-- Logs begin at Wed 2022-09-14 00:20:40 UTC, end at Wed 2022-09-14 01:22:15 UTC. -- Sep 14 00:50:10.476085 dv-cinder-857528-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 14 00:50:10.483327 dv-cinder-857528-1-smb devstack@keystone.service[81466]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 14 00:50:10.485342 dv-cinder-857528-1-smb devstack@keystone.service[81466]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 14 00:50:10 2022] *** Sep 14 00:50:10.485342 dv-cinder-857528-1-smb devstack@keystone.service[81466]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 14 00:50:10.485342 dv-cinder-857528-1-smb devstack@keystone.service[81466]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 14 00:50:10.485342 dv-cinder-857528-1-smb devstack@keystone.service[81466]: nodename: dv-cinder-857528-1-smb Sep 14 00:50:10.485342 dv-cinder-857528-1-smb devstack@keystone.service[81466]: machine: x86_64 Sep 14 00:50:10.485342 dv-cinder-857528-1-smb devstack@keystone.service[81466]: clock source: unix Sep 14 00:50:10.485342 dv-cinder-857528-1-smb devstack@keystone.service[81466]: pcre jit disabled Sep 14 00:50:10.485342 dv-cinder-857528-1-smb devstack@keystone.service[81466]: detected number of CPU cores: 4 Sep 14 00:50:10.485902 dv-cinder-857528-1-smb devstack@keystone.service[81466]: current working directory: / Sep 14 00:50:10.485902 dv-cinder-857528-1-smb devstack@keystone.service[81466]: detected binary path: /usr/bin/uwsgi-core Sep 14 00:50:10.485902 dv-cinder-857528-1-smb devstack@keystone.service[81466]: your processes number limit is 47680 Sep 14 00:50:10.485902 dv-cinder-857528-1-smb devstack@keystone.service[81466]: your memory page size is 4096 bytes Sep 14 00:50:10.485902 dv-cinder-857528-1-smb devstack@keystone.service[81466]: detected max file descriptor number: 2048 Sep 14 00:50:10.485902 dv-cinder-857528-1-smb devstack@keystone.service[81466]: lock engine: pthread robust mutexes Sep 14 00:50:10.485902 dv-cinder-857528-1-smb devstack@keystone.service[81466]: thunder lock: enabled Sep 14 00:50:10.485902 dv-cinder-857528-1-smb devstack@keystone.service[81466]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 14 00:50:10.485902 dv-cinder-857528-1-smb devstack@keystone.service[81466]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 14 00:50:10.525875 dv-cinder-857528-1-smb devstack@keystone.service[81466]: Python main interpreter initialized at 0x55641ddfe9c0 Sep 14 00:50:10.525875 dv-cinder-857528-1-smb devstack@keystone.service[81466]: python threads support enabled Sep 14 00:50:10.525875 dv-cinder-857528-1-smb devstack@keystone.service[81466]: your server socket listen backlog is limited to 100 connections Sep 14 00:50:10.525875 dv-cinder-857528-1-smb devstack@keystone.service[81466]: your mercy for graceful operations on workers is 90 seconds Sep 14 00:50:10.526255 dv-cinder-857528-1-smb devstack@keystone.service[81466]: mapped 403077 bytes (393 KB) for 2 cores Sep 14 00:50:10.526333 dv-cinder-857528-1-smb devstack@keystone.service[81466]: *** Operational MODE: preforking *** Sep 14 00:50:10.526601 dv-cinder-857528-1-smb devstack@keystone.service[81466]: *** uWSGI is running in multiple interpreter mode *** Sep 14 00:50:10.526601 dv-cinder-857528-1-smb devstack@keystone.service[81466]: spawned uWSGI master process (pid: 81466) Sep 14 00:50:10.526790 dv-cinder-857528-1-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 14 00:50:10.527872 dv-cinder-857528-1-smb devstack@keystone.service[81466]: spawned uWSGI worker 1 (pid: 81475, cores: 1) Sep 14 00:50:10.527872 dv-cinder-857528-1-smb devstack@keystone.service[81466]: spawned uWSGI worker 2 (pid: 81476, cores: 1) Sep 14 00:50:10.527872 dv-cinder-857528-1-smb devstack@keystone.service[81466]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 14 00:50:14.773060 dv-cinder-857528-1-smb devstack@keystone.service[81476]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 00:50:14.773060 dv-cinder-857528-1-smb devstack@keystone.service[81476]: from cryptography.utils import int_from_bytes Sep 14 00:50:14.773878 dv-cinder-857528-1-smb devstack@keystone.service[81476]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 00:50:14.773878 dv-cinder-857528-1-smb devstack@keystone.service[81476]: from cryptography.utils import int_from_bytes Sep 14 00:50:14.774716 dv-cinder-857528-1-smb devstack@keystone.service[81475]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 00:50:14.774716 dv-cinder-857528-1-smb devstack@keystone.service[81475]: from cryptography.utils import int_from_bytes Sep 14 00:50:14.775169 dv-cinder-857528-1-smb devstack@keystone.service[81475]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 00:50:14.775169 dv-cinder-857528-1-smb devstack@keystone.service[81475]: from cryptography.utils import int_from_bytes Sep 14 00:50:14.822879 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 00:50:14.823066 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 00:50:14.823253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] command line args: [] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 00:50:14.823518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 00:50:14.823692 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ================================================================================ {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 00:50:14.823943 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] admin_token = **** {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.824186 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] config_dir = [] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.824373 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.824521 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 00:50:14.824606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] config_source = [] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.824717 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] debug = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.824800 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 00:50:14.824909 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] command line args: [] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 00:50:14.824987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.825173 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 00:50:14.825300 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.825376 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ================================================================================ {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 00:50:14.825448 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.825590 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] admin_token = **** {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.825714 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.825845 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] config_dir = [] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.825949 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.826046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.826164 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] list_limit = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.826270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] config_source = [] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.826372 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] log_config_append = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.826475 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] debug = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.826572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.826685 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.826812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] log_dir = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.826915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.827013 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] log_file = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.827121 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.827217 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.827354 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.827433 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.827601 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.827684 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.827801 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] list_limit = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.827881 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.827967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] log_config_append = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.828040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.828106 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.828175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.828301 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] log_dir = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.828387 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.828466 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] log_file = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.828542 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.828658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.828738 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.828816 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.828943 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.829020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.829135 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.829216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.829363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.829452 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.829562 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.829690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.829824 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.829917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.830102 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.830224 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.830342 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.830576 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.830708 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.830810 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.830899 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] publish_errors = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.831045 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.831126 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.831293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.831371 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.831483 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.831567 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.831725 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.831803 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.831963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.832193 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] standard_threads = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.832271 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.832420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.832499 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] publish_errors = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.832657 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.832740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.832818 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.832894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.832990 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] use_journal = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.833069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.833150 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] use_json = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.833284 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.833368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] use_stderr = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.833478 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] use_syslog = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.833561 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.833703 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.833857 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] standard_threads = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.833979 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.834061 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.834214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.834293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.834392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.834477 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.834556 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] use_journal = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.834693 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.834772 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] use_json = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.834897 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] use_stderr = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.834973 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.835073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] use_syslog = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.835153 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.835306 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:50:14.835390 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.835563 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.835642 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.835804 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.835884 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.836065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.836149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.836306 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.836385 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.836533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.836618 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.836776 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.836859 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.837009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.837088 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.837250 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.837334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.837490 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.837567 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.837724 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.837830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.837999 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.838079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.838234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.838312 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.838476 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.838559 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.838708 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.838788 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.838954 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.839031 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.839204 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.839286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.839436 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.839511 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.839688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.839764 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.839917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.840003 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.840145 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.840223 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.840372 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.840456 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.840603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.840689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.840847 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.840925 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.841088 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.841166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.841315 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.841422 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.841546 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.841668 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.841772 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.841915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.842043 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.842137 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.842276 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.842353 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.842520 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.842597 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.842747 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.842837 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.842978 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.843056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.843207 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.843284 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.843433 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.843519 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.843660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.843738 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.843887 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.843970 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.844112 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.844199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.844344 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.844423 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.844586 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.844670 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.844813 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.845012 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.845091 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.845161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.845263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.845348 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.845490 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.845578 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.846257 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.846335 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.846497 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.846575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.846726 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.846816 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.846962 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.847046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.847199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.847275 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.847430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.847514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.847664 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.847741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.847893 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.847970 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.848121 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.848207 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.848364 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.848441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.848582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.848689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.848817 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.848924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.849046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.849160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.849283 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.849388 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.849519 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.849611 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.849731 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.849855 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.849997 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.850080 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.850231 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.850313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.850471 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.850551 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.850704 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.850836 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.850949 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.851034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.851191 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.851272 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.851420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.851498 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.851652 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.851773 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.851883 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.851973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.852125 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.852204 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.852363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.852448 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.852597 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.852679 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.852835 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.852920 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.853069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.853149 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.853304 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.853383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.853535 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.853611 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.853764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.853862 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.854019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.854100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.854249 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.854329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.854479 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.854557 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.854716 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.854794 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.854957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.855034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.855193 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.855270 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.855427 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.855506 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.855659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.855738 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.855893 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.855977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.856125 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.856203 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.856357 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.856435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.856594 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.856723 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.856877 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.856944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.857028 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.857098 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.857260 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.857358 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.857492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.857578 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.857722 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.857824 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.857981 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.858065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.858214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.858313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.858446 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.858537 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.858676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.858755 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.858905 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.858992 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.859141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.859221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.859373 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.859453 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.859607 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] auth.external = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.859693 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.859835 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.859921 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.860081 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.860161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.860319 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.860412 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.860554 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] auth.password = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.860641 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.860781 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] auth.token = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.860863 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.861017 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.861097 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.861294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.861993 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] auth.external = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.862075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.862148 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.862307 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.862413 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.862557 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.862647 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.862803 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.862883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] auth.password = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.863032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.863112 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] auth.token = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.863264 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] credential.caching = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.863356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.863508 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.863588 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.863752 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.863832 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.863989 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.864075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.864227 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.864307 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.864466 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.864546 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.864696 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.864783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.864933 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] credential.caching = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.865013 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.865180 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.865261 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.865412 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.865501 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.865660 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.865741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.867234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.867358 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.867358 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.867494 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.867560 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.867633 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.867700 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.867700 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.867806 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.867873 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] federation.caching = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.867873 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.867873 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.867873 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.868066 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.868197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.868340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.868443 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.868525 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.868692 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.868772 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.868927 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.869009 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.869176 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.869262 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.869411 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.869492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.869654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.869736 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.869961 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity.caching = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.870045 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.870199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] federation.caching = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.870278 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.870444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.870531 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.870677 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.870757 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.870910 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.870990 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.871146 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.871226 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.871373 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.871451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.871606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.871685 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.871837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.871914 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.872087 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.872166 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.872315 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.872393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.872543 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.872624 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.872770 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.872910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.873011 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.873155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity.caching = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.873242 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.873405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.873485 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.873653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.873732 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.873913 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.874067 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.874151 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.874232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.874390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.874470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.874622 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.874710 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.874861 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.874940 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.875111 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.875191 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.875336 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.875423 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.875570 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.875650 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.875801 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.875885 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.876033 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.876122 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.876274 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.876354 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.876504 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.876584 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.876747 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.876838 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.877028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.877107 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.877278 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.877359 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.877549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.877638 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.877789 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.877929 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.878050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.878141 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.878284 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.878373 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.878523 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.878603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.878756 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.878835 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.878992 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.879079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.879231 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.879311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.879465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.879545 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.879702 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.879783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.879932 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.880010 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.880181 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.880285 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.880436 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.880523 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.880673 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.880753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.880919 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.880999 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.881165 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.881247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.881398 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.881478 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.881637 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.881715 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.881895 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.881980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.882125 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.882205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.882361 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.882442 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.882603 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.882685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.882838 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.882916 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.883073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.883151 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.883316 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.883396 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.883559 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.883639 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.883790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.883868 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.884016 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.884096 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.884248 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.884369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.884478 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.884622 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.884709 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.884861 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.884940 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.885099 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.885177 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.885337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.885424 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.885570 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.885650 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.885823 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.885905 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.886092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.886183 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.886319 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.886397 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.886564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.886643 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.886799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.886887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.887033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.887113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.887266 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.887345 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.887496 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.887583 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.887734 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.887814 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.887970 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.888049 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.888202 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.888288 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.888433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.888511 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.888667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.888745 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.888907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.888994 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.889138 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.889218 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.889366 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.889445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.889597 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.889691 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.889853 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.889936 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.890092 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.890171 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.890320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.890412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.890553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.890633 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.890786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.890864 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] resource.caching = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.891023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.891111 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.891263 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.891342 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.891496 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.891575 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.891733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.891820 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.891977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.892056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.892206 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.892283 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.892450 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.892536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.892703 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.892783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.892937 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.893015 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.893168 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] role.caching = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.893254 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.893412 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] role.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.893492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.893640 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.893719 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.893893 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.893987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.894134 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.894215 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.894374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.894452 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] resource.caching = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.894602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.894679 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.894847 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.894927 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.895084 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.895163 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.895323 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.895404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.895566 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.895645 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.895794 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.895873 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.896034 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.896116 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.896271 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.896350 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.896512 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.896591 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.896749 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] role.caching = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.896830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.896995 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] role.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.897134 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.897215 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.897368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.897456 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.897615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.897696 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.897885 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.897969 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.898131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.898223 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.898376 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.898456 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.898607 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.898686 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.898858 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.898946 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.899107 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.899188 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.899343 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.899423 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.899572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.899660 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.899800 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.899880 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.900028 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.900107 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.900275 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.900358 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.900525 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.900662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.900769 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.900899 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.900986 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.901148 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.901228 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.901398 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.901478 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.901645 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.901733 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] token.caching = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.901901 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.901981 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.902140 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.902218 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.902371 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.902461 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.902627 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.902707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.902863 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.902948 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.903094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.903180 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.903323 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.903402 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.903555 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.903635 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.904062 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.904154 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.904296 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.904377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.904533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.904612 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.904765 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.904852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.905000 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.905078 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.905232 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.905312 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.905469 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] token.caching = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.905556 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.905709 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.905821 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.905980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.906060 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.906216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.906296 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.connection = **** {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.906467 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.906548 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.906710 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.906789 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.906945 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.907023 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.907191 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.907273 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.907435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.907514 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.907666 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.907744 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.907899 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.907980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.908663 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.908751 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.908897 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.908977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.909144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.909235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.909398 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.909477 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.909631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.909710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.909899 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.909996 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.910132 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.910213 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.910372 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.910452 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.connection = **** {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.910600 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.910681 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.910836 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.910918 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.911068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.911148 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.911220 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 00:50:14.911332 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.911567 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.911804 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.912040 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.912278 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.912522 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.912758 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.913003 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.913237 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.913484 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.913720 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.913989 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.914221 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.914461 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.914696 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:50:14.914867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 00:50:14.944979 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:14.945206 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:14.945431 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:14.946114 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:14.946346 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:14.946571 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:14.953900 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:14.955180 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:14.982735 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:14.982969 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:14.983130 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:14.983369 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.038761 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.039424 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.088522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.088757 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.089025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.089264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.246025 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.246254 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.246414 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.246505 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.246647 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.246734 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.246869 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.246952 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.247080 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.247173 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.247293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.247507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.270491 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.270720 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.270831 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.270935 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.271100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.271187 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.271331 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.271415 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.271535 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.271620 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.271743 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.271826 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.271968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.272181 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.283205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.284283 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.295836 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.296017 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.296243 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.296343 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.296466 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.296550 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.296682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.296766 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.296893 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.296979 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.297101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.297184 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.297366 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.297585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 00:50:15.314373 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.314610 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 00:50:15.314701 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.314907 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 00:50:15.314992 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.315134 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 00:50:15.315251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.315406 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.315490 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 00:50:15.315667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.315760 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.315930 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.316056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.316184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.316270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.316461 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.325668 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.325956 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.326053 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.326229 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.326332 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.326502 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.326603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.326969 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.334104 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.334942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.336978 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.337259 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.337540 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.337840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.337926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.338131 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.338230 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.338391 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.338474 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.338664 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.338748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.338938 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.339023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.339197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.339277 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.339469 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.339628 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.339739 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.339822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.340010 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.340286 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.340556 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.362970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.364109 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.364418 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.364701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.365571 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.365885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.369340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.369624 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.369934 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.370542 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.370831 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.371117 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.376217 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.376502 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.378159 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.378440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.382799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.383097 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.383386 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.383673 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.383948 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.384151 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.384238 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.384453 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.384538 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.384716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.384810 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.385023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.385302 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.385578 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.385871 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.386142 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.400141 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.400415 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.401659 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.401970 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.404522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.406208 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.407834 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.408148 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.409458 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.409754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.412341 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.414023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.415474 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.417149 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.418694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.418996 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.419281 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.419569 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.419853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.420150 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.420422 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.420730 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.421018 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.421301 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.421579 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.421884 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.436465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.436753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.437036 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.437281 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.438199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.438493 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.438763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.439027 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.444622 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.446184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.446452 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.447704 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.447979 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.448063 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.449520 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.449811 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.450705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.450998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.451279 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.451560 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.451953 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.452470 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.452770 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.453057 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.453343 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.453731 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.463156 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.463441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.463721 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.464003 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.464380 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.464665 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.464902 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.464985 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.465188 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.465473 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.465757 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.466169 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.466448 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.466742 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.480217 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.482352 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.483141 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.485264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.486024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.488088 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.488718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.489540 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.489847 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.490204 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.490301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.491668 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.491952 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.492359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.496629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.498083 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.498743 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.500204 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.500939 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.501331 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.501615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.501969 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.503196 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.503597 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.503887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.504169 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.509698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.510016 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.510299 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.511989 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.512281 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.512561 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.517109 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.517391 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.518223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.518498 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.518778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.519132 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.519403 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.519677 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.519957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.520050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 00:50:15.520239 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.520331 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.520507 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.520609 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.520780 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.520872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.521043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.521135 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.521310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.521627 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.521966 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.522241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.522525 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.522815 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.523089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.523353 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.523629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.524023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 00:50:15.556001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55641ddfe9c0 pid: 81476 (default app) Sep 14 00:50:15.559293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55641ddfe9c0 pid: 81475 (default app) Sep 14 00:50:15.559389 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c90da5-fe9c-4cf7-9a80-415817e69534 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:15.559619 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c90da5-fe9c-4cf7-9a80-415817e69534 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:15.559887 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c90da5-fe9c-4cf7-9a80-415817e69534 None None] PATH_INFO: `/v3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:15.563989 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Wed Sep 14 00:50:15 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:22.273625 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbf01b-5eec-471f-88b7-b9503cdeb643 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:22.274127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbf01b-5eec-471f-88b7-b9503cdeb643 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:22.274127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbf01b-5eec-471f-88b7-b9503cdeb643 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:22.278329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 00:50:22.284411 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c92013-bb79-4732-93b5-6b6682ed5e1f None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:22.284835 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c92013-bb79-4732-93b5-6b6682ed5e1f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:22.284970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c92013-bb79-4732-93b5-6b6682ed5e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:22.355051 dv-cinder-857528-1-smb devstack@keystone.service[81476]: INFO dbcounter [None req-d1c92013-bb79-4732-93b5-6b6682ed5e1f None None] Registered counter for database keystone Sep 14 00:50:22.373473 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG oslo_db.sqlalchemy.engines [None req-d1c92013-bb79-4732-93b5-6b6682ed5e1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 00:50:22.380084 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writer thread running {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 00:50:22.556004 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG passlib.handlers.bcrypt [None req-d1c92013-bb79-4732-93b5-6b6682ed5e1f None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81476) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 14 00:50:22.556311 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG passlib.handlers.bcrypt [None req-d1c92013-bb79-4732-93b5-6b6682ed5e1f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81476) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 14 00:50:22.613818 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-d1c92013-bb79-4732-93b5-6b6682ed5e1f None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:22.615441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d1c92013-bb79-4732-93b5-6b6682ed5e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:22.746913 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 14 00:50:23.211781 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbf01b-5eec-471f-88b7-b9503cdeb643 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:23.281232 dv-cinder-857528-1-smb devstack@keystone.service[81475]: INFO dbcounter [None req-0bcbf01b-5eec-471f-88b7-b9503cdeb643 None None] Registered counter for database keystone Sep 14 00:50:23.303188 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG oslo_db.sqlalchemy.engines [None req-0bcbf01b-5eec-471f-88b7-b9503cdeb643 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 00:50:23.309247 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writer thread running {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 00:50:23.424221 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbf01b-5eec-471f-88b7-b9503cdeb643 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:23.428411 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e201bc-92c4-4cd8-9631-3d27fd302989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:23.429040 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e201bc-92c4-4cd8-9631-3d27fd302989 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:23.429313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e201bc-92c4-4cd8-9631-3d27fd302989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:23.429576 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e201bc-92c4-4cd8-9631-3d27fd302989 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:23.437483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e201bc-92c4-4cd8-9631-3d27fd302989 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:23.489647 dv-cinder-857528-1-smb devstack@keystone.service[81475]: WARNING keystone.common.rbac_enforcer.enforcer [None req-21e201bc-92c4-4cd8-9631-3d27fd302989 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 14 00:50:23.490008 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e201bc-92c4-4cd8-9631-3d27fd302989 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:23.498958 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Wed Sep 14 00:50:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 14 00:50:23.505494 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c92013-bb79-4732-93b5-6b6682ed5e1f None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:23.521793 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c92013-bb79-4732-93b5-6b6682ed5e1f None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:23.526103 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ff7a6-8ccc-4d82-9839-79e48a289318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:23.527201 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ff7a6-8ccc-4d82-9839-79e48a289318 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:23.527479 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ff7a6-8ccc-4d82-9839-79e48a289318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:23.527745 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ff7a6-8ccc-4d82-9839-79e48a289318 admin admin] PATH_INFO: `/v3/projects/77e0a2fe229b4532ac18c75cfe42e13c` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:23.529560 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ff7a6-8ccc-4d82-9839-79e48a289318 admin admin] RBAC: Authorizing `identity:get_project(project_id=77e0a2fe229b4532ac18c75cfe42e13c)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:23.585257 dv-cinder-857528-1-smb devstack@keystone.service[81476]: WARNING keystone.common.rbac_enforcer.enforcer [None req-534ff7a6-8ccc-4d82-9839-79e48a289318 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 14 00:50:23.585533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ff7a6-8ccc-4d82-9839-79e48a289318 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:23.590102 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Wed Sep 14 00:50:23 2022] GET /identity/v3/projects/77e0a2fe229b4532ac18c75cfe42e13c => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:25.701627 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a53ae3-b6dd-4ce8-af9d-3f824daa3c2d None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:25.702188 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a53ae3-b6dd-4ce8-af9d-3f824daa3c2d None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:25.702188 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a53ae3-b6dd-4ce8-af9d-3f824daa3c2d None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:25.706841 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:50:25.712190 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52800c60-6ecd-43ea-a30f-3b871814f424 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:25.712574 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52800c60-6ecd-43ea-a30f-3b871814f424 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:25.712738 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52800c60-6ecd-43ea-a30f-3b871814f424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:25.733079 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-52800c60-6ecd-43ea-a30f-3b871814f424 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:25.734619 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-52800c60-6ecd-43ea-a30f-3b871814f424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:25.742388 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 14 00:50:26.007676 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a53ae3-b6dd-4ce8-af9d-3f824daa3c2d None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:26.019675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a53ae3-b6dd-4ce8-af9d-3f824daa3c2d None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:26.023835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056b08a-c472-4a0b-b4b4-c1f50645c080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:26.024423 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056b08a-c472-4a0b-b4b4-c1f50645c080 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:26.024701 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056b08a-c472-4a0b-b4b4-c1f50645c080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:26.024971 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056b08a-c472-4a0b-b4b4-c1f50645c080 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:26.032684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056b08a-c472-4a0b-b4b4-c1f50645c080 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:26.034511 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056b08a-c472-4a0b-b4b4-c1f50645c080 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:26.043003 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Wed Sep 14 00:50:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 00:50:26.048119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52800c60-6ecd-43ea-a30f-3b871814f424 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:26.057440 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52800c60-6ecd-43ea-a30f-3b871814f424 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:26.061668 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35946114-a54b-4394-95a0-a58771110092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:26.062328 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35946114-a54b-4394-95a0-a58771110092 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:26.062604 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35946114-a54b-4394-95a0-a58771110092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:26.062872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35946114-a54b-4394-95a0-a58771110092 admin admin] PATH_INFO: `/v3/users/07ccce5a2a4546febae17d32e636d9bf` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:26.064788 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35946114-a54b-4394-95a0-a58771110092 admin admin] RBAC: Authorizing `identity:get_user(user_id=07ccce5a2a4546febae17d32e636d9bf)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:26.066632 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35946114-a54b-4394-95a0-a58771110092 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:26.068116 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Wed Sep 14 00:50:26 2022] GET /identity/v3/users/07ccce5a2a4546febae17d32e636d9bf => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:28.258391 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e8200-f85a-4204-a4d2-4148b834665a None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:28.258943 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e8200-f85a-4204-a4d2-4148b834665a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:28.258943 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e8200-f85a-4204-a4d2-4148b834665a None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:28.260161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:50:28.265232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977d835-1fbb-480f-b87a-36359664fea3 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:28.265602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977d835-1fbb-480f-b87a-36359664fea3 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:28.265775 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977d835-1fbb-480f-b87a-36359664fea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:28.284341 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-3977d835-1fbb-480f-b87a-36359664fea3 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:28.285504 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3977d835-1fbb-480f-b87a-36359664fea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:28.306316 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fad2ca-149a-421a-adcb-f6b3eafc8049 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:28.306602 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fad2ca-149a-421a-adcb-f6b3eafc8049 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:28.306869 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fad2ca-149a-421a-adcb-f6b3eafc8049 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:28.308167 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 00:50:28.313160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79e868-627b-48ee-baed-165366872935 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:28.313436 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79e868-627b-48ee-baed-165366872935 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:28.313703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79e868-627b-48ee-baed-165366872935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:28.355456 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG passlib.handlers.bcrypt [None req-ff79e868-627b-48ee-baed-165366872935 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81475) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 14 00:50:28.355844 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG passlib.handlers.bcrypt [None req-ff79e868-627b-48ee-baed-165366872935 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81475) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 14 00:50:28.367434 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:50:28.404957 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ff79e868-627b-48ee-baed-165366872935 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:28.406556 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ff79e868-627b-48ee-baed-165366872935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:28.504311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 00:50:28.631417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977d835-1fbb-480f-b87a-36359664fea3 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:28.654678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:28.734534 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977d835-1fbb-480f-b87a-36359664fea3 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:28.766614 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee1d67-3cce-44e1-aa4e-4346fb8c975c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:28.767764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee1d67-3cce-44e1-aa4e-4346fb8c975c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:28.768039 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee1d67-3cce-44e1-aa4e-4346fb8c975c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:28.771366 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee1d67-3cce-44e1-aa4e-4346fb8c975c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:28.771510 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79e868-627b-48ee-baed-165366872935 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:28.780001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee1d67-3cce-44e1-aa4e-4346fb8c975c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:50:28.789328 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-c2ee1d67-3cce-44e1-aa4e-4346fb8c975c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:50:28.789328 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:50:28.789328 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:50:28.789328 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:50:28.789328 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:50:28.789328 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:50:28.789328 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:50:28.789328 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:50:28.789328 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:50:28.789328 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:50:28.789328 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:50:28.789328 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:50:28.789328 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:50:28.789328 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:50:28.789328 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:50:28.789328 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:50:28.790363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:50:28.790363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:50:28.790363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:50:28.790363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:50:28.790363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:50:28.790363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:50:28.790363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:50:28.790363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:50:28.790363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:50:28.790363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:50:28.790363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:50:28.790363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:50:28.790363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:50:28.790363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:50:28.790363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:50:28.790363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:50:28.791340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:50:28.791340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:50:28.791340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:50:28.791340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:50:28.791340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:50:28.791340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:50:28.791340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:50:28.791340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:50:28.791340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:50:28.791340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:50:28.791340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:50:28.791340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:50:28.791340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:50:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:50:28.796010 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee1d67-3cce-44e1-aa4e-4346fb8c975c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:28.871348 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79e868-627b-48ee-baed-165366872935 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:28.873538 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:28.875845 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:28.895019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee1d67-3cce-44e1-aa4e-4346fb8c975c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:28.909380 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e4582-bec4-43ac-a59a-27da38047329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:28.910274 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e4582-bec4-43ac-a59a-27da38047329 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:28.910558 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e4582-bec4-43ac-a59a-27da38047329 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:28.910829 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e4582-bec4-43ac-a59a-27da38047329 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:28.928577 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b8434-6733-4ea9-a456-945c32d296d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:28.929176 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b8434-6733-4ea9-a456-945c32d296d1 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:28.929453 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b8434-6733-4ea9-a456-945c32d296d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:28.929719 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b8434-6733-4ea9-a456-945c32d296d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:28.930422 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b8434-6733-4ea9-a456-945c32d296d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:50:28.930727 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b8434-6733-4ea9-a456-945c32d296d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:28.932109 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b8434-6733-4ea9-a456-945c32d296d1 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:28.943449 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:50:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:50:28.949110 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b8434-6733-4ea9-a456-945c32d296d1 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:28.981227 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e4582-bec4-43ac-a59a-27da38047329 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:28.982789 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e4582-bec4-43ac-a59a-27da38047329 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:29.047151 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b8434-6733-4ea9-a456-945c32d296d1 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:29.079713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:50:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 00:50:29.080112 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8350d37-e3c6-4b6c-a5b8-30dce2f9ffee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:29.080736 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8350d37-e3c6-4b6c-a5b8-30dce2f9ffee None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:29.081107 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8350d37-e3c6-4b6c-a5b8-30dce2f9ffee None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:29.081381 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8350d37-e3c6-4b6c-a5b8-30dce2f9ffee None admin] PATH_INFO: `/v3/users/07ccce5a2a4546febae17d32e636d9bf` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:29.082556 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8350d37-e3c6-4b6c-a5b8-30dce2f9ffee None admin] RBAC: Authorizing `identity:get_user(user_id=07ccce5a2a4546febae17d32e636d9bf)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:29.084025 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8350d37-e3c6-4b6c-a5b8-30dce2f9ffee None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:29.085192 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e4582-bec4-43ac-a59a-27da38047329 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:29.085867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:50:28 2022] GET /identity/v3/users/07ccce5a2a4546febae17d32e636d9bf => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:50:29.088436 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:29.091285 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8350d37-e3c6-4b6c-a5b8-30dce2f9ffee None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:29.106097 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:29.182425 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e4582-bec4-43ac-a59a-27da38047329 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:29.188828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8350d37-e3c6-4b6c-a5b8-30dce2f9ffee None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:29.216298 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc43af5-a7ee-4fb7-8685-5e8f1e1e350d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:29.217138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc43af5-a7ee-4fb7-8685-5e8f1e1e350d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:29.217415 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc43af5-a7ee-4fb7-8685-5e8f1e1e350d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:29.217683 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc43af5-a7ee-4fb7-8685-5e8f1e1e350d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:29.226236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74c5d4-af9f-496d-a3c8-16e41a790bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:29.226930 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74c5d4-af9f-496d-a3c8-16e41a790bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:29.227207 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74c5d4-af9f-496d-a3c8-16e41a790bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:29.227478 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74c5d4-af9f-496d-a3c8-16e41a790bc7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:29.228592 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74c5d4-af9f-496d-a3c8-16e41a790bc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:29.230089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74c5d4-af9f-496d-a3c8-16e41a790bc7 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:29.231617 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 10/18] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:50:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:29.237651 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74c5d4-af9f-496d-a3c8-16e41a790bc7 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:29.238861 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc43af5-a7ee-4fb7-8685-5e8f1e1e350d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:29.240408 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc43af5-a7ee-4fb7-8685-5e8f1e1e350d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:29.258867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-ebc43af5-a7ee-4fb7-8685-5e8f1e1e350d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:50:29.258867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:50:29.258867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:50:29.258867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:50:29.258867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:50:29.258867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:50:29.258867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:50:29.258867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:50:29.258867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:50:29.258867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:50:29.258867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:50:29.258867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:50:29.258867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:50:29.258867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:50:29.258867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:50:29.258867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:50:29.260241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:50:29.260241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:50:29.260241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:50:29.260241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:50:29.260241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:50:29.260241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:50:29.260241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:50:29.260241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:50:29.260241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:50:29.260241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:50:29.260241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:50:29.260241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:50:29.260241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:50:29.260241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:50:29.260241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:50:29.260241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:50:29.260241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:50:29.261040 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:50:29.261040 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:50:29.261040 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:50:29.261040 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 9/19] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:50:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:50:29.265535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc43af5-a7ee-4fb7-8685-5e8f1e1e350d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:29.320827 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:29.323635 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:29.339930 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74c5d4-af9f-496d-a3c8-16e41a790bc7 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:29.367604 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc43af5-a7ee-4fb7-8685-5e8f1e1e350d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:29.373263 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365c2e3-4910-4a37-b8e4-a60e70399be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:29.373905 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365c2e3-4910-4a37-b8e4-a60e70399be0 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:29.374191 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365c2e3-4910-4a37-b8e4-a60e70399be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:29.374465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365c2e3-4910-4a37-b8e4-a60e70399be0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:29.375184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365c2e3-4910-4a37-b8e4-a60e70399be0 None admin] RBAC: Adding query filter params (role.id=0d7a36bda723430eae02f10f4c775c96, scope.domain.id=default, user.id=07ccce5a2a4546febae17d32e636d9bf) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:50:29.375489 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365c2e3-4910-4a37-b8e4-a60e70399be0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:29.377447 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365c2e3-4910-4a37-b8e4-a60e70399be0 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:29.383872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 11/20] 10.222.0.20 () {56 vars in 1322 bytes} [Wed Sep 14 00:50:29 2022] GET /identity/v3/role_assignments?user.id=07ccce5a2a4546febae17d32e636d9bf&scope.domain.id=default&role.id=0d7a36bda723430eae02f10f4c775c96 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:50:29.400838 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6e892-ba11-46dc-8709-e493adf4f389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:29.401471 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6e892-ba11-46dc-8709-e493adf4f389 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:29.401747 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6e892-ba11-46dc-8709-e493adf4f389 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:29.402048 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6e892-ba11-46dc-8709-e493adf4f389 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:29.402713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6e892-ba11-46dc-8709-e493adf4f389 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:50:29.403012 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6e892-ba11-46dc-8709-e493adf4f389 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:29.404697 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6e892-ba11-46dc-8709-e493adf4f389 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:29.425158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 10/21] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:50:31.821914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a5884-bf74-4db4-89fa-566f435a82a7 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:31.822438 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a5884-bf74-4db4-89fa-566f435a82a7 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:31.822438 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a5884-bf74-4db4-89fa-566f435a82a7 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:31.824066 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 12/22] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:50:31.832426 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed7974-ab19-46c1-a72a-c84523fa8271 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:31.832849 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed7974-ab19-46c1-a72a-c84523fa8271 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:31.833039 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed7974-ab19-46c1-a72a-c84523fa8271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:31.859110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-71ed7974-ab19-46c1-a72a-c84523fa8271 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:31.860312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-71ed7974-ab19-46c1-a72a-c84523fa8271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:31.949708 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 11/23] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 00:50:32.177937 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6dcf1-c9dd-4e88-b00f-f883dc439fe6 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:32.178551 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6dcf1-c9dd-4e88-b00f-f883dc439fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:32.179019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6dcf1-c9dd-4e88-b00f-f883dc439fe6 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:32.180599 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:50:32.185979 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee5aac-b4b2-4b2e-9e83-362d249d5128 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:32.186503 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee5aac-b4b2-4b2e-9e83-362d249d5128 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:32.186972 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee5aac-b4b2-4b2e-9e83-362d249d5128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:32.211313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-89ee5aac-b4b2-4b2e-9e83-362d249d5128 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:32.212875 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-89ee5aac-b4b2-4b2e-9e83-362d249d5128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:32.271698 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:32.302804 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 12/25] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:50:32.380392 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bb871-5063-40a9-ae2f-6c2f04e024fc None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:32.380716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bb871-5063-40a9-ae2f-6c2f04e024fc None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:32.380945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bb871-5063-40a9-ae2f-6c2f04e024fc None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:32.382633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 14/26] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:50:32.387692 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8660c29-abfa-417e-92c9-1470bb980112 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:32.387985 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8660c29-abfa-417e-92c9-1470bb980112 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:32.388265 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8660c29-abfa-417e-92c9-1470bb980112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:32.413261 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-a8660c29-abfa-417e-92c9-1470bb980112 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:32.414523 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a8660c29-abfa-417e-92c9-1470bb980112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:32.487493 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 13/27] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:50:32.504015 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bb871-5063-40a9-ae2f-6c2f04e024fc None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:32.637765 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bb871-5063-40a9-ae2f-6c2f04e024fc None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:32.687930 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494dd6b-38cb-4846-9237-06dd2227b62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:32.688568 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494dd6b-38cb-4846-9237-06dd2227b62b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:32.688918 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494dd6b-38cb-4846-9237-06dd2227b62b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:32.689688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494dd6b-38cb-4846-9237-06dd2227b62b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:32.706019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494dd6b-38cb-4846-9237-06dd2227b62b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:50:32.706731 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a405c-cc35-41fe-a5da-aba9684b8406 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:32.707244 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a405c-cc35-41fe-a5da-aba9684b8406 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:32.707714 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a405c-cc35-41fe-a5da-aba9684b8406 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:32.709554 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 14/28] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:50:32.712082 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-f494dd6b-38cb-4846-9237-06dd2227b62b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:50:32.712082 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:50:32.712082 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:50:32.712082 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:50:32.712082 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:50:32.712082 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:50:32.712082 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:50:32.712082 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:50:32.712082 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:50:32.712082 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:50:32.712082 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:50:32.712082 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:50:32.712082 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:50:32.712082 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:50:32.712082 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:50:32.712082 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:50:32.712893 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:50:32.712893 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:50:32.712893 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:50:32.712893 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:50:32.712893 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:50:32.712893 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:50:32.712893 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:50:32.712893 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:50:32.712893 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:50:32.712893 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:50:32.712893 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:50:32.712893 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:50:32.712893 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:50:32.712893 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:50:32.712893 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:50:32.712893 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:50:32.713672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:50:32.713672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:50:32.713672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:50:32.713672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:50:32.713672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:50:32.713672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:50:32.713672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:50:32.713672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:50:32.713672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:50:32.713672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:50:32.713672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:50:32.713672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:50:32.713672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 15/29] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:50:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:50:32.719324 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cf0ab-ca34-4f6d-a19e-a201b7b76c44 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:32.719863 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cf0ab-ca34-4f6d-a19e-a201b7b76c44 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:32.720376 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cf0ab-ca34-4f6d-a19e-a201b7b76c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:32.726183 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494dd6b-38cb-4846-9237-06dd2227b62b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:32.732766 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:32.755611 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ad2cf0ab-ca34-4f6d-a19e-a201b7b76c44 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:32.756839 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ad2cf0ab-ca34-4f6d-a19e-a201b7b76c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:32.883451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 15/30] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:50:32.884225 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cf0ab-ca34-4f6d-a19e-a201b7b76c44 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:32.897286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494dd6b-38cb-4846-9237-06dd2227b62b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:32.942225 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:32.991265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f0228-bbb8-4534-8d29-1b4cc6478cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:32.991891 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f0228-bbb8-4534-8d29-1b4cc6478cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:32.992171 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f0228-bbb8-4534-8d29-1b4cc6478cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:32.992443 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f0228-bbb8-4534-8d29-1b4cc6478cf2 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:32.993301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f0228-bbb8-4534-8d29-1b4cc6478cf2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:50:32.993607 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f0228-bbb8-4534-8d29-1b4cc6478cf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:32.995046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f0228-bbb8-4534-8d29-1b4cc6478cf2 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:33.008016 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 16/31] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:50:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:50:33.008864 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f0228-bbb8-4534-8d29-1b4cc6478cf2 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:33.082231 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:33.099878 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cf0ab-ca34-4f6d-a19e-a201b7b76c44 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:33.112077 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f0228-bbb8-4534-8d29-1b4cc6478cf2 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:33.154335 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd1ce3-11b9-403e-8239-1f88c7409694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:33.154943 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd1ce3-11b9-403e-8239-1f88c7409694 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:33.155222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd1ce3-11b9-403e-8239-1f88c7409694 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:33.155494 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd1ce3-11b9-403e-8239-1f88c7409694 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:33.156164 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd1ce3-11b9-403e-8239-1f88c7409694 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:33.158063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd1ce3-11b9-403e-8239-1f88c7409694 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:33.185485 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeab799-283c-4b27-9f4e-4dc272864026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:33.187925 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeab799-283c-4b27-9f4e-4dc272864026 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:33.188225 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeab799-283c-4b27-9f4e-4dc272864026 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:33.188506 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeab799-283c-4b27-9f4e-4dc272864026 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:33.211785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeab799-283c-4b27-9f4e-4dc272864026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:33.213360 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeab799-283c-4b27-9f4e-4dc272864026 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:33.239638 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-9eeab799-283c-4b27-9f4e-4dc272864026 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:50:33.239638 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:50:33.239638 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:50:33.239638 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:50:33.239638 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:50:33.239638 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:50:33.239638 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:50:33.239638 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:50:33.239638 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:50:33.239638 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:50:33.239638 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:50:33.239638 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:50:33.239638 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:50:33.239638 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:50:33.239638 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:50:33.239638 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:50:33.240704 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:50:33.240704 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:50:33.240704 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:50:33.240704 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:50:33.240704 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:50:33.240704 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:50:33.240704 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:50:33.240704 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:50:33.240704 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:50:33.240704 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:50:33.240704 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:50:33.240704 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:50:33.240704 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:50:33.240704 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:50:33.240704 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:50:33.240704 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:50:33.240704 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:50:33.241699 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:50:33.241699 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:50:33.241699 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:50:33.243110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 16/32] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:50:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:50:33.248588 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeab799-283c-4b27-9f4e-4dc272864026 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:33.321982 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 17/33] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Sep 14 00:50:33 2022] POST /identity/v3/roles => generated 219 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:50:33.322902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd1ce3-11b9-403e-8239-1f88c7409694 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:33.388319 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:33.410120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeab799-283c-4b27-9f4e-4dc272864026 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:33.450416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e09d4-be44-4014-b5ea-296fdebfd183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:33.451569 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e09d4-be44-4014-b5ea-296fdebfd183 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:33.452072 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e09d4-be44-4014-b5ea-296fdebfd183 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:33.452546 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e09d4-be44-4014-b5ea-296fdebfd183 None admin] PATH_INFO: `/v3/users/07ccce5a2a4546febae17d32e636d9bf` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:33.454499 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e09d4-be44-4014-b5ea-296fdebfd183 None admin] RBAC: Authorizing `identity:get_user(user_id=07ccce5a2a4546febae17d32e636d9bf)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:33.456318 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e09d4-be44-4014-b5ea-296fdebfd183 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:33.458390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 17/34] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:50:33 2022] GET /identity/v3/users/07ccce5a2a4546febae17d32e636d9bf => generated 247 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:33.459622 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e09d4-be44-4014-b5ea-296fdebfd183 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:33.479637 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd1ce3-11b9-403e-8239-1f88c7409694 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:33.509075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:33.518596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016fb7e-cb3b-4bf1-8ad1-fcbc73379ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:33.519209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016fb7e-cb3b-4bf1-8ad1-fcbc73379ead None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:33.519567 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016fb7e-cb3b-4bf1-8ad1-fcbc73379ead None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:33.520236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016fb7e-cb3b-4bf1-8ad1-fcbc73379ead None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:33.521019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016fb7e-cb3b-4bf1-8ad1-fcbc73379ead None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:33.522828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016fb7e-cb3b-4bf1-8ad1-fcbc73379ead None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:33.548928 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 18/35] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Sep 14 00:50:33 2022] POST /identity/v3/roles => generated 225 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:50:33.550600 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5ced6-a36e-4157-a3a3-5162af238208 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:33.551031 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5ced6-a36e-4157-a3a3-5162af238208 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:33.551562 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5ced6-a36e-4157-a3a3-5162af238208 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:33.553079 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:50:33.554039 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5ced6-a36e-4157-a3a3-5162af238208 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:33.594671 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e09d4-be44-4014-b5ea-296fdebfd183 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:33.637612 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05bc6d-f2ee-41f0-958e-f8e2ea52c0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:33.638541 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05bc6d-f2ee-41f0-958e-f8e2ea52c0de None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:33.638918 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05bc6d-f2ee-41f0-958e-f8e2ea52c0de None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:33.639345 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05bc6d-f2ee-41f0-958e-f8e2ea52c0de None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:33.640266 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05bc6d-f2ee-41f0-958e-f8e2ea52c0de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:50:33.640644 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05bc6d-f2ee-41f0-958e-f8e2ea52c0de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:33.643658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05bc6d-f2ee-41f0-958e-f8e2ea52c0de None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:33.658085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 18/37] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:33.661995 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88f0c2-8213-4b26-bd4e-0521046aebd2 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:33.661995 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88f0c2-8213-4b26-bd4e-0521046aebd2 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:33.661995 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88f0c2-8213-4b26-bd4e-0521046aebd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:33.684884 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ac88f0c2-8213-4b26-bd4e-0521046aebd2 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:33.686721 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ac88f0c2-8213-4b26-bd4e-0521046aebd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:33.695030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5ced6-a36e-4157-a3a3-5162af238208 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:33.716524 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:33.742533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3c36b-fba3-412f-8f47-c97e2fb44d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:33.743750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3c36b-fba3-412f-8f47-c97e2fb44d17 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:33.744178 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3c36b-fba3-412f-8f47-c97e2fb44d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:33.744866 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3c36b-fba3-412f-8f47-c97e2fb44d17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:33.746430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3c36b-fba3-412f-8f47-c97e2fb44d17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:33.748917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3c36b-fba3-412f-8f47-c97e2fb44d17 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:33.751081 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:50:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:33.752528 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3c36b-fba3-412f-8f47-c97e2fb44d17 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:33.783768 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 19/39] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:50:33.784047 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88f0c2-8213-4b26-bd4e-0521046aebd2 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:33.838389 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:33.912917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3c36b-fba3-412f-8f47-c97e2fb44d17 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:33.913485 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88f0c2-8213-4b26-bd4e-0521046aebd2 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:33.952860 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195d7f0-01a7-4282-8908-9af585ce0037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:33.956393 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195d7f0-01a7-4282-8908-9af585ce0037 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:33.956393 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195d7f0-01a7-4282-8908-9af585ce0037 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:33.956393 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195d7f0-01a7-4282-8908-9af585ce0037 None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:33.956679 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195d7f0-01a7-4282-8908-9af585ce0037 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:33.958031 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf1dcf-c516-40a4-8d70-aaf7b911bb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:33.958791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf1dcf-c516-40a4-8d70-aaf7b911bb22 None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:33.959243 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf1dcf-c516-40a4-8d70-aaf7b911bb22 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:33.959418 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195d7f0-01a7-4282-8908-9af585ce0037 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:33.959682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf1dcf-c516-40a4-8d70-aaf7b911bb22 None admin] PATH_INFO: `/v3/domains/default/users/07ccce5a2a4546febae17d32e636d9bf/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:33.961766 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf1dcf-c516-40a4-8d70-aaf7b911bb22 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=07ccce5a2a4546febae17d32e636d9bf, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:33.963312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf1dcf-c516-40a4-8d70-aaf7b911bb22 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:33.998163 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Sep 14 00:50:33 2022] POST /identity/v3/projects => generated 301 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:50:33.999881 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cc370-3e59-4e9e-8569-888129dfd068 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:34.000440 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cc370-3e59-4e9e-8569-888129dfd068 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:34.000694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cc370-3e59-4e9e-8569-888129dfd068 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:34.005858 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 22/41] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:50:34.012166 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc560c-f8c6-438a-89e5-271d4a1351d2 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:34.012865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc560c-f8c6-438a-89e5-271d4a1351d2 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:34.013340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc560c-f8c6-438a-89e5-271d4a1351d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:34.044215 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-6edc560c-f8c6-438a-89e5-271d4a1351d2 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:34.045827 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6edc560c-f8c6-438a-89e5-271d4a1351d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:34.104976 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 20/42] 10.222.0.20 () {58 vars in 1361 bytes} [Wed Sep 14 00:50:33 2022] PUT /identity/v3/domains/default/users/07ccce5a2a4546febae17d32e636d9bf/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 00:50:34.106244 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf1dcf-c516-40a4-8d70-aaf7b911bb22 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:34.116880 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:34.131852 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 23/43] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:50:34.241427 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf1dcf-c516-40a4-8d70-aaf7b911bb22 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:34.280037 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31932d2b-127c-4983-872a-9d6140702a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:34.280673 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31932d2b-127c-4983-872a-9d6140702a32 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:34.281013 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31932d2b-127c-4983-872a-9d6140702a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:34.281296 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31932d2b-127c-4983-872a-9d6140702a32 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:34.282015 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31932d2b-127c-4983-872a-9d6140702a32 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:34.284245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31932d2b-127c-4983-872a-9d6140702a32 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:34.306818 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 21/44] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Sep 14 00:50:34 2022] POST /identity/v3/roles => generated 223 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:50:34.426382 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc560c-f8c6-438a-89e5-271d4a1351d2 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:34.464595 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:34.536328 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc560c-f8c6-438a-89e5-271d4a1351d2 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:34.678026 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d3cc5-df99-40d2-ae7b-6f024f166036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:34.678658 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d3cc5-df99-40d2-ae7b-6f024f166036 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:34.678936 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d3cc5-df99-40d2-ae7b-6f024f166036 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:34.679208 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d3cc5-df99-40d2-ae7b-6f024f166036 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:34.680312 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d3cc5-df99-40d2-ae7b-6f024f166036 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:34.681755 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d3cc5-df99-40d2-ae7b-6f024f166036 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:34.683468 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 24/45] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:50:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:34.689009 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31932d2b-127c-4983-872a-9d6140702a32 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:34.752653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:34.788982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31932d2b-127c-4983-872a-9d6140702a32 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:34.820982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416d211-326c-41f0-9ef5-cf6dca1c5133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:34.821592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416d211-326c-41f0-9ef5-cf6dca1c5133 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:34.821901 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416d211-326c-41f0-9ef5-cf6dca1c5133 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:34.822176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416d211-326c-41f0-9ef5-cf6dca1c5133 None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:34.822819 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416d211-326c-41f0-9ef5-cf6dca1c5133 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:34.824274 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416d211-326c-41f0-9ef5-cf6dca1c5133 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:34.852178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 22/46] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Sep 14 00:50:34 2022] POST /identity/v3/projects => generated 312 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:50:36.279969 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6444a8-1d45-495f-8fea-02ad819754d0 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:36.280467 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6444a8-1d45-495f-8fea-02ad819754d0 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:36.280467 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6444a8-1d45-495f-8fea-02ad819754d0 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:36.281766 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 25/47] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:50:36.287801 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6b761-4afd-4877-bbf8-85c075e16a77 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:36.288220 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6b761-4afd-4877-bbf8-85c075e16a77 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:36.288351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6b761-4afd-4877-bbf8-85c075e16a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:36.306577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-fde6b761-4afd-4877-bbf8-85c075e16a77 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:36.308075 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-fde6b761-4afd-4877-bbf8-85c075e16a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:36.372358 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 23/48] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:50:36.643729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6444a8-1d45-495f-8fea-02ad819754d0 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:36.742941 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6444a8-1d45-495f-8fea-02ad819754d0 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:36.745211 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:36.777155 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81acae-5fc3-4da0-a0e2-fd1aea9cfd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:36.777775 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81acae-5fc3-4da0-a0e2-fd1aea9cfd93 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:36.778080 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81acae-5fc3-4da0-a0e2-fd1aea9cfd93 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:36.778347 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81acae-5fc3-4da0-a0e2-fd1aea9cfd93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:36.788453 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81acae-5fc3-4da0-a0e2-fd1aea9cfd93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:50:36.793256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-0c81acae-5fc3-4da0-a0e2-fd1aea9cfd93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:50:36.793256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:50:36.793256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:50:36.793256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:50:36.793256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:50:36.793256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:50:36.793256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:50:36.793256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:50:36.793256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:50:36.793256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:50:36.793256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:50:36.793256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:50:36.793256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:50:36.793256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:50:36.793256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:50:36.793256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:50:36.794251 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:50:36.794251 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:50:36.794251 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:50:36.794251 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:50:36.794251 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:50:36.794251 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:50:36.794251 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:50:36.794251 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:50:36.794251 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:50:36.794251 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:50:36.794251 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:50:36.794251 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:50:36.794251 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:50:36.794251 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:50:36.794251 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:50:36.794251 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:50:36.794983 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:50:36.794983 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:50:36.794983 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:50:36.794983 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:50:36.794983 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:50:36.794983 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:50:36.794983 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:50:36.794983 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:50:36.794983 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:50:36.794983 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:50:36.794983 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:50:36.794983 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:50:36.794983 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 26/49] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:50:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:50:36.800165 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6b761-4afd-4877-bbf8-85c075e16a77 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:36.848834 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:36.903236 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6b761-4afd-4877-bbf8-85c075e16a77 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:36.999012 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8eff25-ea7d-4a83-a399-acc3b9c88c09 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:36.999320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8eff25-ea7d-4a83-a399-acc3b9c88c09 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:36.999564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8eff25-ea7d-4a83-a399-acc3b9c88c09 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:37.001071 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 27/50] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:50:37.006442 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4c449-c2e8-4c5d-8f17-a07da428fd07 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:37.006724 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4c449-c2e8-4c5d-8f17-a07da428fd07 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:37.006993 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4c449-c2e8-4c5d-8f17-a07da428fd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:37.024807 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-08c4c449-c2e8-4c5d-8f17-a07da428fd07 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:37.026035 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-08c4c449-c2e8-4c5d-8f17-a07da428fd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:37.041610 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213c902-2c7d-467b-927f-bba82f40901e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:37.042246 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213c902-2c7d-467b-927f-bba82f40901e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:37.042522 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213c902-2c7d-467b-927f-bba82f40901e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:37.042790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213c902-2c7d-467b-927f-bba82f40901e None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:37.043444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213c902-2c7d-467b-927f-bba82f40901e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:50:37.043740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213c902-2c7d-467b-927f-bba82f40901e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:37.045086 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213c902-2c7d-467b-927f-bba82f40901e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:37.056482 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 24/51] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:50:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:37.062202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213c902-2c7d-467b-927f-bba82f40901e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:37.091225 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 28/52] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 00:50:37.156826 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213c902-2c7d-467b-927f-bba82f40901e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:37.167360 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:37.190038 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573a45f-2863-4778-b107-b173d1c27446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:37.190673 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573a45f-2863-4778-b107-b173d1c27446 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:37.190952 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573a45f-2863-4778-b107-b173d1c27446 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:37.191224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573a45f-2863-4778-b107-b173d1c27446 None admin] PATH_INFO: `/v3/users/07ccce5a2a4546febae17d32e636d9bf` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:37.192347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573a45f-2863-4778-b107-b173d1c27446 None admin] RBAC: Authorizing `identity:get_user(user_id=07ccce5a2a4546febae17d32e636d9bf)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:37.193839 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573a45f-2863-4778-b107-b173d1c27446 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:37.195553 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 25/53] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:50:37 2022] GET /identity/v3/users/07ccce5a2a4546febae17d32e636d9bf => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:50:37.200938 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4c449-c2e8-4c5d-8f17-a07da428fd07 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:37.291014 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:37.298881 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4c449-c2e8-4c5d-8f17-a07da428fd07 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:37.331498 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503ad9c-6f2d-4d0e-ab32-6930cdfc3149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:37.332112 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503ad9c-6f2d-4d0e-ab32-6930cdfc3149 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:37.332386 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503ad9c-6f2d-4d0e-ab32-6930cdfc3149 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:37.332649 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503ad9c-6f2d-4d0e-ab32-6930cdfc3149 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:37.333735 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2503ad9c-6f2d-4d0e-ab32-6930cdfc3149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:37.335192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2503ad9c-6f2d-4d0e-ab32-6930cdfc3149 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:37.336725 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 29/54] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:50:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:37.342480 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573a45f-2863-4778-b107-b173d1c27446 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:37.365647 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503ad9c-6f2d-4d0e-ab32-6930cdfc3149 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:37.443043 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573a45f-2863-4778-b107-b173d1c27446 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:37.463068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503ad9c-6f2d-4d0e-ab32-6930cdfc3149 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:37.476103 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c86f7-c5db-42f0-bd47-0f929355bb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:37.476707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c86f7-c5db-42f0-bd47-0f929355bb13 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:37.476987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c86f7-c5db-42f0-bd47-0f929355bb13 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:37.477284 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c86f7-c5db-42f0-bd47-0f929355bb13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:37.478034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c86f7-c5db-42f0-bd47-0f929355bb13 None admin] RBAC: Adding query filter params (role.id=0d7a36bda723430eae02f10f4c775c96, scope.domain.id=default, user.id=07ccce5a2a4546febae17d32e636d9bf) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:50:37.478339 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c86f7-c5db-42f0-bd47-0f929355bb13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:37.479772 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c86f7-c5db-42f0-bd47-0f929355bb13 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:37.487462 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 26/55] 10.222.0.20 () {56 vars in 1322 bytes} [Wed Sep 14 00:50:37 2022] GET /identity/v3/role_assignments?user.id=07ccce5a2a4546febae17d32e636d9bf&scope.domain.id=default&role.id=0d7a36bda723430eae02f10f4c775c96 => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:37.496093 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809292f-7a25-4160-b5d1-740706cbf732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:37.496751 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809292f-7a25-4160-b5d1-740706cbf732 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:37.497029 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809292f-7a25-4160-b5d1-740706cbf732 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:37.497299 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809292f-7a25-4160-b5d1-740706cbf732 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:37.498581 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809292f-7a25-4160-b5d1-740706cbf732 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:37.500065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809292f-7a25-4160-b5d1-740706cbf732 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:37.502295 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 30/56] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:50:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:50:37.508318 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c86f7-c5db-42f0-bd47-0f929355bb13 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:37.554695 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:37.613000 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c86f7-c5db-42f0-bd47-0f929355bb13 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:37.648940 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f949234-f674-4510-9b1f-5a0efd1a720a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:37.649550 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f949234-f674-4510-9b1f-5a0efd1a720a None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:37.649853 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f949234-f674-4510-9b1f-5a0efd1a720a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:37.650125 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f949234-f674-4510-9b1f-5a0efd1a720a None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:37.650787 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f949234-f674-4510-9b1f-5a0efd1a720a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:37.652218 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f949234-f674-4510-9b1f-5a0efd1a720a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:37.681092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 27/57] 10.222.0.20 () {60 vars in 1140 bytes} [Wed Sep 14 00:50:37 2022] POST /identity/v3/projects => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:50:39.818218 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8f4dc-dca7-48d8-8f5a-1aca8c64678b None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:39.818735 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8f4dc-dca7-48d8-8f5a-1aca8c64678b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:39.818735 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8f4dc-dca7-48d8-8f5a-1aca8c64678b None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:39.820082 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 31/58] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:50:39.825360 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6844549-0136-49c0-a1e1-5c870d01e0d2 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:39.825769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6844549-0136-49c0-a1e1-5c870d01e0d2 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:39.825943 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6844549-0136-49c0-a1e1-5c870d01e0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:39.844208 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-f6844549-0136-49c0-a1e1-5c870d01e0d2 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:39.845391 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f6844549-0136-49c0-a1e1-5c870d01e0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:39.908224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 28/59] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:50:40.174790 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8f4dc-dca7-48d8-8f5a-1aca8c64678b None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:40.203799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:40.273152 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8f4dc-dca7-48d8-8f5a-1aca8c64678b None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:40.306389 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b10e8-0867-4a30-9827-8e7e7d1c2172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:40.307001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b10e8-0867-4a30-9827-8e7e7d1c2172 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:40.307277 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b10e8-0867-4a30-9827-8e7e7d1c2172 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:40.307542 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b10e8-0867-4a30-9827-8e7e7d1c2172 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:40.308617 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b10e8-0867-4a30-9827-8e7e7d1c2172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:40.310066 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b10e8-0867-4a30-9827-8e7e7d1c2172 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:40.311583 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 32/60] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:50:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:40.317600 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6844549-0136-49c0-a1e1-5c870d01e0d2 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:40.341516 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:40.413288 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6844549-0136-49c0-a1e1-5c870d01e0d2 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:40.444948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff22904-c6f7-45c5-8efd-b7c9ce0cd826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:40.445482 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff22904-c6f7-45c5-8efd-b7c9ce0cd826 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:40.445760 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff22904-c6f7-45c5-8efd-b7c9ce0cd826 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:40.446054 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff22904-c6f7-45c5-8efd-b7c9ce0cd826 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:40.446694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff22904-c6f7-45c5-8efd-b7c9ce0cd826 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:40.448097 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff22904-c6f7-45c5-8efd-b7c9ce0cd826 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:40.473298 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 29/61] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 14 00:50:40 2022] POST /identity/v3/users => generated 275 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:50:43.607052 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b66407-4bbc-4ec5-b1d7-fae50a76290d None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:43.608054 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b66407-4bbc-4ec5-b1d7-fae50a76290d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:43.608566 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b66407-4bbc-4ec5-b1d7-fae50a76290d None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:43.610199 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 33/62] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:50:43.615732 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0220e8-5bd2-4f62-8054-f464274833d8 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:43.616518 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0220e8-5bd2-4f62-8054-f464274833d8 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:43.616988 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0220e8-5bd2-4f62-8054-f464274833d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:43.642821 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ce0220e8-5bd2-4f62-8054-f464274833d8 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:43.644024 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ce0220e8-5bd2-4f62-8054-f464274833d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:43.732182 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 30/63] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:50:43.902711 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097f874-7e42-40bb-8cba-ea780be7002d None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:43.903296 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097f874-7e42-40bb-8cba-ea780be7002d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:43.903758 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097f874-7e42-40bb-8cba-ea780be7002d None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:43.905585 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 34/64] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:50:43.911099 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2053714-b8c2-4f78-b505-72b4d9cf4bd3 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:43.911385 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2053714-b8c2-4f78-b505-72b4d9cf4bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:43.911659 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2053714-b8c2-4f78-b505-72b4d9cf4bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:43.938891 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-a2053714-b8c2-4f78-b505-72b4d9cf4bd3 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:43.940107 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a2053714-b8c2-4f78-b505-72b4d9cf4bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:43.943151 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:44.028438 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 31/65] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:50:44.070465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097f874-7e42-40bb-8cba-ea780be7002d None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:44.180755 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:44.187094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097f874-7e42-40bb-8cba-ea780be7002d None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:44.189466 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec6460-9348-4472-8891-6149a85b265f None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:44.189837 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec6460-9348-4472-8891-6149a85b265f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:44.190165 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec6460-9348-4472-8891-6149a85b265f None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:44.191983 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 32/66] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:50:44.203877 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510c497-094e-4286-8cfb-dd71b521c531 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:44.204251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510c497-094e-4286-8cfb-dd71b521c531 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:44.204538 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510c497-094e-4286-8cfb-dd71b521c531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:44.231429 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-5510c497-094e-4286-8cfb-dd71b521c531 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:44.232616 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5510c497-094e-4286-8cfb-dd71b521c531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:44.255205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a764f-ff3d-4ec2-9da6-3fe8e0261df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:44.255835 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a764f-ff3d-4ec2-9da6-3fe8e0261df4 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:44.256111 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a764f-ff3d-4ec2-9da6-3fe8e0261df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:44.256377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a764f-ff3d-4ec2-9da6-3fe8e0261df4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:44.276468 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a764f-ff3d-4ec2-9da6-3fe8e0261df4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:50:44.283420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-e57a764f-ff3d-4ec2-9da6-3fe8e0261df4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:50:44.283420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:50:44.283420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:50:44.283420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:50:44.283420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:50:44.283420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:50:44.283420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:50:44.283420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:50:44.283420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:50:44.283420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:50:44.283420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:50:44.283420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:50:44.283420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:50:44.283420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:50:44.283420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:50:44.283420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:50:44.284253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:50:44.284253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:50:44.284253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:50:44.284253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:50:44.284253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:50:44.284253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:50:44.284253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:50:44.284253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:50:44.284253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:50:44.284253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:50:44.284253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:50:44.284253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:50:44.284253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:50:44.284253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:50:44.284253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:50:44.284253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:50:44.284993 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:50:44.284993 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:50:44.284993 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:50:44.284993 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:50:44.284993 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:50:44.284993 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:50:44.284993 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:50:44.284993 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:50:44.284993 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:50:44.284993 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:50:44.284993 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:50:44.284993 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:50:44.284993 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 35/67] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:50:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:50:44.291810 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a764f-ff3d-4ec2-9da6-3fe8e0261df4 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:44.362279 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 33/68] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:50:44.363403 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510c497-094e-4286-8cfb-dd71b521c531 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:44.435313 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a764f-ff3d-4ec2-9da6-3fe8e0261df4 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:44.491786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90068c-aec9-4794-bc8d-9f2f8db62a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:44.492965 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90068c-aec9-4794-bc8d-9f2f8db62a77 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:44.493988 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90068c-aec9-4794-bc8d-9f2f8db62a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:44.494445 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90068c-aec9-4794-bc8d-9f2f8db62a77 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:44.495537 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90068c-aec9-4794-bc8d-9f2f8db62a77 None admin] RBAC: Adding query filter params (name=member) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:50:44.496379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:44.496681 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90068c-aec9-4794-bc8d-9f2f8db62a77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:44.499352 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90068c-aec9-4794-bc8d-9f2f8db62a77 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:44.509685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 36/69] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 14 00:50:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:44.511179 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a522a5-f411-4976-b547-33a25158c4e5 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:44.511645 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a522a5-f411-4976-b547-33a25158c4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:44.512131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a522a5-f411-4976-b547-33a25158c4e5 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:44.513504 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 37/70] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:50:44.514909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd4616-3cf3-4196-99df-7205f7ac0f1a None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:44.515423 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd4616-3cf3-4196-99df-7205f7ac0f1a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:44.515869 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd4616-3cf3-4196-99df-7205f7ac0f1a None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:44.517277 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 38/71] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:50:44.519219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd4616-3cf3-4196-99df-7205f7ac0f1a None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:44.535571 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510c497-094e-4286-8cfb-dd71b521c531 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:44.544174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:44.571235 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9b4f1-97d5-413d-bd77-6f4bf80c6304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:44.571869 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9b4f1-97d5-413d-bd77-6f4bf80c6304 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:44.572156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9b4f1-97d5-413d-bd77-6f4bf80c6304 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:44.572425 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9b4f1-97d5-413d-bd77-6f4bf80c6304 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:44.583783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9b4f1-97d5-413d-bd77-6f4bf80c6304 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:50:44.590194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-75c9b4f1-97d5-413d-bd77-6f4bf80c6304 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:50:44.590194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:50:44.590194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:50:44.590194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:50:44.590194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:50:44.590194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:50:44.590194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:50:44.590194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:50:44.590194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:50:44.590194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:50:44.590194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:50:44.590194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:50:44.590194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:50:44.590194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:50:44.590194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:50:44.590194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:50:44.591021 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:50:44.591021 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:50:44.591021 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:50:44.591021 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:50:44.591021 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:50:44.591021 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:50:44.591021 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:50:44.591021 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:50:44.591021 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:50:44.591021 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:50:44.591021 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:50:44.591021 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:50:44.591021 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:50:44.591021 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:50:44.591021 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:50:44.591021 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:50:44.591778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:50:44.591778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:50:44.591778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:50:44.591778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:50:44.591778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:50:44.591778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:50:44.591778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:50:44.591778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:50:44.591778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:50:44.591778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:50:44.591778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:50:44.591778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:50:44.591778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 34/72] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:50:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:50:44.592820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f6a18-90c2-4dfb-ae1f-04e3506d3c19 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:44.592820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f6a18-90c2-4dfb-ae1f-04e3506d3c19 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:44.593275 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f6a18-90c2-4dfb-ae1f-04e3506d3c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:44.611029 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-be7f6a18-90c2-4dfb-ae1f-04e3506d3c19 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:44.612213 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-be7f6a18-90c2-4dfb-ae1f-04e3506d3c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:44.637648 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd4616-3cf3-4196-99df-7205f7ac0f1a None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:44.676255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac980a3-fbf4-4764-802d-e91e1877601d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:44.676879 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac980a3-fbf4-4764-802d-e91e1877601d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:44.677155 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac980a3-fbf4-4764-802d-e91e1877601d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:44.677428 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac980a3-fbf4-4764-802d-e91e1877601d None admin] PATH_INFO: `/v3/users/4fde697280c34660bcd0b9ec24ba1a9a` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:44.680707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 35/73] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:50:44.681982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cf893-46f1-4cff-80d5-7595465950d0 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:44.682270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cf893-46f1-4cff-80d5-7595465950d0 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:44.682543 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cf893-46f1-4cff-80d5-7595465950d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:44.691716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac980a3-fbf4-4764-802d-e91e1877601d None admin] RBAC: Authorizing `identity:get_user(user_id=4fde697280c34660bcd0b9ec24ba1a9a)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:44.693091 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac980a3-fbf4-4764-802d-e91e1877601d None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:44.694757 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 39/74] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:50:44 2022] GET /identity/v3/users/4fde697280c34660bcd0b9ec24ba1a9a => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:44.695517 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac980a3-fbf4-4764-802d-e91e1877601d None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:44.705891 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-3b3cf893-46f1-4cff-80d5-7595465950d0 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:44.707998 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3b3cf893-46f1-4cff-80d5-7595465950d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:44.768543 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:44.779354 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:44.782302 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 36/75] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:50:44.783788 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3cf893-46f1-4cff-80d5-7595465950d0 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:44.808865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac980a3-fbf4-4764-802d-e91e1877601d None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:44.847619 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781fe86-fd1a-4f27-8731-4fb69a5bba55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:44.848370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781fe86-fd1a-4f27-8731-4fb69a5bba55 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:44.848751 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781fe86-fd1a-4f27-8731-4fb69a5bba55 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:44.849097 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781fe86-fd1a-4f27-8731-4fb69a5bba55 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:44.849869 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781fe86-fd1a-4f27-8731-4fb69a5bba55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:50:44.850243 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781fe86-fd1a-4f27-8731-4fb69a5bba55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:44.851745 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781fe86-fd1a-4f27-8731-4fb69a5bba55 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:44.861878 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 40/76] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:50:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:44.867474 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781fe86-fd1a-4f27-8731-4fb69a5bba55 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:44.924557 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3cf893-46f1-4cff-80d5-7595465950d0 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:44.966666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562071d8-259e-405f-9606-35375dbaea2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:44.967497 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562071d8-259e-405f-9606-35375dbaea2f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:44.967932 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562071d8-259e-405f-9606-35375dbaea2f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:44.968207 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562071d8-259e-405f-9606-35375dbaea2f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:44.974195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781fe86-fd1a-4f27-8731-4fb69a5bba55 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:44.979668 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562071d8-259e-405f-9606-35375dbaea2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:50:44.984585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-562071d8-259e-405f-9606-35375dbaea2f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 00:50:44.984585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:50:44.984585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:50:44.984585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:50:44.984585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:50:44.984585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:50:44.984585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:50:44.984585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:50:44.984585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:50:44.984585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:50:44.984585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:50:44.984585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:50:44.984585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:50:44.984585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:50:44.984585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:50:44.984585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:50:44.985536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:50:44.985536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:50:44.985536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:50:44.985536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:50:44.985536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:50:44.985536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:50:44.985536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:50:44.985536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:50:44.985536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:50:44.985536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:50:44.985536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:50:44.985536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:50:44.985536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:50:44.985536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:50:44.985536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:50:44.985536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:50:44.986309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:50:44.986309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:50:44.986309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:50:44.986309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:50:44.986309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:50:44.986309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:50:44.986309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:50:44.986309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:50:44.986309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:50:44.986309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:50:44.986309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 00:50:44.986309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:50:44.986309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 37/77] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 14 00:50:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:50:44.987869 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562071d8-259e-405f-9606-35375dbaea2f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:45.018887 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf9b18-b93c-4ec2-8606-7cfe194352d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:45.019495 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf9b18-b93c-4ec2-8606-7cfe194352d5 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:45.019780 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf9b18-b93c-4ec2-8606-7cfe194352d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:45.020054 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf9b18-b93c-4ec2-8606-7cfe194352d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:45.030704 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:45.044264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:45.088230 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf9b18-b93c-4ec2-8606-7cfe194352d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:45.089701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf9b18-b93c-4ec2-8606-7cfe194352d5 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:45.097426 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562071d8-259e-405f-9606-35375dbaea2f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:45.131607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac4064-0ca6-40d4-9f5b-c7dedafb5233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:45.132231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac4064-0ca6-40d4-9f5b-c7dedafb5233 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:45.132513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac4064-0ca6-40d4-9f5b-c7dedafb5233 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:45.132786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac4064-0ca6-40d4-9f5b-c7dedafb5233 None admin] PATH_INFO: `/v3/users/07ccce5a2a4546febae17d32e636d9bf` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:45.133946 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac4064-0ca6-40d4-9f5b-c7dedafb5233 None admin] RBAC: Authorizing `identity:get_user(user_id=07ccce5a2a4546febae17d32e636d9bf)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:45.135371 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac4064-0ca6-40d4-9f5b-c7dedafb5233 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:45.136953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 38/78] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:50:44 2022] GET /identity/v3/users/07ccce5a2a4546febae17d32e636d9bf => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:45.137719 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac4064-0ca6-40d4-9f5b-c7dedafb5233 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:45.190554 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 41/79] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:50:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:50:45.191661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf9b18-b93c-4ec2-8606-7cfe194352d5 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:45.238542 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac4064-0ca6-40d4-9f5b-c7dedafb5233 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:45.238966 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:45.256631 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:45.274055 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9aaa6-3564-4568-bdd2-8e1ab9148c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:45.274689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9aaa6-3564-4568-bdd2-8e1ab9148c2b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:45.274969 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9aaa6-3564-4568-bdd2-8e1ab9148c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:45.275239 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9aaa6-3564-4568-bdd2-8e1ab9148c2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:45.285476 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9aaa6-3564-4568-bdd2-8e1ab9148c2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:50:45.290754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-acb9aaa6-3564-4568-bdd2-8e1ab9148c2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:50:45.290754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:50:45.290754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:50:45.290754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:50:45.290754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:50:45.290754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:50:45.290754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:50:45.290754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:50:45.290754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:50:45.290754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:50:45.290754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:50:45.290754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:50:45.290754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:50:45.290754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:50:45.290754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:50:45.290754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:50:45.291614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:50:45.291614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:50:45.291614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:50:45.291614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:50:45.291614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:50:45.291614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:50:45.291614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:50:45.291614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:50:45.291614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:50:45.291614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:50:45.291614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:50:45.291614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:50:45.291614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:50:45.291614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:50:45.291614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:50:45.291614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:50:45.292347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:50:45.292347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:50:45.292347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:50:45.292347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:50:45.292347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:50:45.292347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:50:45.292347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:50:45.292347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:50:45.292347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:50:45.292347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:50:45.292347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:50:45.292347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:50:45.292347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 39/80] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:50:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:50:45.292958 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9aaa6-3564-4568-bdd2-8e1ab9148c2b None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:45.301609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf9b18-b93c-4ec2-8606-7cfe194352d5 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:45.336668 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50980dbb-cedf-4498-a6e5-96cc424f45ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:45.337262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50980dbb-cedf-4498-a6e5-96cc424f45ab None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:45.337542 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50980dbb-cedf-4498-a6e5-96cc424f45ab None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:45.337832 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50980dbb-cedf-4498-a6e5-96cc424f45ab None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:45.338491 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50980dbb-cedf-4498-a6e5-96cc424f45ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:50:45.338787 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50980dbb-cedf-4498-a6e5-96cc424f45ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:45.340160 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50980dbb-cedf-4498-a6e5-96cc424f45ab None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:45.348480 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 42/81] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:50:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:45.349261 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50980dbb-cedf-4498-a6e5-96cc424f45ab None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:45.398168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9aaa6-3564-4568-bdd2-8e1ab9148c2b None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:45.431332 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6557048-ed26-4105-a1b1-83530374582b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:45.431954 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6557048-ed26-4105-a1b1-83530374582b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:45.432254 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6557048-ed26-4105-a1b1-83530374582b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:45.432509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6557048-ed26-4105-a1b1-83530374582b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:45.433597 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6557048-ed26-4105-a1b1-83530374582b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:45.435058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6557048-ed26-4105-a1b1-83530374582b None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:45.436859 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 40/82] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:50:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:45.437366 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6557048-ed26-4105-a1b1-83530374582b None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:45.446928 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50980dbb-cedf-4498-a6e5-96cc424f45ab None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:45.448448 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:45.480865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22aa8db-5a71-43d4-a23a-7ced50381eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:45.481457 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22aa8db-5a71-43d4-a23a-7ced50381eeb None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:45.481735 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22aa8db-5a71-43d4-a23a-7ced50381eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:45.482036 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22aa8db-5a71-43d4-a23a-7ced50381eeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:45.482645 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:45.537442 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6557048-ed26-4105-a1b1-83530374582b None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:45.548209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22aa8db-5a71-43d4-a23a-7ced50381eeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:45.549651 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22aa8db-5a71-43d4-a23a-7ced50381eeb None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:45.569507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070935b7-a16e-460d-81ec-8063b824bb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:45.570158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070935b7-a16e-460d-81ec-8063b824bb98 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:45.570436 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070935b7-a16e-460d-81ec-8063b824bb98 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:45.570714 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070935b7-a16e-460d-81ec-8063b824bb98 None admin] PATH_INFO: `/v3/projects/6b02aee449a54bf3bb79025645d7f35e` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:45.571819 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070935b7-a16e-460d-81ec-8063b824bb98 None admin] RBAC: Authorizing `identity:get_project(project_id=6b02aee449a54bf3bb79025645d7f35e)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:45.573243 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070935b7-a16e-460d-81ec-8063b824bb98 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:45.574895 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 41/83] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:50:45 2022] GET /identity/v3/projects/6b02aee449a54bf3bb79025645d7f35e => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:45.578646 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070935b7-a16e-460d-81ec-8063b824bb98 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:45.646683 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 43/84] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:50:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:50:45.647543 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22aa8db-5a71-43d4-a23a-7ced50381eeb None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:45.649715 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:45.676635 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070935b7-a16e-460d-81ec-8063b824bb98 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:45.690266 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:45.710071 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8f4ac-7a10-4d9c-9c7c-6b0c1aa0878f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:45.710672 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8f4ac-7a10-4d9c-9c7c-6b0c1aa0878f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:45.710953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8f4ac-7a10-4d9c-9c7c-6b0c1aa0878f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:45.711223 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8f4ac-7a10-4d9c-9c7c-6b0c1aa0878f None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:45.711903 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8f4ac-7a10-4d9c-9c7c-6b0c1aa0878f None admin] RBAC: Adding query filter params (name=member) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:50:45.712203 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8f4ac-7a10-4d9c-9c7c-6b0c1aa0878f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:45.713611 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8f4ac-7a10-4d9c-9c7c-6b0c1aa0878f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:45.722333 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 42/85] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 14 00:50:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:45.723096 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8f4ac-7a10-4d9c-9c7c-6b0c1aa0878f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:45.746967 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22aa8db-5a71-43d4-a23a-7ced50381eeb None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:45.781000 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9818c0f-befd-4a4c-9e15-db487519c379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:45.781616 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9818c0f-befd-4a4c-9e15-db487519c379 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:45.781932 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9818c0f-befd-4a4c-9e15-db487519c379 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:45.782718 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9818c0f-befd-4a4c-9e15-db487519c379 None admin] PATH_INFO: `/v3/users/4fde697280c34660bcd0b9ec24ba1a9a` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:45.784290 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9818c0f-befd-4a4c-9e15-db487519c379 None admin] RBAC: Authorizing `identity:get_user(user_id=4fde697280c34660bcd0b9ec24ba1a9a)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:45.785734 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9818c0f-befd-4a4c-9e15-db487519c379 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:45.787314 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 44/86] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:50:45 2022] GET /identity/v3/users/4fde697280c34660bcd0b9ec24ba1a9a => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:45.788123 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9818c0f-befd-4a4c-9e15-db487519c379 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:45.824954 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8f4ac-7a10-4d9c-9c7c-6b0c1aa0878f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:45.855799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:45.859823 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d8b6a-4f01-4d3e-a00d-a25a217e2aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:45.860480 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d8b6a-4f01-4d3e-a00d-a25a217e2aed None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:45.860762 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d8b6a-4f01-4d3e-a00d-a25a217e2aed None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:45.861030 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d8b6a-4f01-4d3e-a00d-a25a217e2aed None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:45.861676 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d8b6a-4f01-4d3e-a00d-a25a217e2aed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:45.863153 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d8b6a-4f01-4d3e-a00d-a25a217e2aed None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:45.885023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 43/87] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 14 00:50:45 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:50:45.885837 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d8b6a-4f01-4d3e-a00d-a25a217e2aed None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:45.895445 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9818c0f-befd-4a4c-9e15-db487519c379 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:45.926022 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:45.946609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9b974-a994-43f9-985a-7bda88a5a08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:45.947246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9b974-a994-43f9-985a-7bda88a5a08e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:45.947532 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9b974-a994-43f9-985a-7bda88a5a08e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:45.947837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9b974-a994-43f9-985a-7bda88a5a08e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:45.948595 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9b974-a994-43f9-985a-7bda88a5a08e None admin] RBAC: Adding query filter params (role.id=ee3984f710984de6bf564de3bee00d33, scope.project.id=6b02aee449a54bf3bb79025645d7f35e, user.id=4fde697280c34660bcd0b9ec24ba1a9a) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:50:45.948906 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9b974-a994-43f9-985a-7bda88a5a08e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:45.950448 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9b974-a994-43f9-985a-7bda88a5a08e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:45.957068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 45/88] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:50:45 2022] GET /identity/v3/role_assignments?user.id=4fde697280c34660bcd0b9ec24ba1a9a&scope.project.id=6b02aee449a54bf3bb79025645d7f35e&role.id=ee3984f710984de6bf564de3bee00d33 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:45.957764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9b974-a994-43f9-985a-7bda88a5a08e None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:46.028879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d8b6a-4f01-4d3e-a00d-a25a217e2aed None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:46.078582 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76365c-6cc4-4744-a586-47f23bc678f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:46.079852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76365c-6cc4-4744-a586-47f23bc678f2 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:46.080315 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76365c-6cc4-4744-a586-47f23bc678f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:46.080687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76365c-6cc4-4744-a586-47f23bc678f2 None admin] PATH_INFO: `/v3/projects/6b02aee449a54bf3bb79025645d7f35e` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:46.082160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76365c-6cc4-4744-a586-47f23bc678f2 None admin] RBAC: Authorizing `identity:get_project(project_id=6b02aee449a54bf3bb79025645d7f35e)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:46.083768 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76365c-6cc4-4744-a586-47f23bc678f2 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:46.084050 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9b974-a994-43f9-985a-7bda88a5a08e None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:46.085705 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 44/89] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:50:45 2022] GET /identity/v3/projects/6b02aee449a54bf3bb79025645d7f35e => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:46.086621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76365c-6cc4-4744-a586-47f23bc678f2 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:46.125845 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c2146-bc85-47e8-bbfe-30b0cbe9a8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:46.127727 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c2146-bc85-47e8-bbfe-30b0cbe9a8cc None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:46.128166 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c2146-bc85-47e8-bbfe-30b0cbe9a8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:46.128591 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c2146-bc85-47e8-bbfe-30b0cbe9a8cc None admin] PATH_INFO: `/v3/users/4fde697280c34660bcd0b9ec24ba1a9a` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:46.130172 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c2146-bc85-47e8-bbfe-30b0cbe9a8cc None admin] RBAC: Authorizing `identity:get_user(user_id=4fde697280c34660bcd0b9ec24ba1a9a)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:46.131968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c2146-bc85-47e8-bbfe-30b0cbe9a8cc None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:46.134835 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 46/90] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:50:45 2022] GET /identity/v3/users/4fde697280c34660bcd0b9ec24ba1a9a => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:46.135671 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c2146-bc85-47e8-bbfe-30b0cbe9a8cc None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:46.140310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:46.211334 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:46.213732 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76365c-6cc4-4744-a586-47f23bc678f2 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:46.259594 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d2566-edd2-4e9a-abaf-57a6fcc376ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:46.260205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d2566-edd2-4e9a-abaf-57a6fcc376ba None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:46.260493 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d2566-edd2-4e9a-abaf-57a6fcc376ba None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:46.260775 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d2566-edd2-4e9a-abaf-57a6fcc376ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:46.271137 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c2146-bc85-47e8-bbfe-30b0cbe9a8cc None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:46.318303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b25ee6-a943-4e7f-a9d6-ba36c8ea8bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:46.318918 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b25ee6-a943-4e7f-a9d6-ba36c8ea8bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:46.319198 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b25ee6-a943-4e7f-a9d6-ba36c8ea8bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:46.319468 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b25ee6-a943-4e7f-a9d6-ba36c8ea8bc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:46.320301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b25ee6-a943-4e7f-a9d6-ba36c8ea8bc1 None admin] RBAC: Adding query filter params (role.id=0d7a36bda723430eae02f10f4c775c96, scope.project.id=6b02aee449a54bf3bb79025645d7f35e, user.id=07ccce5a2a4546febae17d32e636d9bf) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:50:46.320613 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b25ee6-a943-4e7f-a9d6-ba36c8ea8bc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:46.322291 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b25ee6-a943-4e7f-a9d6-ba36c8ea8bc1 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:46.328859 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 47/91] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:50:46 2022] GET /identity/v3/role_assignments?user.id=07ccce5a2a4546febae17d32e636d9bf&scope.project.id=6b02aee449a54bf3bb79025645d7f35e&role.id=0d7a36bda723430eae02f10f4c775c96 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:46.329778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b25ee6-a943-4e7f-a9d6-ba36c8ea8bc1 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:46.336434 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d2566-edd2-4e9a-abaf-57a6fcc376ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:46.338322 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d2566-edd2-4e9a-abaf-57a6fcc376ba None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:46.414531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:46.461787 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b25ee6-a943-4e7f-a9d6-ba36c8ea8bc1 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:46.478036 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:46.482831 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 45/92] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:50:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:50:46.491015 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d2566-edd2-4e9a-abaf-57a6fcc376ba None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:46.519805 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7be206-f3a3-4321-9dd5-186a3ff3b8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:46.520607 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7be206-f3a3-4321-9dd5-186a3ff3b8ee None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:46.520988 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7be206-f3a3-4321-9dd5-186a3ff3b8ee None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:46.521363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7be206-f3a3-4321-9dd5-186a3ff3b8ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:46.670772 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7be206-f3a3-4321-9dd5-186a3ff3b8ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:46.672189 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7be206-f3a3-4321-9dd5-186a3ff3b8ee None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:46.691177 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d2566-edd2-4e9a-abaf-57a6fcc376ba None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:46.761487 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:46.810531 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722684b-bf97-4e4b-8d45-7f1618f4f18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:46.811574 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722684b-bf97-4e4b-8d45-7f1618f4f18d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:46.812052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722684b-bf97-4e4b-8d45-7f1618f4f18d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:46.812517 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722684b-bf97-4e4b-8d45-7f1618f4f18d None admin] PATH_INFO: `/v3/projects/6b02aee449a54bf3bb79025645d7f35e` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:46.814065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722684b-bf97-4e4b-8d45-7f1618f4f18d None admin] RBAC: Authorizing `identity:get_project(project_id=6b02aee449a54bf3bb79025645d7f35e)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:46.815719 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722684b-bf97-4e4b-8d45-7f1618f4f18d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:46.817570 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 46/93] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:50:46 2022] GET /identity/v3/projects/6b02aee449a54bf3bb79025645d7f35e => generated 298 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:46.821860 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 48/94] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:50:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:50:46.823496 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722684b-bf97-4e4b-8d45-7f1618f4f18d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:46.824367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7be206-f3a3-4321-9dd5-186a3ff3b8ee None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:46.945253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7be206-f3a3-4321-9dd5-186a3ff3b8ee None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:46.972000 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:46.987466 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bbadd-6ea2-44e5-b8dd-2b4ae88696f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:46.988407 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bbadd-6ea2-44e5-b8dd-2b4ae88696f1 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:46.988842 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bbadd-6ea2-44e5-b8dd-2b4ae88696f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:46.989865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bbadd-6ea2-44e5-b8dd-2b4ae88696f1 None admin] PATH_INFO: `/v3/projects/980fa17c43e9422b92284f2941735783` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:46.991228 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bbadd-6ea2-44e5-b8dd-2b4ae88696f1 None admin] RBAC: Authorizing `identity:get_project(project_id=980fa17c43e9422b92284f2941735783)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:46.992899 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bbadd-6ea2-44e5-b8dd-2b4ae88696f1 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:46.995221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 49/95] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:50:46 2022] GET /identity/v3/projects/980fa17c43e9422b92284f2941735783 => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:50:47.006874 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bbadd-6ea2-44e5-b8dd-2b4ae88696f1 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:47.023783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722684b-bf97-4e4b-8d45-7f1618f4f18d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:47.063013 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:47.066652 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5622a-b37b-4a43-8947-0e43fcc015c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:47.067519 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5622a-b37b-4a43-8947-0e43fcc015c5 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:47.067990 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5622a-b37b-4a43-8947-0e43fcc015c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:47.068452 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5622a-b37b-4a43-8947-0e43fcc015c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:47.069393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5622a-b37b-4a43-8947-0e43fcc015c5 None admin] RBAC: Adding query filter params (role.id=8373a23ee4ff4c7d94e82480d85b586b, scope.project.id=6b02aee449a54bf3bb79025645d7f35e, user.id=4fde697280c34660bcd0b9ec24ba1a9a) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:50:47.069939 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5622a-b37b-4a43-8947-0e43fcc015c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:47.071593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5622a-b37b-4a43-8947-0e43fcc015c5 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:47.085831 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 47/96] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:50:46 2022] GET /identity/v3/role_assignments?user.id=4fde697280c34660bcd0b9ec24ba1a9a&scope.project.id=6b02aee449a54bf3bb79025645d7f35e&role.id=8373a23ee4ff4c7d94e82480d85b586b => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:47.162546 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bbadd-6ea2-44e5-b8dd-2b4ae88696f1 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:47.211575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31408194-e7bd-40be-a237-a13792521e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:47.212108 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31408194-e7bd-40be-a237-a13792521e19 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:47.212390 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31408194-e7bd-40be-a237-a13792521e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:47.212664 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31408194-e7bd-40be-a237-a13792521e19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:47.213398 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31408194-e7bd-40be-a237-a13792521e19 None admin] RBAC: Adding query filter params (role.id=ee3984f710984de6bf564de3bee00d33, scope.project.id=980fa17c43e9422b92284f2941735783, user.id=4fde697280c34660bcd0b9ec24ba1a9a) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:50:47.213706 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31408194-e7bd-40be-a237-a13792521e19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:47.215199 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31408194-e7bd-40be-a237-a13792521e19 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:47.221771 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 50/97] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:50:47 2022] GET /identity/v3/role_assignments?user.id=4fde697280c34660bcd0b9ec24ba1a9a&scope.project.id=980fa17c43e9422b92284f2941735783&role.id=ee3984f710984de6bf564de3bee00d33 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:50:48.745079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f93ad-d234-41fd-8644-4fcb2293cb1e None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:48.746155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f93ad-d234-41fd-8644-4fcb2293cb1e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:48.746638 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f93ad-d234-41fd-8644-4fcb2293cb1e None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:48.748174 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 48/98] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:50:48.754272 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70769f-2b21-4f62-9f40-080644befc0d None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:48.754687 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70769f-2b21-4f62-9f40-080644befc0d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:48.754892 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70769f-2b21-4f62-9f40-080644befc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:48.774047 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-7c70769f-2b21-4f62-9f40-080644befc0d None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:48.775333 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7c70769f-2b21-4f62-9f40-080644befc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:48.870276 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 51/99] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 00:50:49.170028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0435299-aa16-484f-a3d3-586f63b447e4 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:49.170406 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0435299-aa16-484f-a3d3-586f63b447e4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:49.170601 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0435299-aa16-484f-a3d3-586f63b447e4 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:49.172119 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 49/100] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:50:49.191890 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f553e78-838a-4f6b-9107-5373c659d38d None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:49.192246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f553e78-838a-4f6b-9107-5373c659d38d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:49.192529 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f553e78-838a-4f6b-9107-5373c659d38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:49.214270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb2f3c-55a5-453f-a4c4-cbcca052a539 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:49.214558 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb2f3c-55a5-453f-a4c4-cbcca052a539 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:49.214845 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb2f3c-55a5-453f-a4c4-cbcca052a539 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:49.216238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 50/101] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 00:50:49.218663 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-5f553e78-838a-4f6b-9107-5373c659d38d None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:49.219886 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5f553e78-838a-4f6b-9107-5373c659d38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:49.222069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caec276-2ae0-42c0-a197-f4ac7c521668 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:49.222352 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caec276-2ae0-42c0-a197-f4ac7c521668 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:49.222627 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caec276-2ae0-42c0-a197-f4ac7c521668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:49.255202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-2caec276-2ae0-42c0-a197-f4ac7c521668 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:49.256323 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2caec276-2ae0-42c0-a197-f4ac7c521668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:49.285111 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:49.367783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 52/102] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:50:49.368655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f553e78-838a-4f6b-9107-5373c659d38d None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:49.377301 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 51/103] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 00:50:49.503667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f553e78-838a-4f6b-9107-5373c659d38d None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:49.539194 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984969a-d598-4169-9d6d-5fa7c907a6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:49.539750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984969a-d598-4169-9d6d-5fa7c907a6cd None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:49.540033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984969a-d598-4169-9d6d-5fa7c907a6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:49.540305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984969a-d598-4169-9d6d-5fa7c907a6cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:49.550860 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984969a-d598-4169-9d6d-5fa7c907a6cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:50:49.555834 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-2984969a-d598-4169-9d6d-5fa7c907a6cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:50:49.555834 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:50:49.555834 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:50:49.555834 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:50:49.555834 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:50:49.555834 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:50:49.555834 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:50:49.555834 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:50:49.555834 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:50:49.555834 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:50:49.555834 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:50:49.555834 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:50:49.555834 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:50:49.555834 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:50:49.555834 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:50:49.555834 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:50:49.556675 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:50:49.556675 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:50:49.556675 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:50:49.556675 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:50:49.556675 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:50:49.556675 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:50:49.556675 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:50:49.556675 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:50:49.556675 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:50:49.556675 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:50:49.556675 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:50:49.556675 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:50:49.556675 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:50:49.556675 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:50:49.556675 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:50:49.556675 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:50:49.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:50:49.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:50:49.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:50:49.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:50:49.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:50:49.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:50:49.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:50:49.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:50:49.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:50:49.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:50:49.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:50:49.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:50:49.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 53/104] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:50:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:50:49.562827 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caec276-2ae0-42c0-a197-f4ac7c521668 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:49.654496 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:49.698972 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caec276-2ae0-42c0-a197-f4ac7c521668 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:49.732501 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984969a-d598-4169-9d6d-5fa7c907a6cd None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:49.751151 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628c726-2498-4bb2-a25c-b9825473aa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:49.751776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628c726-2498-4bb2-a25c-b9825473aa9a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:49.752051 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628c726-2498-4bb2-a25c-b9825473aa9a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:49.752322 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628c726-2498-4bb2-a25c-b9825473aa9a None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:49.752992 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628c726-2498-4bb2-a25c-b9825473aa9a None admin] RBAC: Adding query filter params (name=member) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:50:49.753291 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628c726-2498-4bb2-a25c-b9825473aa9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:49.754764 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628c726-2498-4bb2-a25c-b9825473aa9a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:49.778343 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 52/105] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 14 00:50:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:49.784367 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628c726-2498-4bb2-a25c-b9825473aa9a None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:49.787499 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:49.932951 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984969a-d598-4169-9d6d-5fa7c907a6cd None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:49.951917 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628c726-2498-4bb2-a25c-b9825473aa9a None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:49.988587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:50.001574 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a894f1-d67d-409c-a1e6-5f6e285fde54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:50.002229 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a894f1-d67d-409c-a1e6-5f6e285fde54 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:50.002505 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a894f1-d67d-409c-a1e6-5f6e285fde54 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:50.002772 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a894f1-d67d-409c-a1e6-5f6e285fde54 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:50.008661 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e8dea-7aa7-4fc7-ab8f-9110b337a112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:50.012136 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e8dea-7aa7-4fc7-ab8f-9110b337a112 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:50.012386 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e8dea-7aa7-4fc7-ab8f-9110b337a112 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:50.012661 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e8dea-7aa7-4fc7-ab8f-9110b337a112 None admin] PATH_INFO: `/v3/users/4fde697280c34660bcd0b9ec24ba1a9a` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:50.014127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e8dea-7aa7-4fc7-ab8f-9110b337a112 None admin] RBAC: Authorizing `identity:get_user(user_id=4fde697280c34660bcd0b9ec24ba1a9a)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:50.016207 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e8dea-7aa7-4fc7-ab8f-9110b337a112 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:50.020496 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 53/106] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:50:49 2022] GET /identity/v3/users/4fde697280c34660bcd0b9ec24ba1a9a => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:50.023199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e8dea-7aa7-4fc7-ab8f-9110b337a112 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:50.024362 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a894f1-d67d-409c-a1e6-5f6e285fde54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:50:50.029436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-11a894f1-d67d-409c-a1e6-5f6e285fde54 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 00:50:50.029436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:50:50.029436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:50:50.029436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:50:50.029436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:50:50.029436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:50:50.029436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:50:50.029436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:50:50.029436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:50:50.029436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:50:50.029436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:50:50.029436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:50:50.029436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:50:50.029436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:50:50.029436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:50:50.029436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:50:50.030303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:50:50.030303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:50:50.030303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:50:50.030303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:50:50.030303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:50:50.030303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:50:50.030303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:50:50.030303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:50:50.030303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:50:50.030303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:50:50.030303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:50:50.030303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:50:50.030303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:50:50.030303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:50:50.030303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:50:50.030303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:50:50.031437 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:50:50.031437 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:50:50.031437 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:50:50.031437 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:50:50.031437 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:50:50.031437 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:50:50.031437 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:50:50.031437 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:50:50.031437 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:50:50.031437 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:50:50.031437 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 00:50:50.031437 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:50:50.031437 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 54/107] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:50:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:50:50.031437 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a894f1-d67d-409c-a1e6-5f6e285fde54 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:50.202270 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:50.217913 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e8dea-7aa7-4fc7-ab8f-9110b337a112 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:50.224375 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a894f1-d67d-409c-a1e6-5f6e285fde54 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:50.255283 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f281fa-64a8-421b-8e99-20e5ae8fd06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:50.255917 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f281fa-64a8-421b-8e99-20e5ae8fd06d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:50.256357 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f281fa-64a8-421b-8e99-20e5ae8fd06d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:50.256696 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f281fa-64a8-421b-8e99-20e5ae8fd06d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:50.258492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f281fa-64a8-421b-8e99-20e5ae8fd06d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:50.259924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f281fa-64a8-421b-8e99-20e5ae8fd06d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:50.261603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7f8b8-5baa-4c5f-9271-c7d3ea0d7278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:50.261717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 54/108] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:50:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:50.262264 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7f8b8-5baa-4c5f-9271-c7d3ea0d7278 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:50.262548 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7f8b8-5baa-4c5f-9271-c7d3ea0d7278 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:50.262640 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f281fa-64a8-421b-8e99-20e5ae8fd06d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:50.262876 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7f8b8-5baa-4c5f-9271-c7d3ea0d7278 None admin] PATH_INFO: `/v3/projects/6b02aee449a54bf3bb79025645d7f35e` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:50.263997 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7f8b8-5baa-4c5f-9271-c7d3ea0d7278 None admin] RBAC: Authorizing `identity:get_project(project_id=6b02aee449a54bf3bb79025645d7f35e)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:50.265435 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7f8b8-5baa-4c5f-9271-c7d3ea0d7278 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:50.272484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 55/109] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:50:50 2022] GET /identity/v3/projects/6b02aee449a54bf3bb79025645d7f35e => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:50.272484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2339bc-edee-4bc8-a6be-0ac287b42032 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:50.272484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2339bc-edee-4bc8-a6be-0ac287b42032 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:50.272484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2339bc-edee-4bc8-a6be-0ac287b42032 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:50.272484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 56/110] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:50:50.272484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0bf91-f20c-4df8-be4e-38f67bf2aceb None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:50.272918 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0bf91-f20c-4df8-be4e-38f67bf2aceb None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:50.272918 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0bf91-f20c-4df8-be4e-38f67bf2aceb None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:50.274935 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 57/111] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:50:50.276516 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0bf91-f20c-4df8-be4e-38f67bf2aceb None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:50.328104 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:50.374369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f281fa-64a8-421b-8e99-20e5ae8fd06d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:50.387444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0bf91-f20c-4df8-be4e-38f67bf2aceb None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:50.411361 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e7dc5-ff0a-435d-b40d-b77f39d75e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:50.411961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e7dc5-ff0a-435d-b40d-b77f39d75e6a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:50.412260 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e7dc5-ff0a-435d-b40d-b77f39d75e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:50.412509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e7dc5-ff0a-435d-b40d-b77f39d75e6a None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:50.413187 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e7dc5-ff0a-435d-b40d-b77f39d75e6a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:50:50.413716 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e7dc5-ff0a-435d-b40d-b77f39d75e6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:50.415818 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e7dc5-ff0a-435d-b40d-b77f39d75e6a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:50.422349 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f1e32-f78e-4003-8bc5-cb00008fad92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:50.423011 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f1e32-f78e-4003-8bc5-cb00008fad92 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:50.423292 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f1e32-f78e-4003-8bc5-cb00008fad92 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:50.423566 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f1e32-f78e-4003-8bc5-cb00008fad92 None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:50.424219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f1e32-f78e-4003-8bc5-cb00008fad92 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:50.424751 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 55/112] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 14 00:50:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:50.425603 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e7dc5-ff0a-435d-b40d-b77f39d75e6a None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:50.427436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f1e32-f78e-4003-8bc5-cb00008fad92 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:50.450635 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:50.459420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 58/113] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Sep 14 00:50:50 2022] POST /identity/v3/projects => generated 302 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:50:50.460512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7873cf-abf1-4ecd-9583-a2f591a4f118 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:50.460863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7873cf-abf1-4ecd-9583-a2f591a4f118 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:50.461203 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7873cf-abf1-4ecd-9583-a2f591a4f118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:50.485108 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-fa7873cf-abf1-4ecd-9583-a2f591a4f118 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:50.487578 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fa7873cf-abf1-4ecd-9583-a2f591a4f118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:50.575441 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e7dc5-ff0a-435d-b40d-b77f39d75e6a None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:50.584609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 59/114] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:50:50.585777 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e2f7b-daf1-4cda-bd73-a6ccfd94725b None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:50.586190 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e2f7b-daf1-4cda-bd73-a6ccfd94725b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:50.586545 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e2f7b-daf1-4cda-bd73-a6ccfd94725b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:50.605589 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-5b9e2f7b-daf1-4cda-bd73-a6ccfd94725b None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:50.606875 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5b9e2f7b-daf1-4cda-bd73-a6ccfd94725b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:50.607778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:50.641937 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33aece3-2aec-423f-b374-f30af34a7efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:50.642910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33aece3-2aec-423f-b374-f30af34a7efb None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:50.643193 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33aece3-2aec-423f-b374-f30af34a7efb None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:50.643467 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33aece3-2aec-423f-b374-f30af34a7efb None admin] PATH_INFO: `/v3/projects/6b02aee449a54bf3bb79025645d7f35e/users/4fde697280c34660bcd0b9ec24ba1a9a/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:50.647121 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33aece3-2aec-423f-b374-f30af34a7efb None admin] RBAC: Authorizing `identity:create_grant(project_id=6b02aee449a54bf3bb79025645d7f35e, user_id=4fde697280c34660bcd0b9ec24ba1a9a, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:50.650486 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33aece3-2aec-423f-b374-f30af34a7efb None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:50.666889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 56/115] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 14 00:50:50 2022] PUT /identity/v3/projects/6b02aee449a54bf3bb79025645d7f35e/users/4fde697280c34660bcd0b9ec24ba1a9a/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 00:50:50.667959 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33aece3-2aec-423f-b374-f30af34a7efb None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:50.711706 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 60/116] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:50:50.713299 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725f6a4-42a6-4917-a0a5-afd20e8b1dad None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:50.713581 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725f6a4-42a6-4917-a0a5-afd20e8b1dad None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:50.713881 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725f6a4-42a6-4917-a0a5-afd20e8b1dad None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:50.715119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 61/117] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:50:50.720698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d408d5-e007-47ef-8e84-d0ffbcda60cb None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:50.720989 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d408d5-e007-47ef-8e84-d0ffbcda60cb None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:50.721263 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d408d5-e007-47ef-8e84-d0ffbcda60cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:50.750343 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-49d408d5-e007-47ef-8e84-d0ffbcda60cb None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:50.752335 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-49d408d5-e007-47ef-8e84-d0ffbcda60cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:50.809247 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33aece3-2aec-423f-b374-f30af34a7efb None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:50.841930 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:50.870930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb89c41-cd94-4ff6-93f0-ab09d5644357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:50.871976 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb89c41-cd94-4ff6-93f0-ab09d5644357 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:50.873673 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb89c41-cd94-4ff6-93f0-ab09d5644357 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:50.874465 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb89c41-cd94-4ff6-93f0-ab09d5644357 None admin] PATH_INFO: `/v3/users/4ef75334f9f24d41a8ef3aa382bc7394` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:50.877115 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 62/118] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:50:50.883201 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d408d5-e007-47ef-8e84-d0ffbcda60cb None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:50.896933 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb89c41-cd94-4ff6-93f0-ab09d5644357 None admin] RBAC: Authorizing `identity:get_user(user_id=4ef75334f9f24d41a8ef3aa382bc7394)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:50.898465 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb89c41-cd94-4ff6-93f0-ab09d5644357 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:50.900645 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 57/119] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:50:50 2022] GET /identity/v3/users/4ef75334f9f24d41a8ef3aa382bc7394 => generated 289 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:50.910998 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb89c41-cd94-4ff6-93f0-ab09d5644357 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:50.995457 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:51.038855 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d408d5-e007-47ef-8e84-d0ffbcda60cb None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:51.101606 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb89c41-cd94-4ff6-93f0-ab09d5644357 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:51.105125 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a6c0d-e247-40a7-b142-de17f862eab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:51.105861 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a6c0d-e247-40a7-b142-de17f862eab9 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:51.106149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a6c0d-e247-40a7-b142-de17f862eab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:51.106421 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a6c0d-e247-40a7-b142-de17f862eab9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:51.129386 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a6c0d-e247-40a7-b142-de17f862eab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:50:51.134332 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-e10a6c0d-e247-40a7-b142-de17f862eab9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:50:51.134332 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:50:51.134332 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:50:51.134332 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:50:51.134332 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:50:51.134332 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:50:51.134332 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:50:51.134332 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:50:51.134332 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:50:51.134332 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:50:51.134332 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:50:51.134332 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:50:51.134332 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:50:51.134332 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:50:51.134332 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:50:51.134332 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:50:51.135162 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:50:51.135162 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:50:51.135162 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:50:51.135162 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:50:51.135162 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:50:51.135162 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:50:51.135162 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:50:51.135162 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:50:51.135162 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:50:51.135162 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:50:51.135162 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:50:51.135162 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:50:51.135162 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:50:51.135162 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:50:51.135162 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:50:51.135162 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:50:51.135914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:50:51.135914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:50:51.135914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:50:51.135914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:50:51.135914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:50:51.135914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:50:51.135914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:50:51.135914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:50:51.135914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:50:51.135914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:50:51.135914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:50:51.135914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:50:51.137255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 63/120] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:50:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:50:51.139414 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a6c0d-e247-40a7-b142-de17f862eab9 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:51.182351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b73344-cf4d-42b1-b099-bb94622fafd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:51.182981 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b73344-cf4d-42b1-b099-bb94622fafd5 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:51.183265 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b73344-cf4d-42b1-b099-bb94622fafd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:51.183538 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b73344-cf4d-42b1-b099-bb94622fafd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:51.275014 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:51.306403 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b73344-cf4d-42b1-b099-bb94622fafd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:51.307967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b73344-cf4d-42b1-b099-bb94622fafd5 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:51.383636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:51.387572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a6c0d-e247-40a7-b142-de17f862eab9 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:51.440338 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73d70b-61b7-4885-8d2a-7fd50ee04c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:51.440979 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73d70b-61b7-4885-8d2a-7fd50ee04c80 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:51.441259 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73d70b-61b7-4885-8d2a-7fd50ee04c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:51.441522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73d70b-61b7-4885-8d2a-7fd50ee04c80 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:51.457836 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73d70b-61b7-4885-8d2a-7fd50ee04c80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:50:51.463149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-be73d70b-61b7-4885-8d2a-7fd50ee04c80 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 00:50:51.463149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:50:51.463149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:50:51.463149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:50:51.463149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:50:51.463149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:50:51.463149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:50:51.463149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:50:51.463149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:50:51.463149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:50:51.463149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:50:51.463149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:50:51.463149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:50:51.463149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:50:51.463149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:50:51.463149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:50:51.463998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:50:51.463998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:50:51.463998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:50:51.463998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:50:51.463998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:50:51.463998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:50:51.463998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:50:51.463998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:50:51.463998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:50:51.463998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:50:51.463998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:50:51.463998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:50:51.463998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:50:51.463998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:50:51.463998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:50:51.463998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:50:51.465140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:50:51.465140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:50:51.465140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:50:51.465140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:50:51.465140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:50:51.465140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:50:51.465140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:50:51.465140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:50:51.465140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:50:51.465140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:50:51.465140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 00:50:51.465140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:50:51.465140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 64/121] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 14 00:50:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:50:51.465140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73d70b-61b7-4885-8d2a-7fd50ee04c80 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:51.488040 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 58/122] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:50:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:50:51.489953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b73344-cf4d-42b1-b099-bb94622fafd5 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:51.668928 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73d70b-61b7-4885-8d2a-7fd50ee04c80 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:51.675253 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b73344-cf4d-42b1-b099-bb94622fafd5 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:51.680194 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:51.731812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311a884-a648-4463-9299-3321e706b02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:51.732431 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311a884-a648-4463-9299-3321e706b02b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:51.732712 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311a884-a648-4463-9299-3321e706b02b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:51.732982 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311a884-a648-4463-9299-3321e706b02b None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:51.733650 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311a884-a648-4463-9299-3321e706b02b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:50:51.733980 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311a884-a648-4463-9299-3321e706b02b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:51.735444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311a884-a648-4463-9299-3321e706b02b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:51.745733 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 65/123] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:50:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:51.747255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311a884-a648-4463-9299-3321e706b02b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:51.757266 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b9005-94d2-4b6b-ad6e-2930c5708ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:51.757962 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b9005-94d2-4b6b-ad6e-2930c5708ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:51.758248 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b9005-94d2-4b6b-ad6e-2930c5708ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:51.758524 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b9005-94d2-4b6b-ad6e-2930c5708ed7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:51.770256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:51.773691 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b9005-94d2-4b6b-ad6e-2930c5708ed7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:50:51.780796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-ba9b9005-94d2-4b6b-ad6e-2930c5708ed7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:50:51.780796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:50:51.780796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:50:51.780796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:50:51.780796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:50:51.780796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:50:51.780796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:50:51.780796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:50:51.780796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:50:51.780796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:50:51.780796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:50:51.780796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:50:51.780796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:50:51.780796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:50:51.780796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:50:51.780796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:50:51.781883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:50:51.781883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:50:51.781883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:50:51.781883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:50:51.781883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:50:51.781883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:50:51.781883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:50:51.781883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:50:51.781883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:50:51.781883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:50:51.781883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:50:51.781883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:50:51.781883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:50:51.781883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:50:51.781883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:50:51.781883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:50:51.783210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:50:51.783210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:50:51.783210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:50:51.783210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:50:51.783210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:50:51.783210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:50:51.783210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:50:51.783210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:50:51.783210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:50:51.783210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:50:51.783210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:50:51.783210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:50:51.786789 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 59/124] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:50:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:50:51.789010 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b9005-94d2-4b6b-ad6e-2930c5708ed7 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:51.864785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311a884-a648-4463-9299-3321e706b02b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:51.904878 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17585e8-f92f-45b5-bd63-640b75d08e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:51.905650 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17585e8-f92f-45b5-bd63-640b75d08e9d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:51.906290 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17585e8-f92f-45b5-bd63-640b75d08e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:51.906642 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17585e8-f92f-45b5-bd63-640b75d08e9d None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:51.907918 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17585e8-f92f-45b5-bd63-640b75d08e9d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:50:51.908556 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17585e8-f92f-45b5-bd63-640b75d08e9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:51.910792 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17585e8-f92f-45b5-bd63-640b75d08e9d None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:51.918545 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b9005-94d2-4b6b-ad6e-2930c5708ed7 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:51.921345 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 66/125] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:50:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:51.922872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17585e8-f92f-45b5-bd63-640b75d08e9d None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:51.956670 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e408c-e57f-4862-a225-2062c99ccd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:51.957693 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e408c-e57f-4862-a225-2062c99ccd6f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:51.958299 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e408c-e57f-4862-a225-2062c99ccd6f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:51.958789 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e408c-e57f-4862-a225-2062c99ccd6f None admin] PATH_INFO: `/v3/projects/6b02aee449a54bf3bb79025645d7f35e` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:51.960123 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e408c-e57f-4862-a225-2062c99ccd6f None admin] RBAC: Authorizing `identity:get_project(project_id=6b02aee449a54bf3bb79025645d7f35e)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:51.961331 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:51.963031 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e408c-e57f-4862-a225-2062c99ccd6f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:51.964953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 60/126] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:50:51 2022] GET /identity/v3/projects/6b02aee449a54bf3bb79025645d7f35e => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:51.966111 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e408c-e57f-4862-a225-2062c99ccd6f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:52.052312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:52.059649 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17585e8-f92f-45b5-bd63-640b75d08e9d None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:52.089343 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e408c-e57f-4862-a225-2062c99ccd6f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:52.103902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1432c02-33c5-413f-b04f-909d6fcd8439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:52.104807 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1432c02-33c5-413f-b04f-909d6fcd8439 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:52.105086 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1432c02-33c5-413f-b04f-909d6fcd8439 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:52.105600 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1432c02-33c5-413f-b04f-909d6fcd8439 None admin] PATH_INFO: `/v3/users/07ccce5a2a4546febae17d32e636d9bf` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:52.107144 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1432c02-33c5-413f-b04f-909d6fcd8439 None admin] RBAC: Authorizing `identity:get_user(user_id=07ccce5a2a4546febae17d32e636d9bf)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:52.108604 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1432c02-33c5-413f-b04f-909d6fcd8439 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:52.116424 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 67/127] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:50:51 2022] GET /identity/v3/users/07ccce5a2a4546febae17d32e636d9bf => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:52.117751 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1432c02-33c5-413f-b04f-909d6fcd8439 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:52.128360 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a2484-843d-4d7a-9ea9-fa138c78f52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:52.128965 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a2484-843d-4d7a-9ea9-fa138c78f52c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:52.129242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a2484-843d-4d7a-9ea9-fa138c78f52c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:52.129568 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a2484-843d-4d7a-9ea9-fa138c78f52c None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:52.130285 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a2484-843d-4d7a-9ea9-fa138c78f52c None admin] RBAC: Adding query filter params (name=member) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:50:52.130631 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a2484-843d-4d7a-9ea9-fa138c78f52c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:52.131993 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a2484-843d-4d7a-9ea9-fa138c78f52c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:52.143396 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 61/128] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 14 00:50:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:52.143993 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a2484-843d-4d7a-9ea9-fa138c78f52c None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:52.248858 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:52.251699 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1432c02-33c5-413f-b04f-909d6fcd8439 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:52.252051 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a2484-843d-4d7a-9ea9-fa138c78f52c None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:52.284461 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:52.292488 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774918d-fd4d-4c35-9c94-37610f2159cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:52.293118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774918d-fd4d-4c35-9c94-37610f2159cb None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:52.293306 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497e428-fdc7-440e-8fe9-188ee28d5332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:52.293423 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774918d-fd4d-4c35-9c94-37610f2159cb None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:52.293656 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774918d-fd4d-4c35-9c94-37610f2159cb None admin] PATH_INFO: `/v3/users/4fde697280c34660bcd0b9ec24ba1a9a` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:52.294478 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497e428-fdc7-440e-8fe9-188ee28d5332 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:52.294827 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774918d-fd4d-4c35-9c94-37610f2159cb None admin] RBAC: Authorizing `identity:get_user(user_id=4fde697280c34660bcd0b9ec24ba1a9a)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:52.295118 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497e428-fdc7-440e-8fe9-188ee28d5332 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:52.295560 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497e428-fdc7-440e-8fe9-188ee28d5332 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:52.296293 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774918d-fd4d-4c35-9c94-37610f2159cb None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:52.296593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497e428-fdc7-440e-8fe9-188ee28d5332 None admin] RBAC: Adding query filter params (role.id=79f3e2103ea3417a946a9e54a4ae30f3, scope.project.id=6b02aee449a54bf3bb79025645d7f35e, user.id=4ef75334f9f24d41a8ef3aa382bc7394) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:50:52.297045 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497e428-fdc7-440e-8fe9-188ee28d5332 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:52.298429 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 68/129] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:50:52 2022] GET /identity/v3/users/4fde697280c34660bcd0b9ec24ba1a9a => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:52.299191 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774918d-fd4d-4c35-9c94-37610f2159cb None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:52.299575 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497e428-fdc7-440e-8fe9-188ee28d5332 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:52.306283 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 62/130] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:50:52 2022] GET /identity/v3/role_assignments?user.id=4ef75334f9f24d41a8ef3aa382bc7394&scope.project.id=6b02aee449a54bf3bb79025645d7f35e&role.id=79f3e2103ea3417a946a9e54a4ae30f3 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:52.307313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497e428-fdc7-440e-8fe9-188ee28d5332 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:52.512252 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774918d-fd4d-4c35-9c94-37610f2159cb None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:52.524645 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497e428-fdc7-440e-8fe9-188ee28d5332 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:52.559281 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543624e-2833-467e-a058-243ab71a1a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:52.559905 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543624e-2833-467e-a058-243ab71a1a88 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:52.560187 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543624e-2833-467e-a058-243ab71a1a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:52.560462 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543624e-2833-467e-a058-243ab71a1a88 None admin] PATH_INFO: `/v3/projects/6b02aee449a54bf3bb79025645d7f35e` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:52.561610 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543624e-2833-467e-a058-243ab71a1a88 None admin] RBAC: Authorizing `identity:get_project(project_id=6b02aee449a54bf3bb79025645d7f35e)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:52.563730 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543624e-2833-467e-a058-243ab71a1a88 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:52.565356 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 69/131] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:50:52 2022] GET /identity/v3/projects/6b02aee449a54bf3bb79025645d7f35e => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:52.566147 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543624e-2833-467e-a058-243ab71a1a88 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:52.569722 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c9152-21fa-4ff1-9954-b34266a3550f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:52.570582 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c9152-21fa-4ff1-9954-b34266a3550f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:52.571097 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c9152-21fa-4ff1-9954-b34266a3550f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:52.571567 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c9152-21fa-4ff1-9954-b34266a3550f None admin] PATH_INFO: `/v3/users/4fde697280c34660bcd0b9ec24ba1a9a` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:52.572930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c9152-21fa-4ff1-9954-b34266a3550f None admin] RBAC: Authorizing `identity:get_user(user_id=4fde697280c34660bcd0b9ec24ba1a9a)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:52.575969 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c9152-21fa-4ff1-9954-b34266a3550f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:52.577892 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 63/132] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:50:52 2022] GET /identity/v3/users/4fde697280c34660bcd0b9ec24ba1a9a => generated 275 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:52.578867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c9152-21fa-4ff1-9954-b34266a3550f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:52.636125 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:52.655620 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:52.704654 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c9152-21fa-4ff1-9954-b34266a3550f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:52.743551 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fc72f-3858-4c35-aaed-610594abf33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:52.744511 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fc72f-3858-4c35-aaed-610594abf33e None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:52.745001 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fc72f-3858-4c35-aaed-610594abf33e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:52.745451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fc72f-3858-4c35-aaed-610594abf33e None admin] PATH_INFO: `/v3/projects/6b02aee449a54bf3bb79025645d7f35e/users/07ccce5a2a4546febae17d32e636d9bf/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:52.747896 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fc72f-3858-4c35-aaed-610594abf33e None admin] RBAC: Authorizing `identity:create_grant(project_id=6b02aee449a54bf3bb79025645d7f35e, user_id=07ccce5a2a4546febae17d32e636d9bf, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:52.749758 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fc72f-3858-4c35-aaed-610594abf33e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:52.764993 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 64/133] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 14 00:50:52 2022] PUT /identity/v3/projects/6b02aee449a54bf3bb79025645d7f35e/users/07ccce5a2a4546febae17d32e636d9bf/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 00:50:52.766203 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fc72f-3858-4c35-aaed-610594abf33e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:52.778236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543624e-2833-467e-a058-243ab71a1a88 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:52.861694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba04b6-e9ae-49fb-9123-8ad34c298235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:52.862369 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba04b6-e9ae-49fb-9123-8ad34c298235 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:52.862650 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba04b6-e9ae-49fb-9123-8ad34c298235 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:52.862921 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba04b6-e9ae-49fb-9123-8ad34c298235 None admin] PATH_INFO: `/v3/projects/6b02aee449a54bf3bb79025645d7f35e` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:52.865719 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba04b6-e9ae-49fb-9123-8ad34c298235 None admin] RBAC: Authorizing `identity:get_project(project_id=6b02aee449a54bf3bb79025645d7f35e)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:52.867201 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba04b6-e9ae-49fb-9123-8ad34c298235 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:52.868843 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 70/134] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:50:52 2022] GET /identity/v3/projects/6b02aee449a54bf3bb79025645d7f35e => generated 298 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:52.878871 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba04b6-e9ae-49fb-9123-8ad34c298235 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:52.898400 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fc72f-3858-4c35-aaed-610594abf33e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:52.925830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:52.944806 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e8fc0-f526-48d4-b95a-2862b13006d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:52.946499 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e8fc0-f526-48d4-b95a-2862b13006d8 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:52.947006 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e8fc0-f526-48d4-b95a-2862b13006d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:52.947490 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e8fc0-f526-48d4-b95a-2862b13006d8 None admin] PATH_INFO: `/v3/projects/980fa17c43e9422b92284f2941735783` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:52.949034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e8fc0-f526-48d4-b95a-2862b13006d8 None admin] RBAC: Authorizing `identity:get_project(project_id=980fa17c43e9422b92284f2941735783)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:52.950828 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e8fc0-f526-48d4-b95a-2862b13006d8 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:52.952839 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 65/135] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:50:52 2022] GET /identity/v3/projects/980fa17c43e9422b92284f2941735783 => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:52.959255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e8fc0-f526-48d4-b95a-2862b13006d8 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:53.066348 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba04b6-e9ae-49fb-9123-8ad34c298235 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:53.070860 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:53.140078 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e9129-7c41-44ce-a7e2-9c1e2fec42fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:53.140756 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e9129-7c41-44ce-a7e2-9c1e2fec42fb None admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:53.141037 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e9129-7c41-44ce-a7e2-9c1e2fec42fb None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:53.141354 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e9129-7c41-44ce-a7e2-9c1e2fec42fb None admin] PATH_INFO: `/v3/projects/6b02aee449a54bf3bb79025645d7f35e/users/4fde697280c34660bcd0b9ec24ba1a9a/roles/8373a23ee4ff4c7d94e82480d85b586b` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:53.144909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e9129-7c41-44ce-a7e2-9c1e2fec42fb None admin] RBAC: Authorizing `identity:create_grant(project_id=6b02aee449a54bf3bb79025645d7f35e, user_id=4fde697280c34660bcd0b9ec24ba1a9a, role_id=8373a23ee4ff4c7d94e82480d85b586b)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:53.146396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e9129-7c41-44ce-a7e2-9c1e2fec42fb None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:53.163382 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e8fc0-f526-48d4-b95a-2862b13006d8 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:53.174326 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 71/136] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 14 00:50:52 2022] PUT /identity/v3/projects/6b02aee449a54bf3bb79025645d7f35e/users/4fde697280c34660bcd0b9ec24ba1a9a/roles/8373a23ee4ff4c7d94e82480d85b586b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 00:50:53.211985 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db69856-bd6e-4e91-a8ee-b6db156fcde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:53.212677 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db69856-bd6e-4e91-a8ee-b6db156fcde6 None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:53.212961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db69856-bd6e-4e91-a8ee-b6db156fcde6 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:53.213242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db69856-bd6e-4e91-a8ee-b6db156fcde6 None admin] PATH_INFO: `/v3/projects/980fa17c43e9422b92284f2941735783/users/4fde697280c34660bcd0b9ec24ba1a9a/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:53.215373 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db69856-bd6e-4e91-a8ee-b6db156fcde6 None admin] RBAC: Authorizing `identity:create_grant(project_id=980fa17c43e9422b92284f2941735783, user_id=4fde697280c34660bcd0b9ec24ba1a9a, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:53.216958 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db69856-bd6e-4e91-a8ee-b6db156fcde6 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:53.232958 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 66/137] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 14 00:50:52 2022] PUT /identity/v3/projects/980fa17c43e9422b92284f2941735783/users/4fde697280c34660bcd0b9ec24ba1a9a/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 00:50:53.305267 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1f70f-f1e8-4e46-8cb8-e8a99bce8ec6 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:53.305573 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1f70f-f1e8-4e46-8cb8-e8a99bce8ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:53.305854 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1f70f-f1e8-4e46-8cb8-e8a99bce8ec6 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:53.307426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 72/138] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:50:53.313458 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5186f27-6159-4e8e-a5fa-85e8aa959816 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:53.313937 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459a1be-596f-4cf2-9993-d4b4fcb36cb5 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:53.314226 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459a1be-596f-4cf2-9993-d4b4fcb36cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:53.314504 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459a1be-596f-4cf2-9993-d4b4fcb36cb5 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:53.314729 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5186f27-6159-4e8e-a5fa-85e8aa959816 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:53.315187 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5186f27-6159-4e8e-a5fa-85e8aa959816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:53.315856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 73/139] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 00:50:53.321678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdecf0-f3dc-4136-b9c7-bfd4d4f003bc None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:53.321961 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdecf0-f3dc-4136-b9c7-bfd4d4f003bc None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:53.322251 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdecf0-f3dc-4136-b9c7-bfd4d4f003bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:53.351095 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-c5186f27-6159-4e8e-a5fa-85e8aa959816 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:53.353517 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c5186f27-6159-4e8e-a5fa-85e8aa959816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:53.354871 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-e6cdecf0-f3dc-4136-b9c7-bfd4d4f003bc None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:53.356313 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e6cdecf0-f3dc-4136-b9c7-bfd4d4f003bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:53.453238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:53.487825 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 67/140] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 00:50:53.495262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 74/141] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 00:50:53.868984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5186f27-6159-4e8e-a5fa-85e8aa959816 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:53.964529 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdecf0-f3dc-4136-b9c7-bfd4d4f003bc None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:53.979571 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5186f27-6159-4e8e-a5fa-85e8aa959816 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:54.031856 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027dc973-e1b2-4453-a035-0b7c157cfdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:54.032544 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dc973-e1b2-4453-a035-0b7c157cfdbf None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:54.032828 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dc973-e1b2-4453-a035-0b7c157cfdbf None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:54.033107 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dc973-e1b2-4453-a035-0b7c157cfdbf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:54.034260 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027dc973-e1b2-4453-a035-0b7c157cfdbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:54.035710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027dc973-e1b2-4453-a035-0b7c157cfdbf None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:54.037464 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 68/142] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:50:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:54.042658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027dc973-e1b2-4453-a035-0b7c157cfdbf None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:54.133185 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:54.159818 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:54.176092 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdecf0-f3dc-4136-b9c7-bfd4d4f003bc None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:54.211859 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027dc973-e1b2-4453-a035-0b7c157cfdbf None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:54.250349 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fd093-35b7-42c9-902c-9a0f156636a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:54.251457 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fd093-35b7-42c9-902c-9a0f156636a0 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:54.251963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fd093-35b7-42c9-902c-9a0f156636a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:54.252520 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fd093-35b7-42c9-902c-9a0f156636a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:54.269046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1563a-7721-4493-8b19-0e3a43b9b792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:54.269671 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1563a-7721-4493-8b19-0e3a43b9b792 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:54.269988 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1563a-7721-4493-8b19-0e3a43b9b792 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:54.270268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1563a-7721-4493-8b19-0e3a43b9b792 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:54.270932 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1563a-7721-4493-8b19-0e3a43b9b792 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:54.272374 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1563a-7721-4493-8b19-0e3a43b9b792 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:54.274265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fd093-35b7-42c9-902c-9a0f156636a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:50:54.279764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-668fd093-35b7-42c9-902c-9a0f156636a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:50:54.279764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:50:54.279764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:50:54.279764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:50:54.279764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:50:54.279764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:50:54.279764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:50:54.279764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:50:54.279764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:50:54.279764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:50:54.279764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:50:54.279764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:50:54.279764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:50:54.279764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:50:54.279764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:50:54.279764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:50:54.280694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:50:54.280694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:50:54.280694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:50:54.280694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:50:54.280694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:50:54.280694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:50:54.280694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:50:54.280694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:50:54.280694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:50:54.280694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:50:54.280694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:50:54.280694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:50:54.280694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:50:54.280694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:50:54.280694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:50:54.280694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:50:54.281484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:50:54.281484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:50:54.281484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:50:54.281484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:50:54.281484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:50:54.281484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:50:54.281484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:50:54.281484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:50:54.281484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:50:54.281484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:50:54.281484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:50:54.281484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:50:54.284384 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 75/143] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:50:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:50:54.291630 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fd093-35b7-42c9-902c-9a0f156636a0 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:54.307827 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 69/144] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 14 00:50:54 2022] POST /identity/v3/users => generated 283 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 00:50:54.409943 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fd093-35b7-42c9-902c-9a0f156636a0 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:54.459222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a6d23-cc75-4ea7-8187-69b05687c82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:54.460207 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a6d23-cc75-4ea7-8187-69b05687c82e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:54.460677 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a6d23-cc75-4ea7-8187-69b05687c82e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:54.461146 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a6d23-cc75-4ea7-8187-69b05687c82e None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:54.462086 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a6d23-cc75-4ea7-8187-69b05687c82e None admin] RBAC: Adding query filter params (name=member) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:50:54.462617 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a6d23-cc75-4ea7-8187-69b05687c82e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:54.464242 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a6d23-cc75-4ea7-8187-69b05687c82e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:54.478528 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 76/145] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 14 00:50:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:54.484887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1563a-7721-4493-8b19-0e3a43b9b792 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:54.616256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1563a-7721-4493-8b19-0e3a43b9b792 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:54.623354 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:54.661073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc3f2f-32ab-4aac-97a9-14014e0e08dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:54.661645 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc3f2f-32ab-4aac-97a9-14014e0e08dc None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:54.661973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc3f2f-32ab-4aac-97a9-14014e0e08dc None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:54.662267 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc3f2f-32ab-4aac-97a9-14014e0e08dc None admin] PATH_INFO: `/v3/users/4fde697280c34660bcd0b9ec24ba1a9a` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:54.663398 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc3f2f-32ab-4aac-97a9-14014e0e08dc None admin] RBAC: Authorizing `identity:get_user(user_id=4fde697280c34660bcd0b9ec24ba1a9a)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:54.664858 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc3f2f-32ab-4aac-97a9-14014e0e08dc None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:54.666474 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 70/146] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:50:54 2022] GET /identity/v3/users/4fde697280c34660bcd0b9ec24ba1a9a => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:54.672379 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a6d23-cc75-4ea7-8187-69b05687c82e None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:54.701503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:54.806985 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a6d23-cc75-4ea7-8187-69b05687c82e None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:54.851572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965cfc5-b391-45c2-8670-51b7874d9cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:54.852552 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965cfc5-b391-45c2-8670-51b7874d9cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:54.853028 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965cfc5-b391-45c2-8670-51b7874d9cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:54.853495 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965cfc5-b391-45c2-8670-51b7874d9cb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:54.939366 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965cfc5-b391-45c2-8670-51b7874d9cb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:54.941190 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965cfc5-b391-45c2-8670-51b7874d9cb3 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:54.962075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:55.062814 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 77/147] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:50:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:50:55.068594 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc3f2f-32ab-4aac-97a9-14014e0e08dc None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:55.241849 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc3f2f-32ab-4aac-97a9-14014e0e08dc None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:55.289947 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0f774-b3f6-45ac-8177-e52944513890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:55.291080 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0f774-b3f6-45ac-8177-e52944513890 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:55.291590 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0f774-b3f6-45ac-8177-e52944513890 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:55.291904 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0f774-b3f6-45ac-8177-e52944513890 None admin] PATH_INFO: `/v3/projects/6b02aee449a54bf3bb79025645d7f35e` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:55.293444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0f774-b3f6-45ac-8177-e52944513890 None admin] RBAC: Authorizing `identity:get_project(project_id=6b02aee449a54bf3bb79025645d7f35e)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:55.296335 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0f774-b3f6-45ac-8177-e52944513890 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:55.300291 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 71/148] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:50:55 2022] GET /identity/v3/projects/6b02aee449a54bf3bb79025645d7f35e => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:55.307209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965cfc5-b391-45c2-8670-51b7874d9cb3 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:55.459859 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965cfc5-b391-45c2-8670-51b7874d9cb3 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:55.480307 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:55.484572 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b581503-a3a6-423e-b37c-571ae8ec0849 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:55.485462 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b581503-a3a6-423e-b37c-571ae8ec0849 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:55.486349 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b581503-a3a6-423e-b37c-571ae8ec0849 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:55.488642 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 72/149] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:50:55.494395 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015e04a-ec69-4d84-b47c-f0c1f73e3f85 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:55.495028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015e04a-ec69-4d84-b47c-f0c1f73e3f85 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:55.495523 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015e04a-ec69-4d84-b47c-f0c1f73e3f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:55.499702 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3438c-fd2d-434f-bc53-c614c377252d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:55.500486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3438c-fd2d-434f-bc53-c614c377252d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:55.501435 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3438c-fd2d-434f-bc53-c614c377252d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:55.501904 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3438c-fd2d-434f-bc53-c614c377252d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:55.502773 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc3438c-fd2d-434f-bc53-c614c377252d None admin] RBAC: Adding query filter params (role.id=ee3984f710984de6bf564de3bee00d33, scope.project.id=6b02aee449a54bf3bb79025645d7f35e, user.id=4fde697280c34660bcd0b9ec24ba1a9a) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:50:55.503226 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc3438c-fd2d-434f-bc53-c614c377252d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:55.504778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc3438c-fd2d-434f-bc53-c614c377252d None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:55.510954 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 78/150] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:50:55 2022] GET /identity/v3/role_assignments?user.id=4fde697280c34660bcd0b9ec24ba1a9a&scope.project.id=6b02aee449a54bf3bb79025645d7f35e&role.id=ee3984f710984de6bf564de3bee00d33 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:55.530247 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-a015e04a-ec69-4d84-b47c-f0c1f73e3f85 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:55.531697 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a015e04a-ec69-4d84-b47c-f0c1f73e3f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:55.588296 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:55.638303 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 73/151] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:50:55.988180 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3438c-fd2d-434f-bc53-c614c377252d None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:56.109820 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3438c-fd2d-434f-bc53-c614c377252d None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:56.150596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea8e12-3d7a-4377-8517-5e91a9025b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:56.151224 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea8e12-3d7a-4377-8517-5e91a9025b04 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:56.151497 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea8e12-3d7a-4377-8517-5e91a9025b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:56.151768 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea8e12-3d7a-4377-8517-5e91a9025b04 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:56.167191 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea8e12-3d7a-4377-8517-5e91a9025b04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:50:56.173256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-acea8e12-3d7a-4377-8517-5e91a9025b04 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 00:50:56.173256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:50:56.173256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:50:56.173256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:50:56.173256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:50:56.173256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:50:56.173256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:50:56.173256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:50:56.173256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:50:56.173256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:50:56.173256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:50:56.173256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:50:56.173256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:50:56.173256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:50:56.173256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:50:56.173256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:50:56.174206 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:50:56.174206 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:50:56.174206 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:50:56.174206 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:50:56.174206 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:50:56.174206 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:50:56.174206 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:50:56.174206 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:50:56.174206 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:50:56.174206 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:50:56.174206 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:50:56.174206 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:50:56.174206 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:50:56.174206 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:50:56.174206 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:50:56.174206 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:50:56.175351 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:50:56.175351 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:50:56.175351 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:50:56.175351 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:50:56.175351 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:50:56.175351 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:50:56.175351 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:50:56.175351 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:50:56.175351 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:50:56.175351 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:50:56.175351 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 00:50:56.175351 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:50:56.175351 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 79/152] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:50:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:50:56.180358 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015e04a-ec69-4d84-b47c-f0c1f73e3f85 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:56.319336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015e04a-ec69-4d84-b47c-f0c1f73e3f85 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:56.357543 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03780c-c8b3-4970-a689-cc903b8a8cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:56.358231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03780c-c8b3-4970-a689-cc903b8a8cda None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:56.358472 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03780c-c8b3-4970-a689-cc903b8a8cda None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:56.358745 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03780c-c8b3-4970-a689-cc903b8a8cda None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:56.359423 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03780c-c8b3-4970-a689-cc903b8a8cda None admin] RBAC: Adding query filter params (name=reader) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:50:56.359727 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03780c-c8b3-4970-a689-cc903b8a8cda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:56.361192 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03780c-c8b3-4970-a689-cc903b8a8cda None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:56.373197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 74/153] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 14 00:50:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:56.379452 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea8e12-3d7a-4377-8517-5e91a9025b04 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:56.441694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:56.514039 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea8e12-3d7a-4377-8517-5e91a9025b04 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:56.558581 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb9ea2-94d0-44db-aebe-9ec6bced878f None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:56.559059 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb9ea2-94d0-44db-aebe-9ec6bced878f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:56.559344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb9ea2-94d0-44db-aebe-9ec6bced878f None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:56.560110 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbbdff-be76-46a6-bc95-3c785da1015f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:56.560744 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbbdff-be76-46a6-bc95-3c785da1015f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:56.560959 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 75/154] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 00:50:56.561249 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbbdff-be76-46a6-bc95-3c785da1015f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:56.561517 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbbdff-be76-46a6-bc95-3c785da1015f None admin] PATH_INFO: `/v3/users/4ef75334f9f24d41a8ef3aa382bc7394` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:56.565831 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbbdff-be76-46a6-bc95-3c785da1015f None admin] RBAC: Authorizing `identity:get_user(user_id=4ef75334f9f24d41a8ef3aa382bc7394)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:56.567303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbbdff-be76-46a6-bc95-3c785da1015f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:56.568892 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 80/155] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:50:56 2022] GET /identity/v3/users/4ef75334f9f24d41a8ef3aa382bc7394 => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:56.571397 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0e0b1-3ec9-406c-9a20-e3b1c1b27c1e None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:56.571621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0e0b1-3ec9-406c-9a20-e3b1c1b27c1e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:56.571892 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0e0b1-3ec9-406c-9a20-e3b1c1b27c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:56.574357 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbbdff-be76-46a6-bc95-3c785da1015f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:56.603033 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e7c0e0b1-3ec9-406c-9a20-e3b1c1b27c1e None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:56.604241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e7c0e0b1-3ec9-406c-9a20-e3b1c1b27c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:56.658679 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:56.726964 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 76/156] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:50:56.751367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbbdff-be76-46a6-bc95-3c785da1015f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:56.768495 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:56.815081 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ae980-7754-447d-83ea-5de38a1d0fad None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:56.815403 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ae980-7754-447d-83ea-5de38a1d0fad None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:56.815635 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ae980-7754-447d-83ea-5de38a1d0fad None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:56.817430 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 77/157] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:50:56.818341 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7787de-5a71-4a9e-84a8-338a82bb64f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:56.819352 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7787de-5a71-4a9e-84a8-338a82bb64f3 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:56.819840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7787de-5a71-4a9e-84a8-338a82bb64f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:56.820394 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7787de-5a71-4a9e-84a8-338a82bb64f3 None admin] PATH_INFO: `/v3/projects/6b02aee449a54bf3bb79025645d7f35e` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:56.823106 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7787de-5a71-4a9e-84a8-338a82bb64f3 None admin] RBAC: Authorizing `identity:get_project(project_id=6b02aee449a54bf3bb79025645d7f35e)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:56.824043 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43a6d3-16c6-407c-a1a8-a1d3371954bb None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:56.824329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43a6d3-16c6-407c-a1a8-a1d3371954bb None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:56.824600 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43a6d3-16c6-407c-a1a8-a1d3371954bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:56.825447 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7787de-5a71-4a9e-84a8-338a82bb64f3 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:56.828366 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 81/158] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:50:56 2022] GET /identity/v3/projects/6b02aee449a54bf3bb79025645d7f35e => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:50:56.834149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7787de-5a71-4a9e-84a8-338a82bb64f3 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:56.857090 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-5f43a6d3-16c6-407c-a1a8-a1d3371954bb None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:56.858355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5f43a6d3-16c6-407c-a1a8-a1d3371954bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:56.940713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 78/159] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:50:57.038909 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef30569-75a4-42f8-86f5-ec97ce2a0fd0 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:57.039397 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef30569-75a4-42f8-86f5-ec97ce2a0fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:57.039771 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef30569-75a4-42f8-86f5-ec97ce2a0fd0 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:57.041606 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 79/160] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:50:57.045678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7787de-5a71-4a9e-84a8-338a82bb64f3 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:57.064708 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce334ee-1480-4e9e-a621-18a12fb7d4f0 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:57.065121 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce334ee-1480-4e9e-a621-18a12fb7d4f0 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:57.065494 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce334ee-1480-4e9e-a621-18a12fb7d4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:57.095135 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-9ce334ee-1480-4e9e-a621-18a12fb7d4f0 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:57.096382 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-9ce334ee-1480-4e9e-a621-18a12fb7d4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:57.107069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959dfce2-81f9-478b-8e7e-76731612ef03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:57.107739 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959dfce2-81f9-478b-8e7e-76731612ef03 None admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:57.108016 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959dfce2-81f9-478b-8e7e-76731612ef03 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:57.108285 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959dfce2-81f9-478b-8e7e-76731612ef03 None admin] PATH_INFO: `/v3/projects/6b02aee449a54bf3bb79025645d7f35e/users/4ef75334f9f24d41a8ef3aa382bc7394/roles/79f3e2103ea3417a946a9e54a4ae30f3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:57.118636 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959dfce2-81f9-478b-8e7e-76731612ef03 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b02aee449a54bf3bb79025645d7f35e, user_id=4ef75334f9f24d41a8ef3aa382bc7394, role_id=79f3e2103ea3417a946a9e54a4ae30f3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:57.120091 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959dfce2-81f9-478b-8e7e-76731612ef03 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:57.153935 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 82/161] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 14 00:50:56 2022] PUT /identity/v3/projects/6b02aee449a54bf3bb79025645d7f35e/users/4ef75334f9f24d41a8ef3aa382bc7394/roles/79f3e2103ea3417a946a9e54a4ae30f3 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 00:50:57.227196 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 80/162] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:50:57.252886 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959dfce2-81f9-478b-8e7e-76731612ef03 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:57.291288 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce334ee-1480-4e9e-a621-18a12fb7d4f0 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:57.311204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:57.356171 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:57.428396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959dfce2-81f9-478b-8e7e-76731612ef03 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:57.502528 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86012682-2d15-4d13-99ac-bb4983574283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:57.503184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86012682-2d15-4d13-99ac-bb4983574283 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:57.503464 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86012682-2d15-4d13-99ac-bb4983574283 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:57.503733 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86012682-2d15-4d13-99ac-bb4983574283 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:57.523963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86012682-2d15-4d13-99ac-bb4983574283 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:50:57.529602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-86012682-2d15-4d13-99ac-bb4983574283 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 00:50:57.529602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:50:57.529602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:50:57.529602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:50:57.529602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:50:57.529602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:50:57.529602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:50:57.529602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:50:57.529602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:50:57.529602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:50:57.529602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:50:57.529602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:50:57.529602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:50:57.529602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:50:57.529602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:50:57.529602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:50:57.530529 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:50:57.530529 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:50:57.530529 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:50:57.530529 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:50:57.530529 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:50:57.530529 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:50:57.530529 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:50:57.530529 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:50:57.530529 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:50:57.530529 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:50:57.530529 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:50:57.530529 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:50:57.530529 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:50:57.530529 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:50:57.530529 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:50:57.530529 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:50:57.531288 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:50:57.531288 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:50:57.531288 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:50:57.531288 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:50:57.531288 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:50:57.531288 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:50:57.531288 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:50:57.531288 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:50:57.531288 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:50:57.531288 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:50:57.531288 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 00:50:57.531288 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:50:57.535140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 83/163] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 14 00:50:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:50:57.540437 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86012682-2d15-4d13-99ac-bb4983574283 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:57.556846 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce334ee-1480-4e9e-a621-18a12fb7d4f0 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:57.642594 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748a02f-6acb-4830-8d87-438ff7838385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:57.643579 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748a02f-6acb-4830-8d87-438ff7838385 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:57.644080 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748a02f-6acb-4830-8d87-438ff7838385 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:57.644557 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748a02f-6acb-4830-8d87-438ff7838385 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:57.675019 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748a02f-6acb-4830-8d87-438ff7838385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:50:57.686289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-4748a02f-6acb-4830-8d87-438ff7838385 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:50:57.686289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:50:57.686289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:50:57.686289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:50:57.686289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:50:57.686289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:50:57.686289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:50:57.686289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:50:57.686289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:50:57.686289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:50:57.686289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:50:57.686289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:50:57.686289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:50:57.686289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:50:57.686289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:50:57.686289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:50:57.687238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:50:57.687238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:50:57.687238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:50:57.687238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:50:57.687238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:50:57.687238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:50:57.687238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:50:57.687238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:50:57.687238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:50:57.687238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:50:57.687238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:50:57.687238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:50:57.687238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:50:57.687238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:50:57.687238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:50:57.687238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:50:57.687973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:50:57.687973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:50:57.687973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:50:57.687973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:50:57.687973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:50:57.687973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:50:57.687973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:50:57.687973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:50:57.687973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:50:57.687973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:50:57.687973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:50:57.687973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:50:57.690860 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 81/164] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:50:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:50:57.696808 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748a02f-6acb-4830-8d87-438ff7838385 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:57.731442 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:57.739007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86012682-2d15-4d13-99ac-bb4983574283 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:57.807509 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be5eb4-a4b7-4b8e-8d45-884dcc2e5e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:57.808133 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be5eb4-a4b7-4b8e-8d45-884dcc2e5e7f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:57.808410 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be5eb4-a4b7-4b8e-8d45-884dcc2e5e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:57.808680 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be5eb4-a4b7-4b8e-8d45-884dcc2e5e7f None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:57.809372 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be5eb4-a4b7-4b8e-8d45-884dcc2e5e7f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:50:57.809671 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be5eb4-a4b7-4b8e-8d45-884dcc2e5e7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:57.811109 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be5eb4-a4b7-4b8e-8d45-884dcc2e5e7f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:57.825746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 84/165] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:50:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:57.826627 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be5eb4-a4b7-4b8e-8d45-884dcc2e5e7f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:57.928161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:57.961440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748a02f-6acb-4830-8d87-438ff7838385 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:58.045301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be5eb4-a4b7-4b8e-8d45-884dcc2e5e7f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:58.049617 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1b5a5-1a28-4508-a251-2ad4983d5e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:58.050266 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1b5a5-1a28-4508-a251-2ad4983d5e18 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:58.050579 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1b5a5-1a28-4508-a251-2ad4983d5e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:58.050821 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1b5a5-1a28-4508-a251-2ad4983d5e18 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:58.051495 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1b5a5-1a28-4508-a251-2ad4983d5e18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:50:58.051796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1b5a5-1a28-4508-a251-2ad4983d5e18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:58.053389 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1b5a5-1a28-4508-a251-2ad4983d5e18 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:58.083096 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 82/166] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:50:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:50:58.083804 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1b5a5-1a28-4508-a251-2ad4983d5e18 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:58.126136 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad50a2-ea59-48d6-965a-d4c3288fca24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:58.127817 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad50a2-ea59-48d6-965a-d4c3288fca24 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:58.128308 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad50a2-ea59-48d6-965a-d4c3288fca24 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:58.128810 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad50a2-ea59-48d6-965a-d4c3288fca24 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:58.147849 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad50a2-ea59-48d6-965a-d4c3288fca24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:50:58.154019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-42ad50a2-ea59-48d6-965a-d4c3288fca24 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:50:58.154019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:50:58.154019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:50:58.154019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:50:58.154019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:50:58.154019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:50:58.154019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:50:58.154019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:50:58.154019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:50:58.154019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:50:58.154019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:50:58.154019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:50:58.154019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:50:58.154019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:50:58.154019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:50:58.154019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:50:58.155174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:50:58.155174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:50:58.155174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:50:58.155174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:50:58.155174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:50:58.155174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:50:58.155174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:50:58.155174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:50:58.155174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:50:58.155174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:50:58.155174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:50:58.155174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:50:58.155174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:50:58.155174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:50:58.155174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:50:58.155174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:50:58.156009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:50:58.156009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:50:58.156009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:50:58.156009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:50:58.156009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:50:58.156009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:50:58.156009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:50:58.156009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:50:58.156009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:50:58.156009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:50:58.156009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:50:58.156009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:50:58.163917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 85/167] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:50:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:50:58.164925 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad50a2-ea59-48d6-965a-d4c3288fca24 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:58.199827 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:58.346664 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1b5a5-1a28-4508-a251-2ad4983d5e18 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:58.365957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad50a2-ea59-48d6-965a-d4c3288fca24 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:58.439095 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0c0a0-c71a-4517-80a8-460732afd0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:58.439725 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0c0a0-c71a-4517-80a8-460732afd0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:58.440008 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0c0a0-c71a-4517-80a8-460732afd0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:58.440281 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0c0a0-c71a-4517-80a8-460732afd0b3 None admin] PATH_INFO: `/v3/users/4fde697280c34660bcd0b9ec24ba1a9a` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:58.442029 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0c0a0-c71a-4517-80a8-460732afd0b3 None admin] RBAC: Authorizing `identity:get_user(user_id=4fde697280c34660bcd0b9ec24ba1a9a)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:58.443469 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0c0a0-c71a-4517-80a8-460732afd0b3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:58.445257 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 83/168] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:50:58 2022] GET /identity/v3/users/4fde697280c34660bcd0b9ec24ba1a9a => generated 275 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:58.458164 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0c0a0-c71a-4517-80a8-460732afd0b3 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:58.463510 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304da1c-f28c-4ee2-853b-552ad74d469f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:58.464163 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304da1c-f28c-4ee2-853b-552ad74d469f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:58.464443 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304da1c-f28c-4ee2-853b-552ad74d469f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:58.464715 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304da1c-f28c-4ee2-853b-552ad74d469f None admin] PATH_INFO: `/v3/users/07ccce5a2a4546febae17d32e636d9bf` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:58.466924 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304da1c-f28c-4ee2-853b-552ad74d469f None admin] RBAC: Authorizing `identity:get_user(user_id=07ccce5a2a4546febae17d32e636d9bf)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:58.468434 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304da1c-f28c-4ee2-853b-552ad74d469f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:58.480353 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 86/169] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:50:58 2022] GET /identity/v3/users/07ccce5a2a4546febae17d32e636d9bf => generated 247 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:58.481063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304da1c-f28c-4ee2-853b-552ad74d469f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:58.493929 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:58.654559 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:58.688961 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304da1c-f28c-4ee2-853b-552ad74d469f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:58.712133 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0c0a0-c71a-4517-80a8-460732afd0b3 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:58.763421 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ea864-eb4e-4b37-9345-fa35a7bd6e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:58.764035 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ea864-eb4e-4b37-9345-fa35a7bd6e5e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:58.764316 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ea864-eb4e-4b37-9345-fa35a7bd6e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:58.764587 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ea864-eb4e-4b37-9345-fa35a7bd6e5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:58.814564 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd81b3-4ce3-47d3-b258-71d6d9721ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:58.815198 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd81b3-4ce3-47d3-b258-71d6d9721ca2 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:58.815484 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd81b3-4ce3-47d3-b258-71d6d9721ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:58.815756 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd81b3-4ce3-47d3-b258-71d6d9721ca2 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:58.816434 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd81b3-4ce3-47d3-b258-71d6d9721ca2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:50:58.816737 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd81b3-4ce3-47d3-b258-71d6d9721ca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:58.818141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd81b3-4ce3-47d3-b258-71d6d9721ca2 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:58.835683 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 84/170] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 14 00:50:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:58.836524 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd81b3-4ce3-47d3-b258-71d6d9721ca2 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:58.892247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ea864-eb4e-4b37-9345-fa35a7bd6e5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:58.893710 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ea864-eb4e-4b37-9345-fa35a7bd6e5e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:58.982168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:59.041422 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd81b3-4ce3-47d3-b258-71d6d9721ca2 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:59.065489 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:59.091207 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 87/171] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:50:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:50:59.092305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4ca4b-d7df-4930-b144-b8d83125664e None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:59.092623 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4ca4b-d7df-4930-b144-b8d83125664e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:59.092903 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4ca4b-d7df-4930-b144-b8d83125664e None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:59.094195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 88/172] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:50:59.095459 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4ca4b-d7df-4930-b144-b8d83125664e None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:59.113082 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0148d5-fca8-4596-8f2c-53c8f62613aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:59.113703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0148d5-fca8-4596-8f2c-53c8f62613aa None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:59.114001 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0148d5-fca8-4596-8f2c-53c8f62613aa None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:59.114270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0148d5-fca8-4596-8f2c-53c8f62613aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:59.192072 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0148d5-fca8-4596-8f2c-53c8f62613aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:59.193540 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0148d5-fca8-4596-8f2c-53c8f62613aa None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:59.279931 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:59.303444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 85/173] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:50:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:50:59.304746 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0148d5-fca8-4596-8f2c-53c8f62613aa None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:59.318919 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4ca4b-d7df-4930-b144-b8d83125664e None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:59.354309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c91d25-1584-4c3f-ace0-f039101a4d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:59.354936 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c91d25-1584-4c3f-ace0-f039101a4d54 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:59.355213 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c91d25-1584-4c3f-ace0-f039101a4d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:59.355484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c91d25-1584-4c3f-ace0-f039101a4d54 None admin] PATH_INFO: `/v3/users/4fde697280c34660bcd0b9ec24ba1a9a` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:59.356619 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c91d25-1584-4c3f-ace0-f039101a4d54 None admin] RBAC: Authorizing `identity:get_user(user_id=4fde697280c34660bcd0b9ec24ba1a9a)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:59.358101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c91d25-1584-4c3f-ace0-f039101a4d54 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:59.364474 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 89/174] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:50:59 2022] GET /identity/v3/users/4fde697280c34660bcd0b9ec24ba1a9a => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:59.365726 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a70736-4969-404e-b440-9b3742590180 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:59.366032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a70736-4969-404e-b440-9b3742590180 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:59.366307 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a70736-4969-404e-b440-9b3742590180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:59.385852 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-29a70736-4969-404e-b440-9b3742590180 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:59.387119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-29a70736-4969-404e-b440-9b3742590180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:59.424787 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0148d5-fca8-4596-8f2c-53c8f62613aa None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:59.463377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 90/175] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:50:59.464874 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c70b1-22ba-47ee-a3da-73d0338f69f3 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:59.465244 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c70b1-22ba-47ee-a3da-73d0338f69f3 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:59.465522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c70b1-22ba-47ee-a3da-73d0338f69f3 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:59.466373 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f451119-7c1c-431c-97f9-78fb7f67e896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:59.466827 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 91/176] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:50:59.467206 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f451119-7c1c-431c-97f9-78fb7f67e896 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:59.467602 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f451119-7c1c-431c-97f9-78fb7f67e896 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:59.467720 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c70b1-22ba-47ee-a3da-73d0338f69f3 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:59.468049 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f451119-7c1c-431c-97f9-78fb7f67e896 None admin] PATH_INFO: `/v3/projects/6b02aee449a54bf3bb79025645d7f35e` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:59.469396 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f451119-7c1c-431c-97f9-78fb7f67e896 None admin] RBAC: Authorizing `identity:get_project(project_id=6b02aee449a54bf3bb79025645d7f35e)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:59.471152 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f451119-7c1c-431c-97f9-78fb7f67e896 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:59.473780 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 86/177] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:50:59 2022] GET /identity/v3/projects/6b02aee449a54bf3bb79025645d7f35e => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:59.474659 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f451119-7c1c-431c-97f9-78fb7f67e896 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:59.482233 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:59.526249 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:59.590260 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f451119-7c1c-431c-97f9-78fb7f67e896 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:59.619408 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c70b1-22ba-47ee-a3da-73d0338f69f3 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:59.630122 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a8f49-6328-476c-9ad9-c6db92b2d3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:59.630761 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a8f49-6328-476c-9ad9-c6db92b2d3e3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:59.631139 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a8f49-6328-476c-9ad9-c6db92b2d3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:59.631509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a8f49-6328-476c-9ad9-c6db92b2d3e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:59.656317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c1e7f-0731-4e14-af24-f933674434dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:59.657301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c1e7f-0731-4e14-af24-f933674434dd None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:59.657716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c1e7f-0731-4e14-af24-f933674434dd None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:59.658254 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c1e7f-0731-4e14-af24-f933674434dd None admin] PATH_INFO: `/v3/projects/6b02aee449a54bf3bb79025645d7f35e` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:59.659611 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c1e7f-0731-4e14-af24-f933674434dd None admin] RBAC: Authorizing `identity:get_project(project_id=6b02aee449a54bf3bb79025645d7f35e)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:59.661424 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c1e7f-0731-4e14-af24-f933674434dd None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:59.663353 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 92/178] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:50:59 2022] GET /identity/v3/projects/6b02aee449a54bf3bb79025645d7f35e => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:59.664834 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e613c7-1349-4f77-bd82-0f36358f7069 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:59.665283 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e613c7-1349-4f77-bd82-0f36358f7069 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:59.665732 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e613c7-1349-4f77-bd82-0f36358f7069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:59.685488 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-10e613c7-1349-4f77-bd82-0f36358f7069 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:50:59.687199 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-10e613c7-1349-4f77-bd82-0f36358f7069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:50:59.709452 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a8f49-6328-476c-9ad9-c6db92b2d3e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:59.711256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a8f49-6328-476c-9ad9-c6db92b2d3e3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:59.737838 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:59.759848 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 93/179] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:50:59.761023 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e613c7-1349-4f77-bd82-0f36358f7069 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:59.767013 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:50:59.836262 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 87/180] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:50:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:50:59.837707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c56a07-3592-45ec-8522-a42a935ba033 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:59.838021 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c56a07-3592-45ec-8522-a42a935ba033 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:59.838299 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c56a07-3592-45ec-8522-a42a935ba033 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:59.840334 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 88/181] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:50:59.840986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c56a07-3592-45ec-8522-a42a935ba033 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:59.886564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e613c7-1349-4f77-bd82-0f36358f7069 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:59.923295 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778b1d5-2c77-4afd-8da2-98bd6499f472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:50:59.923898 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778b1d5-2c77-4afd-8da2-98bd6499f472 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:50:59.924177 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778b1d5-2c77-4afd-8da2-98bd6499f472 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:50:59.924447 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778b1d5-2c77-4afd-8da2-98bd6499f472 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:50:59.925217 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778b1d5-2c77-4afd-8da2-98bd6499f472 None admin] RBAC: Adding query filter params (role.id=8373a23ee4ff4c7d94e82480d85b586b, scope.project.id=6b02aee449a54bf3bb79025645d7f35e, user.id=4fde697280c34660bcd0b9ec24ba1a9a) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:50:59.925523 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778b1d5-2c77-4afd-8da2-98bd6499f472 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:50:59.927176 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778b1d5-2c77-4afd-8da2-98bd6499f472 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:50:59.933216 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 94/182] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:50:59 2022] GET /identity/v3/role_assignments?user.id=4fde697280c34660bcd0b9ec24ba1a9a&scope.project.id=6b02aee449a54bf3bb79025645d7f35e&role.id=8373a23ee4ff4c7d94e82480d85b586b => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:50:59.939449 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778b1d5-2c77-4afd-8da2-98bd6499f472 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:50:59.974364 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c56a07-3592-45ec-8522-a42a935ba033 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:50:59.991592 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:00.018063 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67231ce-b6f7-43a3-b20d-9c86353b33b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:00.018839 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67231ce-b6f7-43a3-b20d-9c86353b33b3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:00.019221 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67231ce-b6f7-43a3-b20d-9c86353b33b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:00.019802 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67231ce-b6f7-43a3-b20d-9c86353b33b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:00.020698 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67231ce-b6f7-43a3-b20d-9c86353b33b3 None admin] RBAC: Adding query filter params (role.id=0d7a36bda723430eae02f10f4c775c96, scope.project.id=6b02aee449a54bf3bb79025645d7f35e, user.id=07ccce5a2a4546febae17d32e636d9bf) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:00.021743 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67231ce-b6f7-43a3-b20d-9c86353b33b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:00.023343 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67231ce-b6f7-43a3-b20d-9c86353b33b3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:00.030785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 89/183] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:50:59 2022] GET /identity/v3/role_assignments?user.id=07ccce5a2a4546febae17d32e636d9bf&scope.project.id=6b02aee449a54bf3bb79025645d7f35e&role.id=0d7a36bda723430eae02f10f4c775c96 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:00.032313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67231ce-b6f7-43a3-b20d-9c86353b33b3 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:00.041909 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:00.064542 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778b1d5-2c77-4afd-8da2-98bd6499f472 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:00.110389 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19a7c5-5808-4442-b83a-e0c7784ef896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:00.110954 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19a7c5-5808-4442-b83a-e0c7784ef896 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:00.111233 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19a7c5-5808-4442-b83a-e0c7784ef896 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:00.111503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19a7c5-5808-4442-b83a-e0c7784ef896 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:00.124261 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19a7c5-5808-4442-b83a-e0c7784ef896 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:00.130950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-1b19a7c5-5808-4442-b83a-e0c7784ef896 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:51:00.130950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:00.130950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:00.130950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:00.130950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:00.130950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:00.130950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:00.130950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:00.130950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:00.130950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:00.130950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:00.130950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:00.130950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:00.130950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:00.130950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:00.130950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:00.131920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:00.131920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:00.131920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:00.131920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:00.131920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:00.131920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:00.131920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:00.131920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:00.131920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:00.131920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:00.131920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:00.131920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:00.131920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:00.131920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:00.131920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:00.131920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:00.132676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:00.132676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:00.132676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:00.132676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:00.132676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:00.132676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:00.132676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:00.132676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:00.132676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:00.132676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:00.132676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:51:00.132676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:00.132676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 95/184] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:50:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:00.133745 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c8d46-7c5f-4999-8631-dc9529ee6e83 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:00.137494 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c8d46-7c5f-4999-8631-dc9529ee6e83 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:00.137494 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c8d46-7c5f-4999-8631-dc9529ee6e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:00.154490 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67231ce-b6f7-43a3-b20d-9c86353b33b3 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:00.155367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-5d4c8d46-7c5f-4999-8631-dc9529ee6e83 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:00.156698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5d4c8d46-7c5f-4999-8631-dc9529ee6e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:00.194486 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb480c1-907c-471c-a729-95c57f78eb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:00.195144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb480c1-907c-471c-a729-95c57f78eb9e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:00.195440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb480c1-907c-471c-a729-95c57f78eb9e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:00.195705 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb480c1-907c-471c-a729-95c57f78eb9e None admin] PATH_INFO: `/v3/projects/980fa17c43e9422b92284f2941735783` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:00.197786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb480c1-907c-471c-a729-95c57f78eb9e None admin] RBAC: Authorizing `identity:get_project(project_id=980fa17c43e9422b92284f2941735783)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:00.199325 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb480c1-907c-471c-a729-95c57f78eb9e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:00.201269 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 90/185] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:00 2022] GET /identity/v3/projects/980fa17c43e9422b92284f2941735783 => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:00.202287 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c3e2d-eb36-4773-a093-5c0fb8ed7a18 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:00.202571 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c3e2d-eb36-4773-a093-5c0fb8ed7a18 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:00.202844 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c3e2d-eb36-4773-a093-5c0fb8ed7a18 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:00.204860 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 91/186] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:00.205615 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c3e2d-eb36-4773-a093-5c0fb8ed7a18 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:00.243789 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 96/187] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:00.244757 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c8d46-7c5f-4999-8631-dc9529ee6e83 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:00.286695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:00.300644 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:00.357448 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c3e2d-eb36-4773-a093-5c0fb8ed7a18 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:00.361530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c8d46-7c5f-4999-8631-dc9529ee6e83 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:00.393625 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c7f2b-8db1-4ead-978d-11a79411f58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:00.394291 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c7f2b-8db1-4ead-978d-11a79411f58e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:00.394570 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c7f2b-8db1-4ead-978d-11a79411f58e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:00.394841 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c7f2b-8db1-4ead-978d-11a79411f58e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:00.398437 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c8f2f-6cf1-45ae-98ab-9348375ea40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:00.399202 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c8f2f-6cf1-45ae-98ab-9348375ea40f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:00.399641 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c8f2f-6cf1-45ae-98ab-9348375ea40f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:00.399903 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c8f2f-6cf1-45ae-98ab-9348375ea40f None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:00.400559 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c8f2f-6cf1-45ae-98ab-9348375ea40f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:00.400854 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c8f2f-6cf1-45ae-98ab-9348375ea40f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:00.402450 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c8f2f-6cf1-45ae-98ab-9348375ea40f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:00.405433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c7f2b-8db1-4ead-978d-11a79411f58e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:00.410347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-4d1c7f2b-8db1-4ead-978d-11a79411f58e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 00:51:00.410347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:00.410347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:00.410347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:00.410347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:00.410347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:00.410347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:00.410347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:00.410347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:00.410347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:00.410347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:00.410347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:00.410347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:00.410347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:00.410347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:00.410347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:00.411202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:00.411202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:00.411202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:00.411202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:00.411202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:00.411202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:00.411202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:00.411202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:00.411202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:00.411202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:00.411202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:00.411202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:00.411202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:00.411202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:00.411202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:00.411202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:00.411986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:00.411986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:00.411986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:00.411986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:00.411986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:00.411986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:00.411986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:00.411986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:00.411986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:00.411986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:00.411986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 00:51:00.411986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:00.412577 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 97/188] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:00.412577 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c8f2f-6cf1-45ae-98ab-9348375ea40f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:00.416020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 92/189] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 14 00:51:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:00.417223 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3b619-f332-4ebc-ab74-2effcb58cd64 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:00.417508 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3b619-f332-4ebc-ab74-2effcb58cd64 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:00.417778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3b619-f332-4ebc-ab74-2effcb58cd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:00.436191 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-0fe3b619-f332-4ebc-ab74-2effcb58cd64 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:00.437474 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0fe3b619-f332-4ebc-ab74-2effcb58cd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:00.507296 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 93/190] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:00.507966 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3b619-f332-4ebc-ab74-2effcb58cd64 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:00.515135 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:00.518995 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c8f2f-6cf1-45ae-98ab-9348375ea40f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:00.555792 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555e373-76c2-4de3-a589-d0100d6021fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:00.556405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555e373-76c2-4de3-a589-d0100d6021fe None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:00.556665 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555e373-76c2-4de3-a589-d0100d6021fe None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:00.556935 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555e373-76c2-4de3-a589-d0100d6021fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:00.557653 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555e373-76c2-4de3-a589-d0100d6021fe None admin] RBAC: Adding query filter params (role.id=ee3984f710984de6bf564de3bee00d33, scope.project.id=980fa17c43e9422b92284f2941735783, user.id=4fde697280c34660bcd0b9ec24ba1a9a) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:00.557990 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555e373-76c2-4de3-a589-d0100d6021fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:00.559867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555e373-76c2-4de3-a589-d0100d6021fe None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:00.565296 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 98/191] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:51:00 2022] GET /identity/v3/role_assignments?user.id=4fde697280c34660bcd0b9ec24ba1a9a&scope.project.id=980fa17c43e9422b92284f2941735783&role.id=ee3984f710984de6bf564de3bee00d33 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:00.566727 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555e373-76c2-4de3-a589-d0100d6021fe None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:00.592024 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:00.636763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3b619-f332-4ebc-ab74-2effcb58cd64 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:00.676892 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95025442-dd4d-4416-99b4-b0927792a5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:00.677615 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95025442-dd4d-4416-99b4-b0927792a5cd None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:00.678220 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95025442-dd4d-4416-99b4-b0927792a5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:00.678517 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95025442-dd4d-4416-99b4-b0927792a5cd None admin] PATH_INFO: `/v3/users/a6b8fb2339ce4f02a0a987fe06894b2a` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:00.695220 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95025442-dd4d-4416-99b4-b0927792a5cd None admin] RBAC: Authorizing `identity:get_user(user_id=a6b8fb2339ce4f02a0a987fe06894b2a)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:00.696712 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95025442-dd4d-4416-99b4-b0927792a5cd None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:00.698836 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 94/192] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:51:00 2022] GET /identity/v3/users/a6b8fb2339ce4f02a0a987fe06894b2a => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:00.699661 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95025442-dd4d-4416-99b4-b0927792a5cd None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:00.718437 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555e373-76c2-4de3-a589-d0100d6021fe None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:00.762755 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced870f2-4315-49bb-ae3a-5f4dd2bf8be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:00.763351 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced870f2-4315-49bb-ae3a-5f4dd2bf8be6 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:00.763637 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced870f2-4315-49bb-ae3a-5f4dd2bf8be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:00.763897 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced870f2-4315-49bb-ae3a-5f4dd2bf8be6 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:00.764562 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced870f2-4315-49bb-ae3a-5f4dd2bf8be6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:00.764855 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced870f2-4315-49bb-ae3a-5f4dd2bf8be6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:00.766856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced870f2-4315-49bb-ae3a-5f4dd2bf8be6 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:00.781336 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 99/193] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:51:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:00.782259 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced870f2-4315-49bb-ae3a-5f4dd2bf8be6 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:00.817554 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:00.823588 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95025442-dd4d-4416-99b4-b0927792a5cd None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:00.850123 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:00.863954 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3610e2-7609-4323-8bdb-c64e41554723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:00.864588 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3610e2-7609-4323-8bdb-c64e41554723 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:00.864884 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3610e2-7609-4323-8bdb-c64e41554723 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:00.865223 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3610e2-7609-4323-8bdb-c64e41554723 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:00.866382 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3610e2-7609-4323-8bdb-c64e41554723 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:00.867828 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3610e2-7609-4323-8bdb-c64e41554723 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:00.869416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 95/194] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:00.870306 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3610e2-7609-4323-8bdb-c64e41554723 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:00.897857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced870f2-4315-49bb-ae3a-5f4dd2bf8be6 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:00.931265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca076d-7964-4196-8b37-0a734eb56a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:00.931855 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca076d-7964-4196-8b37-0a734eb56a2c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:00.932134 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca076d-7964-4196-8b37-0a734eb56a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:00.932399 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca076d-7964-4196-8b37-0a734eb56a2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:00.970089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3610e2-7609-4323-8bdb-c64e41554723 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:00.999794 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca076d-7964-4196-8b37-0a734eb56a2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:01.002061 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca076d-7964-4196-8b37-0a734eb56a2c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:01.007980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5155a-67f5-450e-9e5d-f825f5e87375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:01.008605 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5155a-67f5-450e-9e5d-f825f5e87375 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:01.008883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5155a-67f5-450e-9e5d-f825f5e87375 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:01.009155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5155a-67f5-450e-9e5d-f825f5e87375 None admin] PATH_INFO: `/v3/users/a6b8fb2339ce4f02a0a987fe06894b2a` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:01.011996 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5155a-67f5-450e-9e5d-f825f5e87375 None admin] RBAC: Authorizing `identity:get_user(user_id=a6b8fb2339ce4f02a0a987fe06894b2a)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:01.013416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5155a-67f5-450e-9e5d-f825f5e87375 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:01.015008 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 96/195] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:51:00 2022] GET /identity/v3/users/a6b8fb2339ce4f02a0a987fe06894b2a => generated 283 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:01.018622 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5155a-67f5-450e-9e5d-f825f5e87375 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:01.025771 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:01.073997 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:01.104057 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 100/196] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:51:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:51:01.104057 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca076d-7964-4196-8b37-0a734eb56a2c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:01.119708 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5155a-67f5-450e-9e5d-f825f5e87375 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:01.152684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65a1c3-1b7b-4ce5-854e-c3c1d80727cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:01.153238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65a1c3-1b7b-4ce5-854e-c3c1d80727cf None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:01.153516 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65a1c3-1b7b-4ce5-854e-c3c1d80727cf None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:01.153788 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65a1c3-1b7b-4ce5-854e-c3c1d80727cf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:01.164407 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65a1c3-1b7b-4ce5-854e-c3c1d80727cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:01.169707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-5a65a1c3-1b7b-4ce5-854e-c3c1d80727cf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 00:51:01.169707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:01.169707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:01.169707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:01.169707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:01.169707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:01.169707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:01.169707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:01.169707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:01.169707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:01.169707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:01.169707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:01.169707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:01.169707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:01.169707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:01.169707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:01.170785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:01.170785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:01.170785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:01.170785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:01.170785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:01.170785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:01.170785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:01.170785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:01.170785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:01.170785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:01.170785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:01.170785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:01.170785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:01.170785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:01.170785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:01.170785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:01.171680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:01.171680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:01.171680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:01.171680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:01.171680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:01.171680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:01.171680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:01.171680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:01.171680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:01.171680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:01.171680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 00:51:01.171680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:01.171680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 97/197] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:01.171680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65a1c3-1b7b-4ce5-854e-c3c1d80727cf None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:01.201056 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca076d-7964-4196-8b37-0a734eb56a2c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:01.223671 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:01.236298 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8d228-8c22-444f-8f65-0615d534eaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:01.236886 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8d228-8c22-444f-8f65-0615d534eaff None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:01.237158 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8d228-8c22-444f-8f65-0615d534eaff None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:01.237421 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8d228-8c22-444f-8f65-0615d534eaff None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:01.238089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8d228-8c22-444f-8f65-0615d534eaff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:01.239529 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8d228-8c22-444f-8f65-0615d534eaff None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:01.265636 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 101/198] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 14 00:51:01 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:51:01.266537 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8d228-8c22-444f-8f65-0615d534eaff None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:01.273333 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65a1c3-1b7b-4ce5-854e-c3c1d80727cf None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:01.291868 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:01.310183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe61a75-c74e-43f3-8a26-aa8b7a084e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:01.310808 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe61a75-c74e-43f3-8a26-aa8b7a084e7c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:01.311086 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe61a75-c74e-43f3-8a26-aa8b7a084e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:01.311358 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe61a75-c74e-43f3-8a26-aa8b7a084e7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:01.387813 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe61a75-c74e-43f3-8a26-aa8b7a084e7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:01.389354 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe61a75-c74e-43f3-8a26-aa8b7a084e7c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:01.403213 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8d228-8c22-444f-8f65-0615d534eaff None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:01.444093 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be36d4-d22f-4a20-b951-d6684f57e0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:01.445163 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be36d4-d22f-4a20-b951-d6684f57e0f8 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:01.445163 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be36d4-d22f-4a20-b951-d6684f57e0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:01.445337 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be36d4-d22f-4a20-b951-d6684f57e0f8 None admin] PATH_INFO: `/v3/projects/3adf86e652e34928b6066fc3d75c468f` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:01.446687 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be36d4-d22f-4a20-b951-d6684f57e0f8 None admin] RBAC: Authorizing `identity:get_project(project_id=3adf86e652e34928b6066fc3d75c468f)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:01.448250 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be36d4-d22f-4a20-b951-d6684f57e0f8 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:01.449959 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 102/199] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:01 2022] GET /identity/v3/projects/3adf86e652e34928b6066fc3d75c468f => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:01.450263 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be36d4-d22f-4a20-b951-d6684f57e0f8 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:01.505224 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:01.508059 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 98/200] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:51:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:51:01.510701 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe61a75-c74e-43f3-8a26-aa8b7a084e7c None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:01.532491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:01.572630 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be36d4-d22f-4a20-b951-d6684f57e0f8 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:01.610871 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a86fd-e512-437a-8717-abe78440edf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:01.611473 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a86fd-e512-437a-8717-abe78440edf0 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:01.611743 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a86fd-e512-437a-8717-abe78440edf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:01.612015 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a86fd-e512-437a-8717-abe78440edf0 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:01.612679 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a86fd-e512-437a-8717-abe78440edf0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:01.612979 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a86fd-e512-437a-8717-abe78440edf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:01.614388 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a86fd-e512-437a-8717-abe78440edf0 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:01.623700 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 103/201] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 14 00:51:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:01.624436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a86fd-e512-437a-8717-abe78440edf0 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:01.631575 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe61a75-c74e-43f3-8a26-aa8b7a084e7c None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:01.676977 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6707e-87f7-4831-85c2-7a962ced1e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:01.677825 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6707e-87f7-4831-85c2-7a962ced1e2d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:01.678194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6707e-87f7-4831-85c2-7a962ced1e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:01.678569 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6707e-87f7-4831-85c2-7a962ced1e2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:01.679833 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6707e-87f7-4831-85c2-7a962ced1e2d None admin] RBAC: Adding query filter params (role.id=0d7a36bda723430eae02f10f4c775c96, scope.project.id=3adf86e652e34928b6066fc3d75c468f, user.id=a6b8fb2339ce4f02a0a987fe06894b2a) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:01.680053 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6707e-87f7-4831-85c2-7a962ced1e2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:01.681638 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6707e-87f7-4831-85c2-7a962ced1e2d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:01.687905 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 99/202] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:51:01 2022] GET /identity/v3/role_assignments?user.id=a6b8fb2339ce4f02a0a987fe06894b2a&scope.project.id=3adf86e652e34928b6066fc3d75c468f&role.id=0d7a36bda723430eae02f10f4c775c96 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:01.688868 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6707e-87f7-4831-85c2-7a962ced1e2d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:01.739862 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a86fd-e512-437a-8717-abe78440edf0 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:01.758236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:01.784689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde1532-0130-41f7-b36a-48f0a958a83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:01.786519 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde1532-0130-41f7-b36a-48f0a958a83a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:01.786801 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde1532-0130-41f7-b36a-48f0a958a83a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:01.787072 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde1532-0130-41f7-b36a-48f0a958a83a None admin] PATH_INFO: `/v3/projects/3adf86e652e34928b6066fc3d75c468f` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:01.790677 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde1532-0130-41f7-b36a-48f0a958a83a None admin] RBAC: Authorizing `identity:get_project(project_id=3adf86e652e34928b6066fc3d75c468f)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:01.792432 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde1532-0130-41f7-b36a-48f0a958a83a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:01.795279 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 104/203] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:01 2022] GET /identity/v3/projects/3adf86e652e34928b6066fc3d75c468f => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:01.803542 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde1532-0130-41f7-b36a-48f0a958a83a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:01.814727 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:01.861444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6707e-87f7-4831-85c2-7a962ced1e2d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:01.933235 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef9451-7591-414b-892d-46cb9e31c62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:01.933795 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef9451-7591-414b-892d-46cb9e31c62a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:01.934118 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef9451-7591-414b-892d-46cb9e31c62a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:01.934392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef9451-7591-414b-892d-46cb9e31c62a None admin] PATH_INFO: `/v3/users/4ef75334f9f24d41a8ef3aa382bc7394` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:01.935548 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef9451-7591-414b-892d-46cb9e31c62a None admin] RBAC: Authorizing `identity:get_user(user_id=4ef75334f9f24d41a8ef3aa382bc7394)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:01.936986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef9451-7591-414b-892d-46cb9e31c62a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:01.940109 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 100/204] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:51:01 2022] GET /identity/v3/users/4ef75334f9f24d41a8ef3aa382bc7394 => generated 289 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:01.946815 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef9451-7591-414b-892d-46cb9e31c62a None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:01.986805 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde1532-0130-41f7-b36a-48f0a958a83a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:02.056480 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb4b23-9264-4495-86a9-6673eefa16fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:02.057091 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb4b23-9264-4495-86a9-6673eefa16fe None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:02.057367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb4b23-9264-4495-86a9-6673eefa16fe None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:02.057636 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb4b23-9264-4495-86a9-6673eefa16fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:02.058397 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb4b23-9264-4495-86a9-6673eefa16fe None admin] RBAC: Adding query filter params (role.id=8373a23ee4ff4c7d94e82480d85b586b, scope.project.id=3adf86e652e34928b6066fc3d75c468f, user.id=a6b8fb2339ce4f02a0a987fe06894b2a) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:02.058702 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb4b23-9264-4495-86a9-6673eefa16fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:02.060222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb4b23-9264-4495-86a9-6673eefa16fe None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:02.067106 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 105/205] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:51:01 2022] GET /identity/v3/role_assignments?user.id=a6b8fb2339ce4f02a0a987fe06894b2a&scope.project.id=3adf86e652e34928b6066fc3d75c468f&role.id=8373a23ee4ff4c7d94e82480d85b586b => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:51:02.163707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef9451-7591-414b-892d-46cb9e31c62a None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:02.219168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bce78d-3256-415d-9114-d722cde3a759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:02.220209 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bce78d-3256-415d-9114-d722cde3a759 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:02.220685 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bce78d-3256-415d-9114-d722cde3a759 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:02.221149 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bce78d-3256-415d-9114-d722cde3a759 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:02.249474 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:02.314578 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bce78d-3256-415d-9114-d722cde3a759 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:02.316022 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bce78d-3256-415d-9114-d722cde3a759 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:02.440370 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 101/206] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:51:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:51:02.446207 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb4b23-9264-4495-86a9-6673eefa16fe None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:02.509316 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:02.583103 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb4b23-9264-4495-86a9-6673eefa16fe None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:02.630711 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c8828-9e40-4544-99e7-e68544cea8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:02.631345 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c8828-9e40-4544-99e7-e68544cea8af None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:02.631621 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c8828-9e40-4544-99e7-e68544cea8af None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:02.631891 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c8828-9e40-4544-99e7-e68544cea8af None admin] PATH_INFO: `/v3/projects/6b02aee449a54bf3bb79025645d7f35e` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:02.638477 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c8828-9e40-4544-99e7-e68544cea8af None admin] RBAC: Authorizing `identity:get_project(project_id=6b02aee449a54bf3bb79025645d7f35e)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:02.639938 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c8828-9e40-4544-99e7-e68544cea8af None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:02.642450 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 106/207] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:02 2022] GET /identity/v3/projects/6b02aee449a54bf3bb79025645d7f35e => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:02.648094 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bce78d-3256-415d-9114-d722cde3a759 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:02.742894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:02.810272 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bce78d-3256-415d-9114-d722cde3a759 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:02.855076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1c53b-8258-4722-a73b-a71909e264d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:02.855784 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1c53b-8258-4722-a73b-a71909e264d5 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:02.856067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1c53b-8258-4722-a73b-a71909e264d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:02.856341 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1c53b-8258-4722-a73b-a71909e264d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:02.857067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1c53b-8258-4722-a73b-a71909e264d5 None admin] RBAC: Adding query filter params (role.id=79f3e2103ea3417a946a9e54a4ae30f3, scope.project.id=6b02aee449a54bf3bb79025645d7f35e, user.id=4ef75334f9f24d41a8ef3aa382bc7394) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:02.857374 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1c53b-8258-4722-a73b-a71909e264d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:02.858834 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1c53b-8258-4722-a73b-a71909e264d5 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:02.866657 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 102/208] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:51:02 2022] GET /identity/v3/role_assignments?user.id=4ef75334f9f24d41a8ef3aa382bc7394&scope.project.id=6b02aee449a54bf3bb79025645d7f35e&role.id=79f3e2103ea3417a946a9e54a4ae30f3 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:03.843178 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093aada-8474-49a5-abad-047f92b0173b None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:03.843178 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093aada-8474-49a5-abad-047f92b0173b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:03.843178 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093aada-8474-49a5-abad-047f92b0173b None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:03.844750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 107/209] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:03.850223 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7922b52-b1f8-4330-bf0c-1efa0a9c6e00 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:03.851120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7922b52-b1f8-4330-bf0c-1efa0a9c6e00 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:03.851589 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7922b52-b1f8-4330-bf0c-1efa0a9c6e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:03.871784 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e7922b52-b1f8-4330-bf0c-1efa0a9c6e00 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:03.873357 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e7922b52-b1f8-4330-bf0c-1efa0a9c6e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:03.945107 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 103/210] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:03.980749 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224f14f-cac9-484d-a244-0c6a19eb0f63 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:03.981355 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224f14f-cac9-484d-a244-0c6a19eb0f63 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:03.981891 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224f14f-cac9-484d-a244-0c6a19eb0f63 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:03.983417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 108/211] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:03.991820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21b5ec-2c2d-4102-9ac8-abb131ee711b None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:03.992111 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21b5ec-2c2d-4102-9ac8-abb131ee711b None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:03.992385 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21b5ec-2c2d-4102-9ac8-abb131ee711b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:04.012839 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-fc21b5ec-2c2d-4102-9ac8-abb131ee711b None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:04.014032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-fc21b5ec-2c2d-4102-9ac8-abb131ee711b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:04.056610 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:04.086253 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 104/212] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:04.226105 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224f14f-cac9-484d-a244-0c6a19eb0f63 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:04.308405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bf581-0b88-4a4e-81f1-1a591d3a9357 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:04.308875 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bf581-0b88-4a4e-81f1-1a591d3a9357 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:04.308985 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bf581-0b88-4a4e-81f1-1a591d3a9357 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:04.310437 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 105/213] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 00:51:04.316512 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87334a-d209-4f29-9f6f-08b4b554783e None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:04.317048 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87334a-d209-4f29-9f6f-08b4b554783e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:04.317522 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87334a-d209-4f29-9f6f-08b4b554783e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:04.331711 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224f14f-cac9-484d-a244-0c6a19eb0f63 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:04.340533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-3c87334a-d209-4f29-9f6f-08b4b554783e None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:04.342942 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:04.344821 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3c87334a-d209-4f29-9f6f-08b4b554783e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:04.368314 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e250a20-4f2a-4ffa-b8a2-e0c0a6024ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:04.368967 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e250a20-4f2a-4ffa-b8a2-e0c0a6024ebd None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:04.369240 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e250a20-4f2a-4ffa-b8a2-e0c0a6024ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:04.369507 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e250a20-4f2a-4ffa-b8a2-e0c0a6024ebd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:04.385176 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e250a20-4f2a-4ffa-b8a2-e0c0a6024ebd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:04.390193 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-9e250a20-4f2a-4ffa-b8a2-e0c0a6024ebd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:51:04.390193 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:04.390193 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:04.390193 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:04.390193 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:04.390193 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:04.390193 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:04.390193 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:04.390193 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:04.390193 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:04.390193 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:04.390193 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:04.390193 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:04.390193 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:04.390193 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:04.390193 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:04.391785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:04.391785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:04.391785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:04.391785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:04.391785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:04.391785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:04.391785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:04.391785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:04.391785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:04.391785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:04.391785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:04.391785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:04.391785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:04.391785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:04.391785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:04.391785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:04.392573 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:04.392573 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:04.392573 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:04.392573 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:04.392573 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:04.392573 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:04.392573 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:04.392573 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:04.392573 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:04.392573 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:04.392573 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:51:04.392573 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:04.392573 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 109/214] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:04.393199 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e250a20-4f2a-4ffa-b8a2-e0c0a6024ebd None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:04.440183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 106/215] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 00:51:04.441304 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87334a-d209-4f29-9f6f-08b4b554783e None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:04.503890 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e250a20-4f2a-4ffa-b8a2-e0c0a6024ebd None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:04.540935 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa60f4-2245-419d-a887-f047373edcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:04.541591 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa60f4-2245-419d-a887-f047373edcc4 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:04.541837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa60f4-2245-419d-a887-f047373edcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:04.542111 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa60f4-2245-419d-a887-f047373edcc4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:04.543201 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa60f4-2245-419d-a887-f047373edcc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:04.544631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa60f4-2245-419d-a887-f047373edcc4 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:04.546368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 110/216] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:04.552280 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52aa74-4c6d-4a52-889e-7806e856b1ae None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:04.552564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52aa74-4c6d-4a52-889e-7806e856b1ae None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:04.553059 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52aa74-4c6d-4a52-889e-7806e856b1ae None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:04.554057 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 111/217] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:04.554720 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52aa74-4c6d-4a52-889e-7806e856b1ae None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:04.562866 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87334a-d209-4f29-9f6f-08b4b554783e None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:04.565866 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:04.596731 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:04.600699 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36cd80-df2b-4531-b75b-3cc847d5be79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:04.601626 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36cd80-df2b-4531-b75b-3cc847d5be79 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:04.602086 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36cd80-df2b-4531-b75b-3cc847d5be79 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:04.602365 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36cd80-df2b-4531-b75b-3cc847d5be79 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:04.603033 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36cd80-df2b-4531-b75b-3cc847d5be79 None admin] RBAC: Adding query filter params (name=member) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:04.603481 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36cd80-df2b-4531-b75b-3cc847d5be79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:04.605245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36cd80-df2b-4531-b75b-3cc847d5be79 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:04.614251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 107/218] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 14 00:51:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:04.615397 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd818ff-c315-4722-a9f8-7dae0593b97a None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:04.615685 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd818ff-c315-4722-a9f8-7dae0593b97a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:04.615966 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd818ff-c315-4722-a9f8-7dae0593b97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:04.637257 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-0cd818ff-c315-4722-a9f8-7dae0593b97a None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:04.638472 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0cd818ff-c315-4722-a9f8-7dae0593b97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:04.670506 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52aa74-4c6d-4a52-889e-7806e856b1ae None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:04.706462 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6673b-0aeb-4227-8742-76363e9f11b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:04.707066 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6673b-0aeb-4227-8742-76363e9f11b9 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:04.707250 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 108/219] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:04.707348 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6673b-0aeb-4227-8742-76363e9f11b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:04.707766 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6673b-0aeb-4227-8742-76363e9f11b9 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:04.708254 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6673b-0aeb-4227-8742-76363e9f11b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:04.709694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6673b-0aeb-4227-8742-76363e9f11b9 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:04.710705 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd818ff-c315-4722-a9f8-7dae0593b97a None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:04.732910 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 112/220] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 14 00:51:04 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:51:04.734077 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6673b-0aeb-4227-8742-76363e9f11b9 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:04.838100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:04.848172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd818ff-c315-4722-a9f8-7dae0593b97a None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:04.877391 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:04.887805 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6673b-0aeb-4227-8742-76363e9f11b9 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:04.895191 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574db7e-2566-4a9c-94db-eb6ed91f2a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:04.896622 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574db7e-2566-4a9c-94db-eb6ed91f2a86 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:04.897171 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574db7e-2566-4a9c-94db-eb6ed91f2a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:04.897636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574db7e-2566-4a9c-94db-eb6ed91f2a86 None admin] PATH_INFO: `/v3/users/005a226332ca467dbc4f57028ac66eb7` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:04.914789 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574db7e-2566-4a9c-94db-eb6ed91f2a86 None admin] RBAC: Authorizing `identity:get_user(user_id=005a226332ca467dbc4f57028ac66eb7)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:04.916257 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574db7e-2566-4a9c-94db-eb6ed91f2a86 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:04.918138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 109/221] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:51:04 2022] GET /identity/v3/users/005a226332ca467dbc4f57028ac66eb7 => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:04.925631 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574db7e-2566-4a9c-94db-eb6ed91f2a86 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:04.942619 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc1143-d520-42be-9f02-bf0835d2aac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:04.943920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc1143-d520-42be-9f02-bf0835d2aac6 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:04.944625 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc1143-d520-42be-9f02-bf0835d2aac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:04.945113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc1143-d520-42be-9f02-bf0835d2aac6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:04.960460 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc1143-d520-42be-9f02-bf0835d2aac6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:04.966197 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-e5bc1143-d520-42be-9f02-bf0835d2aac6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:51:04.966197 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:04.966197 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:04.966197 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:04.966197 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:04.966197 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:04.966197 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:04.966197 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:04.966197 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:04.966197 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:04.966197 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:04.966197 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:04.966197 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:04.966197 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:04.966197 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:04.966197 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:04.967047 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:04.967047 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:04.967047 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:04.967047 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:04.967047 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:04.967047 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:04.967047 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:04.967047 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:04.967047 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:04.967047 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:04.967047 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:04.967047 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:04.967047 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:04.967047 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:04.967047 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:04.967047 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:04.967795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:04.967795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:04.967795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:04.967795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:04.967795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:04.967795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:04.967795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:04.967795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:04.967795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:04.967795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:04.967795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:51:04.967795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:04.970369 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 113/222] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:51:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:04.976932 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc1143-d520-42be-9f02-bf0835d2aac6 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:05.058528 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574db7e-2566-4a9c-94db-eb6ed91f2a86 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:05.102684 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc1143-d520-42be-9f02-bf0835d2aac6 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:05.106500 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebd9ba-6481-48dd-8e5a-7b5b70513f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:05.107129 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebd9ba-6481-48dd-8e5a-7b5b70513f57 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:05.107412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebd9ba-6481-48dd-8e5a-7b5b70513f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:05.107688 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebd9ba-6481-48dd-8e5a-7b5b70513f57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:05.134010 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:05.141773 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8a0fe-fa77-4741-b80e-03d9943a58eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:05.142130 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8a0fe-fa77-4741-b80e-03d9943a58eb None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:05.142407 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8a0fe-fa77-4741-b80e-03d9943a58eb None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:05.142677 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8a0fe-fa77-4741-b80e-03d9943a58eb None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:05.143350 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8a0fe-fa77-4741-b80e-03d9943a58eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:05.143652 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8a0fe-fa77-4741-b80e-03d9943a58eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:05.145042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8a0fe-fa77-4741-b80e-03d9943a58eb None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:05.154801 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 114/223] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:51:05.155626 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8a0fe-fa77-4741-b80e-03d9943a58eb None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:05.178631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:05.185144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebd9ba-6481-48dd-8e5a-7b5b70513f57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:05.187003 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebd9ba-6481-48dd-8e5a-7b5b70513f57 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:05.296899 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8a0fe-fa77-4741-b80e-03d9943a58eb None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:05.299094 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 110/224] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:51:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:51:05.304008 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebd9ba-6481-48dd-8e5a-7b5b70513f57 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:05.341070 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a6398-dcf2-4203-b921-ee30dae8180e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:05.341728 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a6398-dcf2-4203-b921-ee30dae8180e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:05.342049 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a6398-dcf2-4203-b921-ee30dae8180e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:05.342324 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a6398-dcf2-4203-b921-ee30dae8180e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:05.355762 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a6398-dcf2-4203-b921-ee30dae8180e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:05.361518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-ed8a6398-dcf2-4203-b921-ee30dae8180e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 00:51:05.361518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:05.361518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:05.361518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:05.361518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:05.361518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:05.361518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:05.361518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:05.361518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:05.361518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:05.361518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:05.361518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:05.361518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:05.361518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:05.361518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:05.361518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:05.362427 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:05.362427 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:05.362427 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:05.362427 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:05.362427 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:05.362427 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:05.362427 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:05.362427 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:05.362427 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:05.362427 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:05.362427 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:05.362427 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:05.362427 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:05.362427 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:05.362427 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:05.362427 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:05.363212 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:05.363212 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:05.363212 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:05.363212 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:05.363212 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:05.363212 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:05.363212 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:05.363212 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:05.363212 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:05.363212 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:05.363212 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 00:51:05.363212 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:05.367770 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 115/225] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 14 00:51:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:05.368616 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a6398-dcf2-4203-b921-ee30dae8180e None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:05.379232 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:05.440238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebd9ba-6481-48dd-8e5a-7b5b70513f57 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:05.463867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:05.481996 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890e6c9-beb2-4fc5-afca-0b259a3cd2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:05.482978 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890e6c9-beb2-4fc5-afca-0b259a3cd2e7 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:05.483449 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890e6c9-beb2-4fc5-afca-0b259a3cd2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:05.483914 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890e6c9-beb2-4fc5-afca-0b259a3cd2e7 None admin] PATH_INFO: `/v3/users/a6b8fb2339ce4f02a0a987fe06894b2a` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:05.485982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890e6c9-beb2-4fc5-afca-0b259a3cd2e7 None admin] RBAC: Authorizing `identity:get_user(user_id=a6b8fb2339ce4f02a0a987fe06894b2a)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:05.487865 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890e6c9-beb2-4fc5-afca-0b259a3cd2e7 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:05.490194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 111/226] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:51:05 2022] GET /identity/v3/users/a6b8fb2339ce4f02a0a987fe06894b2a => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:05.491273 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890e6c9-beb2-4fc5-afca-0b259a3cd2e7 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:05.497458 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a6398-dcf2-4203-b921-ee30dae8180e None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:05.534088 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030cb9e-a5ae-46ab-b264-00e469968029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:05.535123 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030cb9e-a5ae-46ab-b264-00e469968029 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:05.535872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030cb9e-a5ae-46ab-b264-00e469968029 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:05.536556 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030cb9e-a5ae-46ab-b264-00e469968029 None admin] PATH_INFO: `/v3/projects/3adf86e652e34928b6066fc3d75c468f` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:05.537900 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030cb9e-a5ae-46ab-b264-00e469968029 None admin] RBAC: Authorizing `identity:get_project(project_id=3adf86e652e34928b6066fc3d75c468f)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:05.540480 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030cb9e-a5ae-46ab-b264-00e469968029 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:05.542313 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 116/227] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:05 2022] GET /identity/v3/projects/3adf86e652e34928b6066fc3d75c468f => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:05.543317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030cb9e-a5ae-46ab-b264-00e469968029 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:05.627519 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890e6c9-beb2-4fc5-afca-0b259a3cd2e7 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:05.650938 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:05.665592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fc639-3c73-423b-932e-c6103dc9138c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:05.665786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030cb9e-a5ae-46ab-b264-00e469968029 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:05.666686 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fc639-3c73-423b-932e-c6103dc9138c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:05.667135 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fc639-3c73-423b-932e-c6103dc9138c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:05.667574 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fc639-3c73-423b-932e-c6103dc9138c None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:05.668403 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fc639-3c73-423b-932e-c6103dc9138c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:05.668900 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fc639-3c73-423b-932e-c6103dc9138c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:05.670495 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fc639-3c73-423b-932e-c6103dc9138c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:05.679832 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 112/228] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:51:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:05.681098 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fc639-3c73-423b-932e-c6103dc9138c None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:05.703335 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdd990-c82a-4019-a767-c0f6f5ffe655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:05.704492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdd990-c82a-4019-a767-c0f6f5ffe655 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:05.704821 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdd990-c82a-4019-a767-c0f6f5ffe655 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:05.705088 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdd990-c82a-4019-a767-c0f6f5ffe655 None admin] PATH_INFO: `/v3/projects/3adf86e652e34928b6066fc3d75c468f` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:05.706770 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fdd990-c82a-4019-a767-c0f6f5ffe655 None admin] RBAC: Authorizing `identity:get_project(project_id=3adf86e652e34928b6066fc3d75c468f)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:05.707973 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fdd990-c82a-4019-a767-c0f6f5ffe655 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:05.714518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 117/229] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:05 2022] GET /identity/v3/projects/3adf86e652e34928b6066fc3d75c468f => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:05.715415 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdd990-c82a-4019-a767-c0f6f5ffe655 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:05.732053 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:05.787310 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fc639-3c73-423b-932e-c6103dc9138c None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:05.821228 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e93616-5295-47c9-9113-a27e3c248d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:05.822202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e93616-5295-47c9-9113-a27e3c248d42 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:05.822676 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e93616-5295-47c9-9113-a27e3c248d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:05.823241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e93616-5295-47c9-9113-a27e3c248d42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:05.824159 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e93616-5295-47c9-9113-a27e3c248d42 None admin] RBAC: Adding query filter params (role.id=ee3984f710984de6bf564de3bee00d33, scope.project.id=3adf86e652e34928b6066fc3d75c468f, user.id=005a226332ca467dbc4f57028ac66eb7) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:05.824660 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e93616-5295-47c9-9113-a27e3c248d42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:05.826349 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e93616-5295-47c9-9113-a27e3c248d42 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:05.826676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdd990-c82a-4019-a767-c0f6f5ffe655 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:05.833147 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 113/230] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:51:05 2022] GET /identity/v3/role_assignments?user.id=005a226332ca467dbc4f57028ac66eb7&scope.project.id=3adf86e652e34928b6066fc3d75c468f&role.id=ee3984f710984de6bf564de3bee00d33 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:05.834424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e93616-5295-47c9-9113-a27e3c248d42 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:05.905001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce6e3e-84a2-411c-a964-a959f1c105ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:05.906380 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce6e3e-84a2-411c-a964-a959f1c105ea None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:05.907415 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce6e3e-84a2-411c-a964-a959f1c105ea None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:05.907880 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce6e3e-84a2-411c-a964-a959f1c105ea None admin] PATH_INFO: `/v3/users/a6b8fb2339ce4f02a0a987fe06894b2a` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:05.911848 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce6e3e-84a2-411c-a964-a959f1c105ea None admin] RBAC: Authorizing `identity:get_user(user_id=a6b8fb2339ce4f02a0a987fe06894b2a)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:05.913608 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce6e3e-84a2-411c-a964-a959f1c105ea None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:05.915649 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 118/231] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:51:05 2022] GET /identity/v3/users/a6b8fb2339ce4f02a0a987fe06894b2a => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:05.924052 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce6e3e-84a2-411c-a964-a959f1c105ea None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:05.948181 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:06.028535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e93616-5295-47c9-9113-a27e3c248d42 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:06.065987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ed6a6-c02a-44c7-b118-c905aa0df1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:06.067024 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ed6a6-c02a-44c7-b118-c905aa0df1a5 None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:06.067525 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ed6a6-c02a-44c7-b118-c905aa0df1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:06.067990 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ed6a6-c02a-44c7-b118-c905aa0df1a5 None admin] PATH_INFO: `/v3/projects/3adf86e652e34928b6066fc3d75c468f/users/a6b8fb2339ce4f02a0a987fe06894b2a/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:06.068616 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:06.071118 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ed6a6-c02a-44c7-b118-c905aa0df1a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=3adf86e652e34928b6066fc3d75c468f, user_id=a6b8fb2339ce4f02a0a987fe06894b2a, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:06.072785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ed6a6-c02a-44c7-b118-c905aa0df1a5 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:06.099749 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 114/232] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 14 00:51:05 2022] PUT /identity/v3/projects/3adf86e652e34928b6066fc3d75c468f/users/a6b8fb2339ce4f02a0a987fe06894b2a/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 00:51:06.104085 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce6e3e-84a2-411c-a964-a959f1c105ea None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:06.164383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6ab80-10b9-424f-a807-5c5d9478133c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:06.164956 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6ab80-10b9-424f-a807-5c5d9478133c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:06.165236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6ab80-10b9-424f-a807-5c5d9478133c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:06.165506 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6ab80-10b9-424f-a807-5c5d9478133c None admin] PATH_INFO: `/v3/projects/3adf86e652e34928b6066fc3d75c468f` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:06.167084 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b6ab80-10b9-424f-a807-5c5d9478133c None admin] RBAC: Authorizing `identity:get_project(project_id=3adf86e652e34928b6066fc3d75c468f)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:06.168895 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b6ab80-10b9-424f-a807-5c5d9478133c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:06.170788 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 119/233] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:05 2022] GET /identity/v3/projects/3adf86e652e34928b6066fc3d75c468f => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:06.176982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ed6a6-c02a-44c7-b118-c905aa0df1a5 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:06.301086 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ed6a6-c02a-44c7-b118-c905aa0df1a5 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:06.311100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:06.343199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5eee89-587a-4553-8a73-cb1876449179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:06.343864 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5eee89-587a-4553-8a73-cb1876449179 None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:06.344247 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5eee89-587a-4553-8a73-cb1876449179 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:06.344524 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5eee89-587a-4553-8a73-cb1876449179 None admin] PATH_INFO: `/v3/projects/3adf86e652e34928b6066fc3d75c468f/users/a6b8fb2339ce4f02a0a987fe06894b2a/roles/8373a23ee4ff4c7d94e82480d85b586b` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:06.346738 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5eee89-587a-4553-8a73-cb1876449179 None admin] RBAC: Authorizing `identity:create_grant(project_id=3adf86e652e34928b6066fc3d75c468f, user_id=a6b8fb2339ce4f02a0a987fe06894b2a, role_id=8373a23ee4ff4c7d94e82480d85b586b)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:06.348216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5eee89-587a-4553-8a73-cb1876449179 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:06.366461 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 115/234] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 14 00:51:06 2022] PUT /identity/v3/projects/3adf86e652e34928b6066fc3d75c468f/users/a6b8fb2339ce4f02a0a987fe06894b2a/roles/8373a23ee4ff4c7d94e82480d85b586b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 00:51:07.264038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2e917-fc97-4e5f-8cd9-15e2256ac899 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:07.264526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2e917-fc97-4e5f-8cd9-15e2256ac899 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:07.264526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2e917-fc97-4e5f-8cd9-15e2256ac899 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:07.265825 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 120/235] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:07.271151 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612a038-cb93-4f48-9b34-3ef5753f78d6 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:07.271545 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612a038-cb93-4f48-9b34-3ef5753f78d6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:07.271742 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612a038-cb93-4f48-9b34-3ef5753f78d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:07.292393 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897c5c1-7b22-4517-8750-6eed192fc0f7 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:07.292669 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897c5c1-7b22-4517-8750-6eed192fc0f7 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:07.292938 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897c5c1-7b22-4517-8750-6eed192fc0f7 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:07.294271 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 121/236] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:07.300734 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-c612a038-cb93-4f48-9b34-3ef5753f78d6 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:07.301936 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c612a038-cb93-4f48-9b34-3ef5753f78d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:07.305370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365e2a7-1c6d-43dd-ac9b-d360797cc48d None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:07.305646 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365e2a7-1c6d-43dd-ac9b-d360797cc48d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:07.305944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365e2a7-1c6d-43dd-ac9b-d360797cc48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:07.333384 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-2365e2a7-1c6d-43dd-ac9b-d360797cc48d None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:07.334595 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-2365e2a7-1c6d-43dd-ac9b-d360797cc48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:07.421592 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 122/237] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 00:51:07.452369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 116/238] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:07.760772 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365e2a7-1c6d-43dd-ac9b-d360797cc48d None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:07.773171 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612a038-cb93-4f48-9b34-3ef5753f78d6 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:07.898257 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:07.906516 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612a038-cb93-4f48-9b34-3ef5753f78d6 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:07.908413 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:07.930580 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365e2a7-1c6d-43dd-ac9b-d360797cc48d None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:07.967748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330ab5b-5c84-435e-ab7d-5fea045928fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:07.968841 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330ab5b-5c84-435e-ab7d-5fea045928fd None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:07.969376 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330ab5b-5c84-435e-ab7d-5fea045928fd None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:07.969881 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330ab5b-5c84-435e-ab7d-5fea045928fd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:07.980739 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330ab5b-5c84-435e-ab7d-5fea045928fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:07.993826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-e330ab5b-5c84-435e-ab7d-5fea045928fd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 00:51:07.993826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:07.993826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:07.993826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:07.993826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:07.993826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:07.993826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:07.993826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:07.993826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:07.993826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:07.993826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:07.993826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:07.993826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:07.993826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:07.993826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:07.993826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:07.994713 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:07.994713 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:07.994713 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:07.994713 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:07.994713 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:07.994713 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:07.994713 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:07.994713 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:07.994713 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:07.994713 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:07.994713 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:07.994713 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:07.994713 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:07.994713 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:07.994713 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:07.994713 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:07.995492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:07.995492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:07.995492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:07.995492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:07.995492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:07.995492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:07.995492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:07.995492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:07.995492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:07.995492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:07.995492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 00:51:07.995492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:07.996079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055c8ae-7528-48b0-bde8-1c7b61b88b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:07.996079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055c8ae-7528-48b0-bde8-1c7b61b88b2f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:07.996079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055c8ae-7528-48b0-bde8-1c7b61b88b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:07.996079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055c8ae-7528-48b0-bde8-1c7b61b88b2f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:07.998457 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 123/239] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:08.005245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055c8ae-7528-48b0-bde8-1c7b61b88b2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:08.006765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055c8ae-7528-48b0-bde8-1c7b61b88b2f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:08.008053 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330ab5b-5c84-435e-ab7d-5fea045928fd None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:08.010310 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 117/240] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:51:08.022985 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055c8ae-7528-48b0-bde8-1c7b61b88b2f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:08.138601 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055c8ae-7528-48b0-bde8-1c7b61b88b2f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:08.175246 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc564dc-b713-4f64-9802-05ceb1de229f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:08.176097 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc564dc-b713-4f64-9802-05ceb1de229f None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:08.176540 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc564dc-b713-4f64-9802-05ceb1de229f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:08.176946 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc564dc-b713-4f64-9802-05ceb1de229f None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:08.177732 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc564dc-b713-4f64-9802-05ceb1de229f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:08.179339 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc564dc-b713-4f64-9802-05ceb1de229f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:08.212906 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 118/241] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 14 00:51:08 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:51:08.217248 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330ab5b-5c84-435e-ab7d-5fea045928fd None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:08.262901 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a937c8-f34d-482a-ba8e-71117ad3f14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:08.263532 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a937c8-f34d-482a-ba8e-71117ad3f14a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:08.263855 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a937c8-f34d-482a-ba8e-71117ad3f14a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:08.264255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a937c8-f34d-482a-ba8e-71117ad3f14a None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:08.264944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a937c8-f34d-482a-ba8e-71117ad3f14a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:08.265327 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a937c8-f34d-482a-ba8e-71117ad3f14a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:08.266971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a937c8-f34d-482a-ba8e-71117ad3f14a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:08.273920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:08.292410 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 124/242] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 14 00:51:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:51:08.298343 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc564dc-b713-4f64-9802-05ceb1de229f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:08.382248 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:08.477042 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc564dc-b713-4f64-9802-05ceb1de229f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:08.513110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591e76c-4eb3-4b32-a109-665c7140e7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:08.513747 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591e76c-4eb3-4b32-a109-665c7140e7ba None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:08.514080 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591e76c-4eb3-4b32-a109-665c7140e7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:08.514355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591e76c-4eb3-4b32-a109-665c7140e7ba None admin] PATH_INFO: `/v3/users/0e76dbb11c884442b477ef46646f5971` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:08.530415 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591e76c-4eb3-4b32-a109-665c7140e7ba None admin] RBAC: Authorizing `identity:get_user(user_id=0e76dbb11c884442b477ef46646f5971)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:08.531918 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591e76c-4eb3-4b32-a109-665c7140e7ba None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:08.533929 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 119/243] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:51:08 2022] GET /identity/v3/users/0e76dbb11c884442b477ef46646f5971 => generated 297 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:08.540571 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a937c8-f34d-482a-ba8e-71117ad3f14a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:08.672065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a937c8-f34d-482a-ba8e-71117ad3f14a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:08.710785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac676994-0e47-4e06-b4d1-5e2d16720261 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:08.711168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac676994-0e47-4e06-b4d1-5e2d16720261 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:08.711543 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac676994-0e47-4e06-b4d1-5e2d16720261 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:08.713043 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 120/244] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 00:51:08.713353 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5585ac-a739-4e5a-bb54-57de9aba9df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:08.714054 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5585ac-a739-4e5a-bb54-57de9aba9df4 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:08.714394 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5585ac-a739-4e5a-bb54-57de9aba9df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:08.714668 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5585ac-a739-4e5a-bb54-57de9aba9df4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:08.718440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4280fc9-de41-4a67-864c-ce9cec14b75d None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:08.718786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4280fc9-de41-4a67-864c-ce9cec14b75d None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:08.719034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4280fc9-de41-4a67-864c-ce9cec14b75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:08.742071 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-b4280fc9-de41-4a67-864c-ce9cec14b75d None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:08.743270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b4280fc9-de41-4a67-864c-ce9cec14b75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:08.827192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:08.832455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5585ac-a739-4e5a-bb54-57de9aba9df4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:08.833963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5585ac-a739-4e5a-bb54-57de9aba9df4 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:08.845938 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 121/245] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:08.961179 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 125/246] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:51:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:51:08.967018 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4280fc9-de41-4a67-864c-ce9cec14b75d None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:08.988188 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:09.051087 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f181b-7001-40fb-844a-001a6dd033af None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:09.051392 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f181b-7001-40fb-844a-001a6dd033af None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:09.051631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f181b-7001-40fb-844a-001a6dd033af None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:09.052965 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 126/247] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 00:51:09.059157 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e145169-6c0a-4470-b89d-eb2de231633b None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:09.059635 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e145169-6c0a-4470-b89d-eb2de231633b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:09.059807 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e145169-6c0a-4470-b89d-eb2de231633b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:09.092037 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-0e145169-6c0a-4470-b89d-eb2de231633b None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:09.093144 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-0e145169-6c0a-4470-b89d-eb2de231633b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:09.116687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4280fc9-de41-4a67-864c-ce9cec14b75d None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:09.164701 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda26ca-4947-49b0-9245-04f4d58b5669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:09.165341 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda26ca-4947-49b0-9245-04f4d58b5669 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:09.165617 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda26ca-4947-49b0-9245-04f4d58b5669 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:09.165910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda26ca-4947-49b0-9245-04f4d58b5669 None admin] PATH_INFO: `/v3/projects/3adf86e652e34928b6066fc3d75c468f` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:09.167051 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda26ca-4947-49b0-9245-04f4d58b5669 None admin] RBAC: Authorizing `identity:get_project(project_id=3adf86e652e34928b6066fc3d75c468f)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:09.168486 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda26ca-4947-49b0-9245-04f4d58b5669 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:09.170457 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 122/248] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:08 2022] GET /identity/v3/projects/3adf86e652e34928b6066fc3d75c468f => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:09.171667 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b48bba-2157-4108-8ff3-efd7658ae6fc None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:09.171947 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b48bba-2157-4108-8ff3-efd7658ae6fc None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:09.172339 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b48bba-2157-4108-8ff3-efd7658ae6fc None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:09.173563 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 123/249] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:09.178679 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b48bba-2157-4108-8ff3-efd7658ae6fc None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:09.212296 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 127/250] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 00:51:09.214382 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209381af-f1dd-4752-a9e3-fc3eaaa501c0 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:09.214853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209381af-f1dd-4752-a9e3-fc3eaaa501c0 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:09.215233 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209381af-f1dd-4752-a9e3-fc3eaaa501c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:09.247573 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-209381af-f1dd-4752-a9e3-fc3eaaa501c0 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:09.248761 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-209381af-f1dd-4752-a9e3-fc3eaaa501c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:09.305576 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:09.319279 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:09.345977 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b48bba-2157-4108-8ff3-efd7658ae6fc None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:09.367953 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 128/251] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:09.368816 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209381af-f1dd-4752-a9e3-fc3eaaa501c0 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:09.417834 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590029c-a159-4a19-a5ea-daf610c2f442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:09.418450 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590029c-a159-4a19-a5ea-daf610c2f442 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:09.418731 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590029c-a159-4a19-a5ea-daf610c2f442 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:09.419027 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590029c-a159-4a19-a5ea-daf610c2f442 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:09.420092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590029c-a159-4a19-a5ea-daf610c2f442 None admin] RBAC: Adding query filter params (role.id=79f3e2103ea3417a946a9e54a4ae30f3, scope.project.id=3adf86e652e34928b6066fc3d75c468f, user.id=0e76dbb11c884442b477ef46646f5971) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:09.420404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590029c-a159-4a19-a5ea-daf610c2f442 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:09.422673 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590029c-a159-4a19-a5ea-daf610c2f442 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:09.430097 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 124/252] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:51:09 2022] GET /identity/v3/role_assignments?user.id=0e76dbb11c884442b477ef46646f5971&scope.project.id=3adf86e652e34928b6066fc3d75c468f&role.id=79f3e2103ea3417a946a9e54a4ae30f3 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:09.552708 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590029c-a159-4a19-a5ea-daf610c2f442 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:09.576249 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209381af-f1dd-4752-a9e3-fc3eaaa501c0 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:09.666091 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9450031-bfca-40c3-8df6-4590df91d2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:09.666656 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9450031-bfca-40c3-8df6-4590df91d2f3 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:09.666931 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9450031-bfca-40c3-8df6-4590df91d2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:09.667199 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9450031-bfca-40c3-8df6-4590df91d2f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:09.681105 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590029c-a159-4a19-a5ea-daf610c2f442 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:09.693158 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9450031-bfca-40c3-8df6-4590df91d2f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:09.698146 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-e9450031-bfca-40c3-8df6-4590df91d2f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:51:09.698146 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:09.698146 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:09.698146 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:09.698146 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:09.698146 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:09.698146 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:09.698146 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:09.698146 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:09.698146 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:09.698146 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:09.698146 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:09.698146 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:09.698146 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:09.698146 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:09.698146 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:09.699042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:09.699042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:09.699042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:09.699042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:09.699042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:09.699042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:09.699042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:09.699042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:09.699042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:09.699042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:09.699042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:09.699042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:09.699042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:09.699042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:09.699042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:09.699042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:09.699812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:09.699812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:09.699812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:09.699812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:09.699812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:09.699812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:09.699812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:09.699812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:09.699812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:09.699812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:09.699812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:51:09.699812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:09.699812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 129/253] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:09.716151 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9450031-bfca-40c3-8df6-4590df91d2f3 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:09.730111 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac1b39-b863-42f3-8a36-5c4567d28223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:09.730816 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac1b39-b863-42f3-8a36-5c4567d28223 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:09.731102 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac1b39-b863-42f3-8a36-5c4567d28223 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:09.731376 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac1b39-b863-42f3-8a36-5c4567d28223 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:09.745153 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac1b39-b863-42f3-8a36-5c4567d28223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:09.752118 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-cbac1b39-b863-42f3-8a36-5c4567d28223 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:51:09.752118 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:09.752118 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:09.752118 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:09.752118 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:09.752118 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:09.752118 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:09.752118 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:09.752118 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:09.752118 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:09.752118 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:09.752118 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:09.752118 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:09.752118 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:09.752118 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:09.752118 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:09.753765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:09.753765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:09.753765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:09.753765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:09.753765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:09.753765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:09.753765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:09.753765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:09.753765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:09.753765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:09.753765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:09.753765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:09.753765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:09.753765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:09.753765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:09.753765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:09.754669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:09.754669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:09.754669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:09.754669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:09.754669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:09.754669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:09.754669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:09.754669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:09.754669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:09.754669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:09.754669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:51:09.754669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:09.754669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 125/254] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:51:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:51:09.760078 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac1b39-b863-42f3-8a36-5c4567d28223 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:09.763683 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:09.783302 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:09.882411 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac1b39-b863-42f3-8a36-5c4567d28223 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:09.935579 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdbad0-ed48-4abc-ad66-5bd622d54b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:09.936116 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdbad0-ed48-4abc-ad66-5bd622d54b2f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:09.936399 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdbad0-ed48-4abc-ad66-5bd622d54b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:09.936675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdbad0-ed48-4abc-ad66-5bd622d54b2f None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:09.937353 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fdbad0-ed48-4abc-ad66-5bd622d54b2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:09.937657 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fdbad0-ed48-4abc-ad66-5bd622d54b2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:09.939220 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fdbad0-ed48-4abc-ad66-5bd622d54b2f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:09.948969 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 126/255] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:51:09.949666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdbad0-ed48-4abc-ad66-5bd622d54b2f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:09.971248 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9450031-bfca-40c3-8df6-4590df91d2f3 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:10.024485 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:10.065883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdbad0-ed48-4abc-ad66-5bd622d54b2f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:10.095134 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd6ce2-a460-4fcb-8f79-fded8b5d5246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:10.095751 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd6ce2-a460-4fcb-8f79-fded8b5d5246 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:10.096029 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd6ce2-a460-4fcb-8f79-fded8b5d5246 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:10.096291 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd6ce2-a460-4fcb-8f79-fded8b5d5246 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:10.096953 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd6ce2-a460-4fcb-8f79-fded8b5d5246 None admin] RBAC: Adding query filter params (name=member) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:10.097351 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd6ce2-a460-4fcb-8f79-fded8b5d5246 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:10.101856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd6ce2-a460-4fcb-8f79-fded8b5d5246 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:10.107020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62286bc7-3d4f-435b-8da6-57d31a81d249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:10.107662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62286bc7-3d4f-435b-8da6-57d31a81d249 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:10.107940 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62286bc7-3d4f-435b-8da6-57d31a81d249 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:10.108207 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62286bc7-3d4f-435b-8da6-57d31a81d249 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:10.115621 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 130/256] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 14 00:51:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:51:10.116520 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd6ce2-a460-4fcb-8f79-fded8b5d5246 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:10.119155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62286bc7-3d4f-435b-8da6-57d31a81d249 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:10.124607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-62286bc7-3d4f-435b-8da6-57d31a81d249 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 00:51:10.124607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:10.124607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:10.124607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:10.124607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:10.124607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:10.124607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:10.124607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:10.124607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:10.124607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:10.124607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:10.124607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:10.124607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:10.124607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:10.124607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:10.124607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:10.125533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:10.125533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:10.125533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:10.125533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:10.125533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:10.125533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:10.125533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:10.125533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:10.125533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:10.125533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:10.125533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:10.125533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:10.125533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:10.125533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:10.125533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:10.125533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:10.126372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:10.126372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:10.126372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:10.126372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:10.126372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:10.126372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:10.126372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:10.126372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:10.126372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:10.126372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:10.126372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 00:51:10.126372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:10.126372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 127/257] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 14 00:51:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:10.127041 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62286bc7-3d4f-435b-8da6-57d31a81d249 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:10.285063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:10.300517 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62286bc7-3d4f-435b-8da6-57d31a81d249 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:10.321184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd6ce2-a460-4fcb-8f79-fded8b5d5246 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:10.345813 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:10.363989 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58eca0a-85b8-4f73-ab09-edb8af991455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:10.364791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58eca0a-85b8-4f73-ab09-edb8af991455 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:10.365071 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58eca0a-85b8-4f73-ab09-edb8af991455 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:10.365393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58eca0a-85b8-4f73-ab09-edb8af991455 None admin] PATH_INFO: `/v3/users/005a226332ca467dbc4f57028ac66eb7` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:10.366632 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58eca0a-85b8-4f73-ab09-edb8af991455 None admin] RBAC: Authorizing `identity:get_user(user_id=005a226332ca467dbc4f57028ac66eb7)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:10.368088 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58eca0a-85b8-4f73-ab09-edb8af991455 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:10.369755 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 128/258] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:51:10 2022] GET /identity/v3/users/005a226332ca467dbc4f57028ac66eb7 => generated 297 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:10.370544 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58eca0a-85b8-4f73-ab09-edb8af991455 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:10.411086 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f1bf3-0fe8-42f5-bcd7-040e45abf742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:10.411727 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f1bf3-0fe8-42f5-bcd7-040e45abf742 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:10.412002 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f1bf3-0fe8-42f5-bcd7-040e45abf742 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:10.412268 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f1bf3-0fe8-42f5-bcd7-040e45abf742 None admin] PATH_INFO: `/v3/users/a6b8fb2339ce4f02a0a987fe06894b2a` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:10.414528 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f1bf3-0fe8-42f5-bcd7-040e45abf742 None admin] RBAC: Authorizing `identity:get_user(user_id=a6b8fb2339ce4f02a0a987fe06894b2a)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:10.417629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f1bf3-0fe8-42f5-bcd7-040e45abf742 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:10.419318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 131/259] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:51:10 2022] GET /identity/v3/users/a6b8fb2339ce4f02a0a987fe06894b2a => generated 283 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:10.421293 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f1bf3-0fe8-42f5-bcd7-040e45abf742 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:10.525774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58eca0a-85b8-4f73-ab09-edb8af991455 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:10.553855 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f1bf3-0fe8-42f5-bcd7-040e45abf742 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:10.593770 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3243e-30a5-4e9e-b124-085c70a13974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:10.595283 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3243e-30a5-4e9e-b124-085c70a13974 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:10.595987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3243e-30a5-4e9e-b124-085c70a13974 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:10.596095 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3243e-30a5-4e9e-b124-085c70a13974 None admin] PATH_INFO: `/v3/projects/3adf86e652e34928b6066fc3d75c468f` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:10.597891 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3243e-30a5-4e9e-b124-085c70a13974 None admin] RBAC: Authorizing `identity:get_project(project_id=3adf86e652e34928b6066fc3d75c468f)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:10.600415 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3243e-30a5-4e9e-b124-085c70a13974 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:10.603837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 132/260] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:10 2022] GET /identity/v3/projects/3adf86e652e34928b6066fc3d75c468f => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:10.604338 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b4734-e501-4b6e-8264-7e8435fcc204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:10.604991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3243e-30a5-4e9e-b124-085c70a13974 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:10.605387 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b4734-e501-4b6e-8264-7e8435fcc204 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:10.605901 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b4734-e501-4b6e-8264-7e8435fcc204 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:10.606369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b4734-e501-4b6e-8264-7e8435fcc204 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:10.607244 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b4734-e501-4b6e-8264-7e8435fcc204 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:10.607741 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b4734-e501-4b6e-8264-7e8435fcc204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:10.609310 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b4734-e501-4b6e-8264-7e8435fcc204 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:10.644009 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 129/261] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:51:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:10.644884 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b4734-e501-4b6e-8264-7e8435fcc204 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:10.646181 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:10.726446 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3243e-30a5-4e9e-b124-085c70a13974 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:10.748796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:10.759930 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87bef7f-fe1f-4238-acfd-13df6b47b94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:10.760581 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bef7f-fe1f-4238-acfd-13df6b47b94c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:10.760858 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bef7f-fe1f-4238-acfd-13df6b47b94c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:10.761170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bef7f-fe1f-4238-acfd-13df6b47b94c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:10.830815 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87bef7f-fe1f-4238-acfd-13df6b47b94c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:10.832253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87bef7f-fe1f-4238-acfd-13df6b47b94c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:10.832368 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b4734-e501-4b6e-8264-7e8435fcc204 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:10.852844 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:10.881362 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e9852-e620-42f6-b416-11af82eb8703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:10.882048 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e9852-e620-42f6-b416-11af82eb8703 None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:10.882337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e9852-e620-42f6-b416-11af82eb8703 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:10.882607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e9852-e620-42f6-b416-11af82eb8703 None admin] PATH_INFO: `/v3/projects/3adf86e652e34928b6066fc3d75c468f/users/005a226332ca467dbc4f57028ac66eb7/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:10.884534 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e9852-e620-42f6-b416-11af82eb8703 None admin] RBAC: Authorizing `identity:create_grant(project_id=3adf86e652e34928b6066fc3d75c468f, user_id=005a226332ca467dbc4f57028ac66eb7, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:10.886011 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e9852-e620-42f6-b416-11af82eb8703 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:10.910515 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 130/262] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 14 00:51:10 2022] PUT /identity/v3/projects/3adf86e652e34928b6066fc3d75c468f/users/005a226332ca467dbc4f57028ac66eb7/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 00:51:10.913887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e9852-e620-42f6-b416-11af82eb8703 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:10.963521 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 133/263] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:51:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:51:10.964607 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87bef7f-fe1f-4238-acfd-13df6b47b94c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:11.097156 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87bef7f-fe1f-4238-acfd-13df6b47b94c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:11.116178 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:11.134685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908904e2-6834-407f-86a0-17227ece87e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:11.135431 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908904e2-6834-407f-86a0-17227ece87e2 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:11.135782 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908904e2-6834-407f-86a0-17227ece87e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:11.136132 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908904e2-6834-407f-86a0-17227ece87e2 None admin] PATH_INFO: `/v3/projects/3adf86e652e34928b6066fc3d75c468f` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:11.137332 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908904e2-6834-407f-86a0-17227ece87e2 None admin] RBAC: Authorizing `identity:get_project(project_id=3adf86e652e34928b6066fc3d75c468f)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:11.138667 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e9852-e620-42f6-b416-11af82eb8703 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:11.138960 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908904e2-6834-407f-86a0-17227ece87e2 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:11.140667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 134/264] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:10 2022] GET /identity/v3/projects/3adf86e652e34928b6066fc3d75c468f => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:11.146790 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908904e2-6834-407f-86a0-17227ece87e2 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:11.167448 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:11.231145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8c69b-32de-4804-a103-b9efa99e7548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:11.231831 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8c69b-32de-4804-a103-b9efa99e7548 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:11.232111 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8c69b-32de-4804-a103-b9efa99e7548 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:11.232380 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8c69b-32de-4804-a103-b9efa99e7548 None admin] PATH_INFO: `/v3/users/a6b8fb2339ce4f02a0a987fe06894b2a` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:11.233607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8c69b-32de-4804-a103-b9efa99e7548 None admin] RBAC: Authorizing `identity:get_user(user_id=a6b8fb2339ce4f02a0a987fe06894b2a)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:11.235244 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8c69b-32de-4804-a103-b9efa99e7548 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:11.237077 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 131/265] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:51:10 2022] GET /identity/v3/users/a6b8fb2339ce4f02a0a987fe06894b2a => generated 283 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:11.242758 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8c69b-32de-4804-a103-b9efa99e7548 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:11.255312 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908904e2-6834-407f-86a0-17227ece87e2 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:11.300390 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f021770-ceca-4b38-9c6b-ffb700b92929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:11.301281 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f021770-ceca-4b38-9c6b-ffb700b92929 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:11.301702 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f021770-ceca-4b38-9c6b-ffb700b92929 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:11.302140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f021770-ceca-4b38-9c6b-ffb700b92929 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:11.303286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f021770-ceca-4b38-9c6b-ffb700b92929 None admin] RBAC: Adding query filter params (role.id=0d7a36bda723430eae02f10f4c775c96, scope.project.id=3adf86e652e34928b6066fc3d75c468f, user.id=a6b8fb2339ce4f02a0a987fe06894b2a) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:11.303759 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f021770-ceca-4b38-9c6b-ffb700b92929 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:11.307529 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f021770-ceca-4b38-9c6b-ffb700b92929 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:11.322754 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 135/266] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:51:11 2022] GET /identity/v3/role_assignments?user.id=a6b8fb2339ce4f02a0a987fe06894b2a&scope.project.id=3adf86e652e34928b6066fc3d75c468f&role.id=0d7a36bda723430eae02f10f4c775c96 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:51:11.393546 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8c69b-32de-4804-a103-b9efa99e7548 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:11.437508 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2f209-82b7-4f51-be65-852ba81149a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:11.438495 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2f209-82b7-4f51-be65-852ba81149a6 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:11.438916 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2f209-82b7-4f51-be65-852ba81149a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:11.439319 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2f209-82b7-4f51-be65-852ba81149a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:11.510812 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:11.532887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2f209-82b7-4f51-be65-852ba81149a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:11.534695 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2f209-82b7-4f51-be65-852ba81149a6 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:11.651601 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 132/267] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:51:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:51:11.658978 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f021770-ceca-4b38-9c6b-ffb700b92929 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:11.721878 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db43be-fca5-47f3-b656-2c7cc6d14ec2 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:11.722385 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db43be-fca5-47f3-b656-2c7cc6d14ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:11.722876 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db43be-fca5-47f3-b656-2c7cc6d14ec2 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:11.724574 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 133/268] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:11.732157 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5d1e7-73f7-4981-804a-5a139a23c90e None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:11.732540 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5d1e7-73f7-4981-804a-5a139a23c90e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:11.733006 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:11.734042 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5d1e7-73f7-4981-804a-5a139a23c90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:11.758951 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-64b5d1e7-73f7-4981-804a-5a139a23c90e None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:11.760292 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-64b5d1e7-73f7-4981-804a-5a139a23c90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:11.789740 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f021770-ceca-4b38-9c6b-ffb700b92929 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:11.827690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069437f-425e-4114-9d8e-f27c1657728a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:11.829419 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069437f-425e-4114-9d8e-f27c1657728a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:11.829902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069437f-425e-4114-9d8e-f27c1657728a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:11.830315 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069437f-425e-4114-9d8e-f27c1657728a None admin] PATH_INFO: `/v3/projects/3adf86e652e34928b6066fc3d75c468f` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:11.831595 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069437f-425e-4114-9d8e-f27c1657728a None admin] RBAC: Authorizing `identity:get_project(project_id=3adf86e652e34928b6066fc3d75c468f)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:11.833201 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069437f-425e-4114-9d8e-f27c1657728a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:11.835000 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 136/269] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:11 2022] GET /identity/v3/projects/3adf86e652e34928b6066fc3d75c468f => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:11.836363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6379c12-7f8b-42e2-8776-0cfe925fae5a None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:11.836823 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6379c12-7f8b-42e2-8776-0cfe925fae5a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:11.837269 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6379c12-7f8b-42e2-8776-0cfe925fae5a None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:11.838928 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 137/270] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:11.841254 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6379c12-7f8b-42e2-8776-0cfe925fae5a None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:11.857656 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 134/271] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 00:51:11.860146 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a31222-18e1-4475-86bc-763824125d65 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:11.860496 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a31222-18e1-4475-86bc-763824125d65 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:11.860758 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a31222-18e1-4475-86bc-763824125d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:11.882016 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-69a31222-18e1-4475-86bc-763824125d65 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:11.883444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-69a31222-18e1-4475-86bc-763824125d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:11.893202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:11.963533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6379c12-7f8b-42e2-8776-0cfe925fae5a None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:11.969877 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 135/272] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:11.985245 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:12.004992 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896bc33-291d-4582-b498-a8c3f901e59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:12.005854 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896bc33-291d-4582-b498-a8c3f901e59b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:12.006311 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896bc33-291d-4582-b498-a8c3f901e59b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:12.006756 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896bc33-291d-4582-b498-a8c3f901e59b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:12.007650 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896bc33-291d-4582-b498-a8c3f901e59b None admin] RBAC: Adding query filter params (role.id=8373a23ee4ff4c7d94e82480d85b586b, scope.project.id=3adf86e652e34928b6066fc3d75c468f, user.id=a6b8fb2339ce4f02a0a987fe06894b2a) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:12.008132 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896bc33-291d-4582-b498-a8c3f901e59b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:12.009750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896bc33-291d-4582-b498-a8c3f901e59b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:12.016523 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 138/273] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:51:11 2022] GET /identity/v3/role_assignments?user.id=a6b8fb2339ce4f02a0a987fe06894b2a&scope.project.id=3adf86e652e34928b6066fc3d75c468f&role.id=8373a23ee4ff4c7d94e82480d85b586b => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:12.263781 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a31222-18e1-4475-86bc-763824125d65 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:12.285086 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896bc33-291d-4582-b498-a8c3f901e59b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:12.398179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a31222-18e1-4475-86bc-763824125d65 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:12.412441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896bc33-291d-4582-b498-a8c3f901e59b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:12.439402 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808aefea-31bc-41ed-ba7c-1eaec2ca8575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:12.440033 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808aefea-31bc-41ed-ba7c-1eaec2ca8575 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:12.440312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808aefea-31bc-41ed-ba7c-1eaec2ca8575 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:12.440583 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808aefea-31bc-41ed-ba7c-1eaec2ca8575 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:12.441951 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808aefea-31bc-41ed-ba7c-1eaec2ca8575 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:12.443198 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808aefea-31bc-41ed-ba7c-1eaec2ca8575 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:12.445042 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 136/274] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:12.446336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42ab4f-2b4f-4726-bf59-3519b03d4917 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:12.446609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72cd5a-25d5-4491-b8ec-838399acda2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:12.446736 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42ab4f-2b4f-4726-bf59-3519b03d4917 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:12.446891 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42ab4f-2b4f-4726-bf59-3519b03d4917 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:12.447235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72cd5a-25d5-4491-b8ec-838399acda2d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:12.447509 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72cd5a-25d5-4491-b8ec-838399acda2d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:12.447775 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72cd5a-25d5-4491-b8ec-838399acda2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:12.448238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 137/275] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:12.451018 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42ab4f-2b4f-4726-bf59-3519b03d4917 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:12.459022 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72cd5a-25d5-4491-b8ec-838399acda2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:12.464144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:12.465795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-5f72cd5a-25d5-4491-b8ec-838399acda2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:51:12.465795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:12.465795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:12.465795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:12.465795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:12.465795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:12.465795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:12.465795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:12.465795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:12.465795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:12.465795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:12.465795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:12.465795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:12.465795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:12.465795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:12.465795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:12.466682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:12.466682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:12.466682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:12.466682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:12.466682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:12.466682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:12.466682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:12.466682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:12.466682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:12.466682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:12.466682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:12.466682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:12.466682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:12.466682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:12.466682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:12.466682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:12.467539 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:12.467539 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:12.467539 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:12.467539 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:12.467539 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:12.467539 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:12.467539 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:12.467539 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:12.467539 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:12.467539 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:12.467539 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:51:12.467539 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:12.467539 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 139/276] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:12.468696 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b3ba2-f29a-4840-930a-b44446550e90 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:12.468696 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b3ba2-f29a-4840-930a-b44446550e90 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:12.468820 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b3ba2-f29a-4840-930a-b44446550e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:12.487429 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-761b3ba2-f29a-4840-930a-b44446550e90 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:12.488598 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-761b3ba2-f29a-4840-930a-b44446550e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:12.525951 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:12.563676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 140/277] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:12.574048 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b3ba2-f29a-4840-930a-b44446550e90 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:12.575882 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42ab4f-2b4f-4726-bf59-3519b03d4917 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:12.618741 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d3b12-fcfd-4958-af31-3092ff198668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:12.619341 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d3b12-fcfd-4958-af31-3092ff198668 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:12.619618 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d3b12-fcfd-4958-af31-3092ff198668 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:12.619994 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d3b12-fcfd-4958-af31-3092ff198668 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:12.620742 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d3b12-fcfd-4958-af31-3092ff198668 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:12.622254 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d3b12-fcfd-4958-af31-3092ff198668 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:12.649433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 138/278] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 14 00:51:12 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:51:12.686144 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b3ba2-f29a-4840-930a-b44446550e90 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:12.725717 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df12e1-857a-4cbd-b18f-a96260349415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:12.726489 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df12e1-857a-4cbd-b18f-a96260349415 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:12.726767 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df12e1-857a-4cbd-b18f-a96260349415 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:12.727036 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df12e1-857a-4cbd-b18f-a96260349415 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:12.727712 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df12e1-857a-4cbd-b18f-a96260349415 None admin] RBAC: Adding query filter params (name=member) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:12.728063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df12e1-857a-4cbd-b18f-a96260349415 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:12.729521 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df12e1-857a-4cbd-b18f-a96260349415 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:12.739580 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 141/279] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 14 00:51:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:12.745191 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d3b12-fcfd-4958-af31-3092ff198668 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:12.826586 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:12.842775 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df12e1-857a-4cbd-b18f-a96260349415 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:12.863597 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d3b12-fcfd-4958-af31-3092ff198668 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:12.893008 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:12.911004 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5920946-7bce-4c96-88fa-4c55ff7065d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:12.911995 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5920946-7bce-4c96-88fa-4c55ff7065d1 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:12.912473 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5920946-7bce-4c96-88fa-4c55ff7065d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:12.912942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5920946-7bce-4c96-88fa-4c55ff7065d1 None admin] PATH_INFO: `/v3/users/0bc5328aeb4e40a3babe7e33b45f62c4` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:12.928534 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5920946-7bce-4c96-88fa-4c55ff7065d1 None admin] RBAC: Authorizing `identity:get_user(user_id=0bc5328aeb4e40a3babe7e33b45f62c4)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:12.930423 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5920946-7bce-4c96-88fa-4c55ff7065d1 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:12.932413 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 139/280] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:51:12 2022] GET /identity/v3/users/0bc5328aeb4e40a3babe7e33b45f62c4 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:12.938057 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5920946-7bce-4c96-88fa-4c55ff7065d1 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:12.967231 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df12e1-857a-4cbd-b18f-a96260349415 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:13.009663 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da059c-9c79-46ee-a557-5f7042c7aee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:13.010613 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da059c-9c79-46ee-a557-5f7042c7aee2 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:13.011772 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da059c-9c79-46ee-a557-5f7042c7aee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:13.011772 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da059c-9c79-46ee-a557-5f7042c7aee2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:13.026389 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da059c-9c79-46ee-a557-5f7042c7aee2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:13.032425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-31da059c-9c79-46ee-a557-5f7042c7aee2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 00:51:13.032425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:13.032425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:13.032425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:13.032425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:13.032425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:13.032425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:13.032425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:13.032425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:13.032425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:13.032425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:13.032425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:13.032425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:13.032425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:13.032425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:13.032425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:13.033306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:13.033306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:13.033306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:13.033306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:13.033306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:13.033306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:13.033306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:13.033306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:13.033306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:13.033306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:13.033306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:13.033306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:13.033306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:13.033306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:13.033306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:13.033306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:13.034120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:13.034120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:13.034120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:13.034120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:13.034120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:13.034120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:13.034120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:13.034120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:13.034120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:13.034120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:13.034120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 00:51:13.034120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:13.036340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 142/281] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:51:13.043242 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da059c-9c79-46ee-a557-5f7042c7aee2 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:13.070997 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5920946-7bce-4c96-88fa-4c55ff7065d1 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:13.103776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:13.118033 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b75e57-ce03-47b6-b560-d621bf2dc573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:13.119400 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b75e57-ce03-47b6-b560-d621bf2dc573 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:13.119913 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b75e57-ce03-47b6-b560-d621bf2dc573 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:13.120650 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b75e57-ce03-47b6-b560-d621bf2dc573 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:13.121652 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b75e57-ce03-47b6-b560-d621bf2dc573 None admin] RBAC: Adding query filter params (role.id=ee3984f710984de6bf564de3bee00d33, user.id=0bc5328aeb4e40a3babe7e33b45f62c4, scope.system=all) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:13.122259 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b75e57-ce03-47b6-b560-d621bf2dc573 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:13.123883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b75e57-ce03-47b6-b560-d621bf2dc573 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:13.131222 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 140/282] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Sep 14 00:51:12 2022] GET /identity/v3/role_assignments?user.id=0bc5328aeb4e40a3babe7e33b45f62c4&scope.system=all&role.id=ee3984f710984de6bf564de3bee00d33 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:51:13.166042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:13.174178 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da059c-9c79-46ee-a557-5f7042c7aee2 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:13.215146 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611ceba-c345-4c6f-9d43-4e4954c75ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:13.215830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611ceba-c345-4c6f-9d43-4e4954c75ced None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:13.216110 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611ceba-c345-4c6f-9d43-4e4954c75ced None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:13.216376 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611ceba-c345-4c6f-9d43-4e4954c75ced None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:13.217096 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611ceba-c345-4c6f-9d43-4e4954c75ced None admin] RBAC: Adding query filter params (name=reader) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:13.217400 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611ceba-c345-4c6f-9d43-4e4954c75ced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:13.218883 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611ceba-c345-4c6f-9d43-4e4954c75ced None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:13.228831 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 143/283] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 14 00:51:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:13.235236 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b75e57-ce03-47b6-b560-d621bf2dc573 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:13.367302 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b75e57-ce03-47b6-b560-d621bf2dc573 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:13.409029 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70036d07-9d29-4176-b138-15c799aac1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:13.409765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70036d07-9d29-4176-b138-15c799aac1a3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:13.410089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70036d07-9d29-4176-b138-15c799aac1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:13.410295 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70036d07-9d29-4176-b138-15c799aac1a3 None admin] PATH_INFO: `/v3/users/0e76dbb11c884442b477ef46646f5971` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:13.411426 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70036d07-9d29-4176-b138-15c799aac1a3 None admin] RBAC: Authorizing `identity:get_user(user_id=0e76dbb11c884442b477ef46646f5971)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:13.412875 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70036d07-9d29-4176-b138-15c799aac1a3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:13.414809 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 141/284] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:51:13 2022] GET /identity/v3/users/0e76dbb11c884442b477ef46646f5971 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:13.423482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611ceba-c345-4c6f-9d43-4e4954c75ced None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:13.575857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611ceba-c345-4c6f-9d43-4e4954c75ced None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:13.627553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaaee74-6bad-4102-8b1d-c26576585d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:13.628118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaaee74-6bad-4102-8b1d-c26576585d58 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:13.628395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaaee74-6bad-4102-8b1d-c26576585d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:13.628664 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaaee74-6bad-4102-8b1d-c26576585d58 None admin] PATH_INFO: `/v3/projects/3adf86e652e34928b6066fc3d75c468f` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:13.629835 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaaee74-6bad-4102-8b1d-c26576585d58 None admin] RBAC: Authorizing `identity:get_project(project_id=3adf86e652e34928b6066fc3d75c468f)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:13.631284 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaaee74-6bad-4102-8b1d-c26576585d58 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:13.633068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 144/285] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:13 2022] GET /identity/v3/projects/3adf86e652e34928b6066fc3d75c468f => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:13.638785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70036d07-9d29-4176-b138-15c799aac1a3 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:13.714635 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:13.780896 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70036d07-9d29-4176-b138-15c799aac1a3 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:13.830492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba99f3-118d-4c40-ad71-36ccc95962c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:13.831159 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba99f3-118d-4c40-ad71-36ccc95962c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:13.831440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba99f3-118d-4c40-ad71-36ccc95962c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:13.831710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba99f3-118d-4c40-ad71-36ccc95962c6 None admin] PATH_INFO: `/v3/projects/3adf86e652e34928b6066fc3d75c468f/users/0e76dbb11c884442b477ef46646f5971/roles/79f3e2103ea3417a946a9e54a4ae30f3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:13.833661 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba99f3-118d-4c40-ad71-36ccc95962c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=3adf86e652e34928b6066fc3d75c468f, user_id=0e76dbb11c884442b477ef46646f5971, role_id=79f3e2103ea3417a946a9e54a4ae30f3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:13.835108 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba99f3-118d-4c40-ad71-36ccc95962c6 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:13.860692 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 142/286] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 14 00:51:13 2022] PUT /identity/v3/projects/3adf86e652e34928b6066fc3d75c468f/users/0e76dbb11c884442b477ef46646f5971/roles/79f3e2103ea3417a946a9e54a4ae30f3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 00:51:14.225651 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46175c94-4ea9-4df8-b2f3-5447ee4350ed None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:14.226043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46175c94-4ea9-4df8-b2f3-5447ee4350ed None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:14.226249 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46175c94-4ea9-4df8-b2f3-5447ee4350ed None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:14.227771 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 145/287] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:14.234484 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34d09e-53da-42a2-9bf2-7c70a071d877 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:14.234801 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34d09e-53da-42a2-9bf2-7c70a071d877 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:14.235080 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34d09e-53da-42a2-9bf2-7c70a071d877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:14.257272 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-2c34d09e-53da-42a2-9bf2-7c70a071d877 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:14.258454 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2c34d09e-53da-42a2-9bf2-7c70a071d877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:14.334048 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 143/288] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:14.677690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46175c94-4ea9-4df8-b2f3-5447ee4350ed None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:14.713287 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:14.816558 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46175c94-4ea9-4df8-b2f3-5447ee4350ed None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:14.856963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9a18a-1c77-4cfe-aa23-2ff4c945808e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:14.857932 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9a18a-1c77-4cfe-aa23-2ff4c945808e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:14.858477 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9a18a-1c77-4cfe-aa23-2ff4c945808e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:14.858934 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9a18a-1c77-4cfe-aa23-2ff4c945808e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:14.869616 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9a18a-1c77-4cfe-aa23-2ff4c945808e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:14.875849 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-6ff9a18a-1c77-4cfe-aa23-2ff4c945808e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:51:14.875849 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:14.875849 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:14.875849 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:14.875849 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:14.875849 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:14.875849 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:14.875849 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:14.875849 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:14.875849 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:14.875849 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:14.875849 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:14.875849 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:14.875849 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:14.875849 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:14.875849 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:14.876688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:14.876688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:14.876688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:14.876688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:14.876688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:14.876688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:14.876688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:14.876688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:14.876688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:14.876688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:14.876688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:14.876688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:14.876688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:14.876688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:14.876688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:14.876688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:14.877554 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:14.877554 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:14.877554 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:14.877554 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:14.877554 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:14.877554 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:14.877554 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:14.877554 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:14.877554 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:14.877554 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:14.877554 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:51:14.877554 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:14.880168 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 146/289] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:14.885569 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34d09e-53da-42a2-9bf2-7c70a071d877 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:14.964737 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:15.026553 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34d09e-53da-42a2-9bf2-7c70a071d877 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:15.068361 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3336431-a359-454c-bd4e-198f7cc489b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:15.068974 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3336431-a359-454c-bd4e-198f7cc489b3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:15.069251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3336431-a359-454c-bd4e-198f7cc489b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:15.069522 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3336431-a359-454c-bd4e-198f7cc489b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:15.070219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3336431-a359-454c-bd4e-198f7cc489b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:15.070518 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3336431-a359-454c-bd4e-198f7cc489b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:15.071878 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3336431-a359-454c-bd4e-198f7cc489b3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:15.086161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 144/290] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 14 00:51:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:15.087309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9a18a-1c77-4cfe-aa23-2ff4c945808e None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:15.213384 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:15.232180 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9a18a-1c77-4cfe-aa23-2ff4c945808e None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:15.278701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafca177-9fda-43c8-bf80-de61c5a5937e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:15.279588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafca177-9fda-43c8-bf80-de61c5a5937e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:15.279871 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafca177-9fda-43c8-bf80-de61c5a5937e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:15.280140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafca177-9fda-43c8-bf80-de61c5a5937e None admin] PATH_INFO: `/v3/users/005a226332ca467dbc4f57028ac66eb7` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:15.281313 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafca177-9fda-43c8-bf80-de61c5a5937e None admin] RBAC: Authorizing `identity:get_user(user_id=005a226332ca467dbc4f57028ac66eb7)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:15.282806 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafca177-9fda-43c8-bf80-de61c5a5937e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:15.284708 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 147/291] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:51:15 2022] GET /identity/v3/users/005a226332ca467dbc4f57028ac66eb7 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:15.289838 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3336431-a359-454c-bd4e-198f7cc489b3 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:15.454084 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3336431-a359-454c-bd4e-198f7cc489b3 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:15.454772 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0446c-d51a-4708-b30f-4a82f380701a None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:15.455058 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0446c-d51a-4708-b30f-4a82f380701a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:15.455335 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0446c-d51a-4708-b30f-4a82f380701a None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:15.456673 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 148/292] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:15.463475 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:15.467116 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39cb3c-f401-4f0b-844a-3b48c43e3dd2 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:15.467622 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39cb3c-f401-4f0b-844a-3b48c43e3dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:15.468085 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39cb3c-f401-4f0b-844a-3b48c43e3dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:15.493865 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18547450-e5f1-4b74-8f0b-916ee5a3b510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:15.494407 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18547450-e5f1-4b74-8f0b-916ee5a3b510 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:15.494688 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18547450-e5f1-4b74-8f0b-916ee5a3b510 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:15.494964 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18547450-e5f1-4b74-8f0b-916ee5a3b510 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:15.509887 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-8d39cb3c-f401-4f0b-844a-3b48c43e3dd2 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:15.511379 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8d39cb3c-f401-4f0b-844a-3b48c43e3dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:15.571847 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18547450-e5f1-4b74-8f0b-916ee5a3b510 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:15.573827 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18547450-e5f1-4b74-8f0b-916ee5a3b510 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:15.658881 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 149/293] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:15.700345 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 145/294] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:51:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:51:15.706984 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39cb3c-f401-4f0b-844a-3b48c43e3dd2 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:15.718066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb5581-8bff-45dc-9e20-1c76fd8de9db None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:15.718434 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb5581-8bff-45dc-9e20-1c76fd8de9db None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:15.718657 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb5581-8bff-45dc-9e20-1c76fd8de9db None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:15.720672 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 146/295] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:15 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:15.727660 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0085f6-2ce9-4c3f-8612-3e8a58e3846e None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:15.728486 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0085f6-2ce9-4c3f-8612-3e8a58e3846e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:15.728794 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0085f6-2ce9-4c3f-8612-3e8a58e3846e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:15.762728 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-0e0085f6-2ce9-4c3f-8612-3e8a58e3846e None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:15.763858 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0e0085f6-2ce9-4c3f-8612-3e8a58e3846e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:15.766576 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:15.856231 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:15.874031 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 147/296] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:15.877236 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc708a31-14a3-4ec9-9dd1-c0e57af95f08 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:15.877746 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc708a31-14a3-4ec9-9dd1-c0e57af95f08 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:15.878212 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc708a31-14a3-4ec9-9dd1-c0e57af95f08 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:15.879044 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39cb3c-f401-4f0b-844a-3b48c43e3dd2 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:15.879722 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 148/297] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:15.884929 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b8415-5294-4483-8802-1da2f5494df4 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:15.885391 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b8415-5294-4483-8802-1da2f5494df4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:15.885830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b8415-5294-4483-8802-1da2f5494df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:15.919946 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ca7b8415-5294-4483-8802-1da2f5494df4 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:15.921704 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ca7b8415-5294-4483-8802-1da2f5494df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:15.942328 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7670c81-a669-4506-aacd-d7ec3cce843d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:15.943144 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7670c81-a669-4506-aacd-d7ec3cce843d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:15.943423 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7670c81-a669-4506-aacd-d7ec3cce843d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:15.943758 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7670c81-a669-4506-aacd-d7ec3cce843d None admin] PATH_INFO: `/v3/projects/3adf86e652e34928b6066fc3d75c468f` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:15.946647 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7670c81-a669-4506-aacd-d7ec3cce843d None admin] RBAC: Authorizing `identity:get_project(project_id=3adf86e652e34928b6066fc3d75c468f)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:15.948171 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7670c81-a669-4506-aacd-d7ec3cce843d None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:15.952295 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 150/298] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:15 2022] GET /identity/v3/projects/3adf86e652e34928b6066fc3d75c468f => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:15.959272 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7670c81-a669-4506-aacd-d7ec3cce843d None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:16.023180 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 149/299] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 00:51:16.024183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b8415-5294-4483-8802-1da2f5494df4 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:16.100428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:16.126959 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7670c81-a669-4506-aacd-d7ec3cce843d None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:16.138494 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b8415-5294-4483-8802-1da2f5494df4 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:16.176456 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b22b24-986b-485a-8fde-98f0af094db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:16.177287 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b22b24-986b-485a-8fde-98f0af094db8 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:16.177659 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b22b24-986b-485a-8fde-98f0af094db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:16.178101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b22b24-986b-485a-8fde-98f0af094db8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:16.188910 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964ad41-43be-4c1b-8d58-24418cb75d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:16.189519 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964ad41-43be-4c1b-8d58-24418cb75d9d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:16.190070 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964ad41-43be-4c1b-8d58-24418cb75d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:16.190348 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964ad41-43be-4c1b-8d58-24418cb75d9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:16.191081 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964ad41-43be-4c1b-8d58-24418cb75d9d None admin] RBAC: Adding query filter params (role.id=ee3984f710984de6bf564de3bee00d33, scope.project.id=3adf86e652e34928b6066fc3d75c468f, user.id=005a226332ca467dbc4f57028ac66eb7) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:16.191383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964ad41-43be-4c1b-8d58-24418cb75d9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:16.192811 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964ad41-43be-4c1b-8d58-24418cb75d9d None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:16.199406 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 151/300] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:51:15 2022] GET /identity/v3/role_assignments?user.id=005a226332ca467dbc4f57028ac66eb7&scope.project.id=3adf86e652e34928b6066fc3d75c468f&role.id=ee3984f710984de6bf564de3bee00d33 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:51:16.209470 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b22b24-986b-485a-8fde-98f0af094db8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:16.214705 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-b7b22b24-986b-485a-8fde-98f0af094db8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 00:51:16.214705 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:16.214705 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:16.214705 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:16.214705 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:16.214705 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:16.214705 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:16.214705 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:16.214705 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:16.214705 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:16.214705 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:16.214705 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:16.214705 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:16.214705 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:16.214705 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:16.214705 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:16.216790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:16.216790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:16.216790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:16.216790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:16.216790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:16.216790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:16.216790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:16.216790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:16.216790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:16.216790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:16.216790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:16.216790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:16.216790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:16.216790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:16.216790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:16.216790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:16.218911 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:16.218911 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:16.218911 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:16.218911 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:16.218911 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:16.218911 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:16.218911 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:16.218911 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:16.218911 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:16.218911 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:16.218911 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 00:51:16.218911 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:16.218911 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 150/301] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:16.223639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964ad41-43be-4c1b-8d58-24418cb75d9d None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:16.255613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b22b24-986b-485a-8fde-98f0af094db8 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:16.260059 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:16.422791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b22b24-986b-485a-8fde-98f0af094db8 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:16.431100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964ad41-43be-4c1b-8d58-24418cb75d9d None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:16.461154 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:16.472642 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd92cca-d197-4bfa-b583-c14cea63297a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:16.473282 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd92cca-d197-4bfa-b583-c14cea63297a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:16.473557 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd92cca-d197-4bfa-b583-c14cea63297a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:16.473842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd92cca-d197-4bfa-b583-c14cea63297a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:16.475091 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd92cca-d197-4bfa-b583-c14cea63297a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:16.475518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345e53e-7ecf-482f-940e-faef2896b72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:16.476113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345e53e-7ecf-482f-940e-faef2896b72c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:16.476386 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345e53e-7ecf-482f-940e-faef2896b72c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:16.476559 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd92cca-d197-4bfa-b583-c14cea63297a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:16.476763 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345e53e-7ecf-482f-940e-faef2896b72c None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:16.477480 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2345e53e-7ecf-482f-940e-faef2896b72c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:16.477786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2345e53e-7ecf-482f-940e-faef2896b72c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:16.479213 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2345e53e-7ecf-482f-940e-faef2896b72c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:16.481946 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 151/302] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:16.482995 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd92cca-d197-4bfa-b583-c14cea63297a None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:16.493018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 152/303] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 14 00:51:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:16.494238 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345e53e-7ecf-482f-940e-faef2896b72c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:16.595427 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:16.604706 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd92cca-d197-4bfa-b583-c14cea63297a None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:16.620436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345e53e-7ecf-482f-940e-faef2896b72c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:16.642932 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546c4b9-647c-4b99-ae0b-508511bc6164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:16.643562 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546c4b9-647c-4b99-ae0b-508511bc6164 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:16.643988 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546c4b9-647c-4b99-ae0b-508511bc6164 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:16.644264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546c4b9-647c-4b99-ae0b-508511bc6164 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:16.654946 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546c4b9-647c-4b99-ae0b-508511bc6164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:16.658958 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87f895-0e2a-4b83-815b-9db709c37377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:16.659558 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87f895-0e2a-4b83-815b-9db709c37377 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:16.659833 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87f895-0e2a-4b83-815b-9db709c37377 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:16.660097 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87f895-0e2a-4b83-815b-9db709c37377 None admin] PATH_INFO: `/v3/groups` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:16.660251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-a546c4b9-647c-4b99-ae0b-508511bc6164 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:51:16.660251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:16.660251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:16.660251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:16.660251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:16.660251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:16.660251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:16.660251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:16.660251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:16.660251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:16.660251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:16.660251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:16.660251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:16.660251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:16.660251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:16.660251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:16.661178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:16.661178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:16.661178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:16.661178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:16.661178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:16.661178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:16.661178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:16.661178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:16.661178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:16.661178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:16.661178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:16.661178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:16.661178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:16.661178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:16.661178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:16.661178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:16.666687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:16.666687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:16.666687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:16.666687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:16.666687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:16.666687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:16.666687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:16.666687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:16.666687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:16.666687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:16.666687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:51:16.666687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:16.667288 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87f895-0e2a-4b83-815b-9db709c37377 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:16.667359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 152/304] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:16.667359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546c4b9-647c-4b99-ae0b-508511bc6164 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:16.667473 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87f895-0e2a-4b83-815b-9db709c37377 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:16.685731 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 153/305] 10.222.0.20 () {60 vars in 1134 bytes} [Wed Sep 14 00:51:16 2022] POST /identity/v3/groups => generated 229 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:51:16.686704 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87f895-0e2a-4b83-815b-9db709c37377 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:16.766677 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:16.816033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87f895-0e2a-4b83-815b-9db709c37377 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:16.829945 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546c4b9-647c-4b99-ae0b-508511bc6164 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:16.858046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364148c-6bb0-4f3f-848e-d14ebff61fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:16.858679 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364148c-6bb0-4f3f-848e-d14ebff61fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:16.858959 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364148c-6bb0-4f3f-848e-d14ebff61fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:16.859235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364148c-6bb0-4f3f-848e-d14ebff61fd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:16.860445 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364148c-6bb0-4f3f-848e-d14ebff61fd0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:16.860748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364148c-6bb0-4f3f-848e-d14ebff61fd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:16.862191 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364148c-6bb0-4f3f-848e-d14ebff61fd0 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:16.865156 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:16.868461 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae5ab0-b9d5-4f2d-aa2d-f702a0e95e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:16.869101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae5ab0-b9d5-4f2d-aa2d-f702a0e95e68 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:16.869532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae5ab0-b9d5-4f2d-aa2d-f702a0e95e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:16.870003 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae5ab0-b9d5-4f2d-aa2d-f702a0e95e68 None admin] PATH_INFO: `/v3/users/e3970c7bc64647ebba754a7ba99dfc21` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:16.878294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 154/306] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 14 00:51:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:16.879992 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a9ecd-f469-42a8-8582-9753755d7f61 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:16.880433 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a9ecd-f469-42a8-8582-9753755d7f61 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:16.880709 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a9ecd-f469-42a8-8582-9753755d7f61 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:16.882054 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 155/307] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:16.882922 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a9ecd-f469-42a8-8582-9753755d7f61 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:16.889725 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae5ab0-b9d5-4f2d-aa2d-f702a0e95e68 None admin] RBAC: Authorizing `identity:get_user(user_id=e3970c7bc64647ebba754a7ba99dfc21)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:16.891874 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae5ab0-b9d5-4f2d-aa2d-f702a0e95e68 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:16.893547 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 153/308] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:51:16 2022] GET /identity/v3/users/e3970c7bc64647ebba754a7ba99dfc21 => generated 293 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:16.894898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b7c9b-ac6b-45c0-a6bc-28eadab82b4d None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:16.895353 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b7c9b-ac6b-45c0-a6bc-28eadab82b4d None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:16.895776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b7c9b-ac6b-45c0-a6bc-28eadab82b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:16.914379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-7e6b7c9b-ac6b-45c0-a6bc-28eadab82b4d None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:16.915559 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7e6b7c9b-ac6b-45c0-a6bc-28eadab82b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:16.989937 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 154/309] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:16.990804 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b7c9b-ac6b-45c0-a6bc-28eadab82b4d None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:17.016209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a9ecd-f469-42a8-8582-9753755d7f61 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:17.049907 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:17.054245 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e149dfa-bea2-4dc1-8f41-d0dc89d3c6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:17.055167 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e149dfa-bea2-4dc1-8f41-d0dc89d3c6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:17.055645 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e149dfa-bea2-4dc1-8f41-d0dc89d3c6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:17.056114 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e149dfa-bea2-4dc1-8f41-d0dc89d3c6c3 None admin] PATH_INFO: `/v3/users/0bc5328aeb4e40a3babe7e33b45f62c4` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:17.057465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e149dfa-bea2-4dc1-8f41-d0dc89d3c6c3 None admin] RBAC: Authorizing `identity:get_user(user_id=0bc5328aeb4e40a3babe7e33b45f62c4)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:17.059152 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e149dfa-bea2-4dc1-8f41-d0dc89d3c6c3 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:17.061291 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 156/310] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:51:16 2022] GET /identity/v3/users/0bc5328aeb4e40a3babe7e33b45f62c4 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:17.067408 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e149dfa-bea2-4dc1-8f41-d0dc89d3c6c3 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:17.112060 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b7c9b-ac6b-45c0-a6bc-28eadab82b4d None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:17.147509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668a70a-0aa0-404a-b8f8-2c02959730ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:17.148121 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:17.148933 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668a70a-0aa0-404a-b8f8-2c02959730ba None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:17.150263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668a70a-0aa0-404a-b8f8-2c02959730ba None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:17.150803 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668a70a-0aa0-404a-b8f8-2c02959730ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:17.151753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668a70a-0aa0-404a-b8f8-2c02959730ba None admin] RBAC: Adding query filter params (role.id=79f3e2103ea3417a946a9e54a4ae30f3, user.id=e3970c7bc64647ebba754a7ba99dfc21, scope.system=all) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:17.152294 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668a70a-0aa0-404a-b8f8-2c02959730ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:17.155003 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668a70a-0aa0-404a-b8f8-2c02959730ba None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:17.161302 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 155/311] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Sep 14 00:51:16 2022] GET /identity/v3/role_assignments?user.id=e3970c7bc64647ebba754a7ba99dfc21&scope.system=all&role.id=79f3e2103ea3417a946a9e54a4ae30f3 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:17.188449 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e149dfa-bea2-4dc1-8f41-d0dc89d3c6c3 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:17.227497 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db479e22-5bd9-40f4-a944-81242815342d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:17.228523 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db479e22-5bd9-40f4-a944-81242815342d None admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:17.229046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db479e22-5bd9-40f4-a944-81242815342d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:17.229582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db479e22-5bd9-40f4-a944-81242815342d None admin] PATH_INFO: `/v3/system/users/0bc5328aeb4e40a3babe7e33b45f62c4/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:17.231356 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db479e22-5bd9-40f4-a944-81242815342d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0bc5328aeb4e40a3babe7e33b45f62c4, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:17.232974 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db479e22-5bd9-40f4-a944-81242815342d None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:17.247336 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 157/312] 10.222.0.20 () {58 vars in 1334 bytes} [Wed Sep 14 00:51:17 2022] PUT /identity/v3/system/users/0bc5328aeb4e40a3babe7e33b45f62c4/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 00:51:17.284347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668a70a-0aa0-404a-b8f8-2c02959730ba None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:17.403374 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668a70a-0aa0-404a-b8f8-2c02959730ba None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:17.417819 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:17.450987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373c04f-5ee5-42ad-b5ff-cf0eb7fce5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:17.452004 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373c04f-5ee5-42ad-b5ff-cf0eb7fce5ce None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:17.452500 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373c04f-5ee5-42ad-b5ff-cf0eb7fce5ce None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:17.452966 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373c04f-5ee5-42ad-b5ff-cf0eb7fce5ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:17.466298 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373c04f-5ee5-42ad-b5ff-cf0eb7fce5ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:17.472129 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-5373c04f-5ee5-42ad-b5ff-cf0eb7fce5ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 00:51:17.472129 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:17.472129 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:17.472129 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:17.472129 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:17.472129 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:17.472129 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:17.472129 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:17.472129 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:17.472129 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:17.472129 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:17.472129 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:17.472129 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:17.472129 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:17.472129 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:17.472129 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:17.473889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:17.473889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:17.473889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:17.473889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:17.473889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:17.473889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:17.473889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:17.473889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:17.473889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:17.473889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:17.473889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:17.473889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:17.473889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:17.473889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:17.473889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:17.473889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:17.475390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:17.475390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:17.475390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:17.475390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:17.475390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:17.475390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:17.475390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:17.475390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:17.475390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:17.475390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:17.475390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 00:51:17.475390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:17.475390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 156/313] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:17.480214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db479e22-5bd9-40f4-a944-81242815342d None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:17.587916 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db479e22-5bd9-40f4-a944-81242815342d None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:17.616784 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:17.622320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea04b17-dfd7-49a2-8750-e0cd5a271f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:17.623192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea04b17-dfd7-49a2-8750-e0cd5a271f9a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:17.625065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea04b17-dfd7-49a2-8750-e0cd5a271f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:17.625065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea04b17-dfd7-49a2-8750-e0cd5a271f9a None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:17.625065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea04b17-dfd7-49a2-8750-e0cd5a271f9a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:17.625065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea04b17-dfd7-49a2-8750-e0cd5a271f9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:17.626181 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea04b17-dfd7-49a2-8750-e0cd5a271f9a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:17.636981 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 158/314] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 14 00:51:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:17.643486 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373c04f-5ee5-42ad-b5ff-cf0eb7fce5ce None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:17.754047 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373c04f-5ee5-42ad-b5ff-cf0eb7fce5ce None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:17.788992 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e6d23-de60-4d07-8df2-a5e2a9b34840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:17.789620 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e6d23-de60-4d07-8df2-a5e2a9b34840 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:17.789928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e6d23-de60-4d07-8df2-a5e2a9b34840 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:17.790200 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e6d23-de60-4d07-8df2-a5e2a9b34840 None admin] PATH_INFO: `/v3/users/0e76dbb11c884442b477ef46646f5971` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:17.791336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e6d23-de60-4d07-8df2-a5e2a9b34840 None admin] RBAC: Authorizing `identity:get_user(user_id=0e76dbb11c884442b477ef46646f5971)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:17.792779 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e6d23-de60-4d07-8df2-a5e2a9b34840 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:17.794375 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 157/315] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:51:17 2022] GET /identity/v3/users/0e76dbb11c884442b477ef46646f5971 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:17.800626 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea04b17-dfd7-49a2-8750-e0cd5a271f9a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:17.904710 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea04b17-dfd7-49a2-8750-e0cd5a271f9a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:17.941974 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202327e1-940a-4261-92a6-594dfeb7945c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:17.942865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202327e1-940a-4261-92a6-594dfeb7945c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:17.943316 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202327e1-940a-4261-92a6-594dfeb7945c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:17.943784 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202327e1-940a-4261-92a6-594dfeb7945c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:18.006155 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:18.017110 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202327e1-940a-4261-92a6-594dfeb7945c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:18.018598 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202327e1-940a-4261-92a6-594dfeb7945c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:18.126872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 159/316] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:51:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:51:18.135284 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e6d23-de60-4d07-8df2-a5e2a9b34840 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:18.173265 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:18.238644 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e6d23-de60-4d07-8df2-a5e2a9b34840 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:18.275849 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddea80e-3e54-4eb8-ab56-9185e71a42a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:18.276481 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddea80e-3e54-4eb8-ab56-9185e71a42a7 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:18.276757 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddea80e-3e54-4eb8-ab56-9185e71a42a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:18.277029 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddea80e-3e54-4eb8-ab56-9185e71a42a7 None admin] PATH_INFO: `/v3/projects/3adf86e652e34928b6066fc3d75c468f` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:18.278178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddea80e-3e54-4eb8-ab56-9185e71a42a7 None admin] RBAC: Authorizing `identity:get_project(project_id=3adf86e652e34928b6066fc3d75c468f)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:18.279852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddea80e-3e54-4eb8-ab56-9185e71a42a7 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:18.285924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 158/317] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:18 2022] GET /identity/v3/projects/3adf86e652e34928b6066fc3d75c468f => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:18.287882 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202327e1-940a-4261-92a6-594dfeb7945c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:18.380342 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:18.389454 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202327e1-940a-4261-92a6-594dfeb7945c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:18.425697 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182aa23-9508-40a7-b253-bc7ea703db9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:18.426302 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182aa23-9508-40a7-b253-bc7ea703db9f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:18.426746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182aa23-9508-40a7-b253-bc7ea703db9f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:18.427019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182aa23-9508-40a7-b253-bc7ea703db9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:18.427801 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6182aa23-9508-40a7-b253-bc7ea703db9f None admin] RBAC: Adding query filter params (role.id=79f3e2103ea3417a946a9e54a4ae30f3, scope.project.id=3adf86e652e34928b6066fc3d75c468f, user.id=0e76dbb11c884442b477ef46646f5971) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:18.428196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6182aa23-9508-40a7-b253-bc7ea703db9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:18.429633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6182aa23-9508-40a7-b253-bc7ea703db9f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:18.435713 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 160/318] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:51:18 2022] GET /identity/v3/role_assignments?user.id=0e76dbb11c884442b477ef46646f5971&scope.project.id=3adf86e652e34928b6066fc3d75c468f&role.id=79f3e2103ea3417a946a9e54a4ae30f3 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:18.914690 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccba582-41b1-4d60-b17f-fe0eeab32c81 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:18.915107 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccba582-41b1-4d60-b17f-fe0eeab32c81 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:18.915287 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccba582-41b1-4d60-b17f-fe0eeab32c81 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:18.916728 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 159/319] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:18.921588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf9bd4-8c77-465a-bfd5-8f139c5409e3 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:18.922540 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf9bd4-8c77-465a-bfd5-8f139c5409e3 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:18.922722 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf9bd4-8c77-465a-bfd5-8f139c5409e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:18.941916 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-4ccf9bd4-8c77-465a-bfd5-8f139c5409e3 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:18.943090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4ccf9bd4-8c77-465a-bfd5-8f139c5409e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:19.014844 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 161/320] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:19.282747 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccba582-41b1-4d60-b17f-fe0eeab32c81 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:19.394770 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccba582-41b1-4d60-b17f-fe0eeab32c81 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:19.397108 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:19.430671 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86805426-df35-44dc-979f-f4dda556e302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:19.431300 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86805426-df35-44dc-979f-f4dda556e302 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:19.431580 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86805426-df35-44dc-979f-f4dda556e302 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:19.431852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86805426-df35-44dc-979f-f4dda556e302 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:19.432954 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86805426-df35-44dc-979f-f4dda556e302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:19.434418 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86805426-df35-44dc-979f-f4dda556e302 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:19.436206 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 160/321] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:19.441177 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29060e5c-d33e-4f68-b5c4-43ba41f3f92e None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:19.441302 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86805426-df35-44dc-979f-f4dda556e302 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:19.441487 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29060e5c-d33e-4f68-b5c4-43ba41f3f92e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:19.441721 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29060e5c-d33e-4f68-b5c4-43ba41f3f92e None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:19.443203 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 162/322] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:19.448052 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcada091-7d09-4554-9f10-8847a5d197c1 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:19.448327 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcada091-7d09-4554-9f10-8847a5d197c1 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:19.448594 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcada091-7d09-4554-9f10-8847a5d197c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:19.468401 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-dcada091-7d09-4554-9f10-8847a5d197c1 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:19.470207 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-dcada091-7d09-4554-9f10-8847a5d197c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:19.543190 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 163/323] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 00:51:19.550062 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86805426-df35-44dc-979f-f4dda556e302 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:19.580790 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79debe7-cf11-42fc-abec-7855ac9e9e7b None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:19.581383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79debe7-cf11-42fc-abec-7855ac9e9e7b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:19.581927 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79debe7-cf11-42fc-abec-7855ac9e9e7b None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:19.583514 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 164/324] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 00:51:19.585948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7914b18-d5b2-4f14-9b4d-0305b2070e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:19.586581 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7914b18-d5b2-4f14-9b4d-0305b2070e39 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:19.586859 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7914b18-d5b2-4f14-9b4d-0305b2070e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:19.587311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7914b18-d5b2-4f14-9b4d-0305b2070e39 None admin] PATH_INFO: `/v3/groups` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:19.587944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7914b18-d5b2-4f14-9b4d-0305b2070e39 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:19.588417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715f7e2-474c-42d6-8396-f94a1441bbeb None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:19.588694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715f7e2-474c-42d6-8396-f94a1441bbeb None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:19.588961 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715f7e2-474c-42d6-8396-f94a1441bbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:19.589406 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7914b18-d5b2-4f14-9b4d-0305b2070e39 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:19.606804 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-c715f7e2-474c-42d6-8396-f94a1441bbeb None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:19.607966 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c715f7e2-474c-42d6-8396-f94a1441bbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:19.608743 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 161/325] 10.222.0.20 () {60 vars in 1134 bytes} [Wed Sep 14 00:51:19 2022] POST /identity/v3/groups => generated 226 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:51:19.625746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:19.691950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 165/326] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 00:51:19.822561 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7914b18-d5b2-4f14-9b4d-0305b2070e39 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:19.857083 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:19.931122 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7914b18-d5b2-4f14-9b4d-0305b2070e39 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:19.958998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715f7e2-474c-42d6-8396-f94a1441bbeb None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:19.969759 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970806a-695e-403f-8bd9-e4255b376df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:19.970098 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970806a-695e-403f-8bd9-e4255b376df2 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:19.970367 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970806a-695e-403f-8bd9-e4255b376df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:19.970635 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970806a-695e-403f-8bd9-e4255b376df2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:19.983908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970806a-695e-403f-8bd9-e4255b376df2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:19.988158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-8970806a-695e-403f-8bd9-e4255b376df2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 00:51:19.988158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:19.988158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:19.988158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:19.988158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:19.988158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:19.988158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:19.988158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:19.988158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:19.988158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:19.988158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:19.988158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:19.988158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:19.988158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:19.988158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:19.988158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:19.989028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:19.989028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:19.989028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:19.989028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:19.989028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:19.989028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:19.989028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:19.989028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:19.989028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:19.989028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:19.989028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:19.989028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:19.989028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:19.989028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:19.989028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:19.989028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:19.989852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:19.989852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:19.989852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:19.989852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:19.989852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:19.989852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:19.989852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:19.989852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:19.989852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:19.989852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:19.989852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 00:51:19.989852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:19.989852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 162/327] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:19.994902 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970806a-695e-403f-8bd9-e4255b376df2 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:20.097026 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715f7e2-474c-42d6-8396-f94a1441bbeb None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:20.127094 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:20.141260 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970806a-695e-403f-8bd9-e4255b376df2 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:20.146660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130d8fb-746f-4562-8d8c-c19c338d473f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:20.147302 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130d8fb-746f-4562-8d8c-c19c338d473f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:20.147573 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130d8fb-746f-4562-8d8c-c19c338d473f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:20.147839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130d8fb-746f-4562-8d8c-c19c338d473f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:20.161199 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130d8fb-746f-4562-8d8c-c19c338d473f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:20.167236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-9130d8fb-746f-4562-8d8c-c19c338d473f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:51:20.167236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:20.167236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:20.167236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:20.167236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:20.167236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:20.167236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:20.167236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:20.167236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:20.167236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:20.167236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:20.167236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:20.167236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:20.167236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:20.167236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:20.167236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:20.168113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:20.168113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:20.168113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:20.168113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:20.168113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:20.168113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:20.168113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:20.168113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:20.168113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:20.168113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:20.168113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:20.168113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:20.168113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:20.168113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:20.168113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:20.168113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:20.168874 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:20.168874 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:20.168874 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:20.168874 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:20.168874 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:20.168874 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:20.168874 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:20.168874 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:20.168874 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:20.168874 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:20.168874 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:51:20.168874 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:20.168874 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 166/328] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:51:20.174763 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130d8fb-746f-4562-8d8c-c19c338d473f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:20.185626 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:20.194284 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637a751-0daa-4143-8b35-6f0badf1678c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:20.194892 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637a751-0daa-4143-8b35-6f0badf1678c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:20.195168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637a751-0daa-4143-8b35-6f0badf1678c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:20.195440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637a751-0daa-4143-8b35-6f0badf1678c None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:20.196108 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637a751-0daa-4143-8b35-6f0badf1678c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:20.196404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637a751-0daa-4143-8b35-6f0badf1678c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:20.197770 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637a751-0daa-4143-8b35-6f0badf1678c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:20.208122 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 163/329] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 14 00:51:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:51:20.213569 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637a751-0daa-4143-8b35-6f0badf1678c None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:20.312008 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130d8fb-746f-4562-8d8c-c19c338d473f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:20.342188 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637a751-0daa-4143-8b35-6f0badf1678c None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:20.351706 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edd738-233d-4055-b36e-c7559ed84b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:20.352253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edd738-233d-4055-b36e-c7559ed84b30 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:20.352533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edd738-233d-4055-b36e-c7559ed84b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:20.352814 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edd738-233d-4055-b36e-c7559ed84b30 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:20.353589 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edd738-233d-4055-b36e-c7559ed84b30 None admin] RBAC: Adding query filter params (name=member) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:20.353917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edd738-233d-4055-b36e-c7559ed84b30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:20.355405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edd738-233d-4055-b36e-c7559ed84b30 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:20.369928 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 167/330] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 14 00:51:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:51:20.372439 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edd738-233d-4055-b36e-c7559ed84b30 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:20.379862 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c19b6-524f-43c3-9272-111fbf476f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:20.380497 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c19b6-524f-43c3-9272-111fbf476f50 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:20.380771 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c19b6-524f-43c3-9272-111fbf476f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:20.381041 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c19b6-524f-43c3-9272-111fbf476f50 None admin] PATH_INFO: `/v3/users/e3970c7bc64647ebba754a7ba99dfc21` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:20.382204 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c19b6-524f-43c3-9272-111fbf476f50 None admin] RBAC: Authorizing `identity:get_user(user_id=e3970c7bc64647ebba754a7ba99dfc21)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:20.383638 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c19b6-524f-43c3-9272-111fbf476f50 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:20.385621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 164/331] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:51:20 2022] GET /identity/v3/users/e3970c7bc64647ebba754a7ba99dfc21 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:20.395730 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c19b6-524f-43c3-9272-111fbf476f50 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:20.431200 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:20.464739 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:20.514390 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edd738-233d-4055-b36e-c7559ed84b30 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:20.518967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c19b6-524f-43c3-9272-111fbf476f50 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:20.554326 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975ed84-4ea9-4100-9bcf-d1551c5c4762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:20.554977 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975ed84-4ea9-4100-9bcf-d1551c5c4762 None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:20.555259 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975ed84-4ea9-4100-9bcf-d1551c5c4762 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:20.555531 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975ed84-4ea9-4100-9bcf-d1551c5c4762 None admin] PATH_INFO: `/v3/system/users/e3970c7bc64647ebba754a7ba99dfc21/roles/79f3e2103ea3417a946a9e54a4ae30f3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:20.556992 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975ed84-4ea9-4100-9bcf-d1551c5c4762 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e3970c7bc64647ebba754a7ba99dfc21, role_id=79f3e2103ea3417a946a9e54a4ae30f3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:20.558452 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975ed84-4ea9-4100-9bcf-d1551c5c4762 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:20.577597 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 165/332] 10.222.0.20 () {58 vars in 1334 bytes} [Wed Sep 14 00:51:20 2022] PUT /identity/v3/system/users/e3970c7bc64647ebba754a7ba99dfc21/roles/79f3e2103ea3417a946a9e54a4ae30f3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 00:51:20.579437 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db004e1-099f-471e-a419-b99b9bb5b8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:20.580178 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db004e1-099f-471e-a419-b99b9bb5b8cf None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:20.580463 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db004e1-099f-471e-a419-b99b9bb5b8cf None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:20.580823 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db004e1-099f-471e-a419-b99b9bb5b8cf None admin] PATH_INFO: `/v3/users/0bc5328aeb4e40a3babe7e33b45f62c4` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:20.582208 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db004e1-099f-471e-a419-b99b9bb5b8cf None admin] RBAC: Authorizing `identity:get_user(user_id=0bc5328aeb4e40a3babe7e33b45f62c4)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:20.583773 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db004e1-099f-471e-a419-b99b9bb5b8cf None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:20.585790 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 168/333] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:51:20 2022] GET /identity/v3/users/0bc5328aeb4e40a3babe7e33b45f62c4 => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:51:20.591690 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975ed84-4ea9-4100-9bcf-d1551c5c4762 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:20.689461 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:20.711649 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975ed84-4ea9-4100-9bcf-d1551c5c4762 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:20.749727 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2134eea-4034-462d-855c-0c34c1075239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:20.750460 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2134eea-4034-462d-855c-0c34c1075239 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:20.750742 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2134eea-4034-462d-855c-0c34c1075239 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:20.751017 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2134eea-4034-462d-855c-0c34c1075239 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:20.751775 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2134eea-4034-462d-855c-0c34c1075239 None admin] RBAC: Adding query filter params (role.id=ee3984f710984de6bf564de3bee00d33, user.id=0bc5328aeb4e40a3babe7e33b45f62c4, scope.system=all) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:20.752085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2134eea-4034-462d-855c-0c34c1075239 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:20.753566 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2134eea-4034-462d-855c-0c34c1075239 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:20.767956 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 166/334] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Sep 14 00:51:20 2022] GET /identity/v3/role_assignments?user.id=0bc5328aeb4e40a3babe7e33b45f62c4&scope.system=all&role.id=ee3984f710984de6bf564de3bee00d33 => generated 510 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:22.498417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b1b9e-695d-4228-a59f-f0d0db4dd137 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:22.498929 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b1b9e-695d-4228-a59f-f0d0db4dd137 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:22.499362 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b1b9e-695d-4228-a59f-f0d0db4dd137 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:22.502577 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 169/335] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:22.508677 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fecad-b870-42f3-aac3-18d466daf289 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:22.509175 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fecad-b870-42f3-aac3-18d466daf289 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:22.509654 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fecad-b870-42f3-aac3-18d466daf289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:22.544994 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-581fecad-b870-42f3-aac3-18d466daf289 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:22.547150 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-581fecad-b870-42f3-aac3-18d466daf289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:22.682676 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 167/336] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:23.234426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b1b9e-695d-4228-a59f-f0d0db4dd137 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:23.368966 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b1b9e-695d-4228-a59f-f0d0db4dd137 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:23.387871 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986c801-fa70-41bc-a5b1-b0987339b9e6 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:23.388161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986c801-fa70-41bc-a5b1-b0987339b9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:23.388435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986c801-fa70-41bc-a5b1-b0987339b9e6 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:23.394243 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 168/337] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:23.399561 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cd7e1-0342-4911-817f-c5b2d8d76520 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:23.399909 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cd7e1-0342-4911-817f-c5b2d8d76520 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:23.400187 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cd7e1-0342-4911-817f-c5b2d8d76520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:23.421220 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03ca03-cc58-4c8f-bd06-806486e94e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:23.421983 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03ca03-cc58-4c8f-bd06-806486e94e9e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:23.422258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03ca03-cc58-4c8f-bd06-806486e94e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:23.423200 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03ca03-cc58-4c8f-bd06-806486e94e9e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:23.429213 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:23.435102 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e27cd7e1-0342-4911-817f-c5b2d8d76520 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:23.436470 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e27cd7e1-0342-4911-817f-c5b2d8d76520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:23.449629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03ca03-cc58-4c8f-bd06-806486e94e9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:23.455923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-9a03ca03-cc58-4c8f-bd06-806486e94e9e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 00:51:23.455923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:23.455923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:23.455923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:23.455923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:23.455923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:23.455923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:23.455923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:23.455923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:23.455923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:23.455923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:23.455923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:23.455923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:23.455923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:23.455923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:23.455923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:23.456856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:23.456856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:23.456856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:23.456856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:23.456856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:23.456856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:23.456856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:23.456856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:23.456856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:23.456856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:23.456856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:23.456856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:23.456856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:23.456856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:23.456856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:23.456856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:23.457618 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:23.457618 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:23.457618 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:23.457618 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:23.457618 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:23.457618 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:23.457618 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:23.457618 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:23.457618 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:23.457618 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:23.457618 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 00:51:23.457618 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:23.458246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 170/338] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 14 00:51:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:23.464723 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03ca03-cc58-4c8f-bd06-806486e94e9e None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:23.626973 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03ca03-cc58-4c8f-bd06-806486e94e9e None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:23.645218 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 169/339] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:23.656203 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a742e10-bf7d-416d-b450-8aa259ad2378 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:23.656490 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a742e10-bf7d-416d-b450-8aa259ad2378 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:23.656765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a742e10-bf7d-416d-b450-8aa259ad2378 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:23.658392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 170/340] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:23.663059 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae5364-5ac5-4a72-816a-fef592c5dd3d None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:23.663343 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae5364-5ac5-4a72-816a-fef592c5dd3d None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:23.663614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae5364-5ac5-4a72-816a-fef592c5dd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:23.682187 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:23.690477 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71aa5c8-67d9-4956-99a1-521e3d20b631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:23.691370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71aa5c8-67d9-4956-99a1-521e3d20b631 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:23.691836 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71aa5c8-67d9-4956-99a1-521e3d20b631 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:23.692302 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71aa5c8-67d9-4956-99a1-521e3d20b631 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:23.693165 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71aa5c8-67d9-4956-99a1-521e3d20b631 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:23.693696 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71aa5c8-67d9-4956-99a1-521e3d20b631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:23.695261 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71aa5c8-67d9-4956-99a1-521e3d20b631 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:23.702861 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-2eae5364-5ac5-4a72-816a-fef592c5dd3d None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:23.704629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2eae5364-5ac5-4a72-816a-fef592c5dd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:23.712837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 171/341] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:51:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:23.720733 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71aa5c8-67d9-4956-99a1-521e3d20b631 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:23.843191 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 171/342] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:23.850142 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:23.912486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71aa5c8-67d9-4956-99a1-521e3d20b631 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:23.954027 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819e533-757e-4587-b36d-38c8cced8890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:23.954637 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819e533-757e-4587-b36d-38c8cced8890 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:23.954917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819e533-757e-4587-b36d-38c8cced8890 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:23.955190 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819e533-757e-4587-b36d-38c8cced8890 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:23.991611 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6a8e2-3433-4357-b81b-510428cf2e1a None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:23.991930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6a8e2-3433-4357-b81b-510428cf2e1a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:23.992161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6a8e2-3433-4357-b81b-510428cf2e1a None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:23.993992 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 172/343] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:23.999110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f72cd9-b4a3-4fcc-9148-8fd2195f507e None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:23.999392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f72cd9-b4a3-4fcc-9148-8fd2195f507e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:23.999667 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f72cd9-b4a3-4fcc-9148-8fd2195f507e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:24.038936 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-c1f72cd9-b4a3-4fcc-9148-8fd2195f507e None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:24.040807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c1f72cd9-b4a3-4fcc-9148-8fd2195f507e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:24.065148 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819e533-757e-4587-b36d-38c8cced8890 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:24.066779 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819e533-757e-4587-b36d-38c8cced8890 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:24.150717 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:24.152958 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 173/344] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:24.154973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f72cd9-b4a3-4fcc-9148-8fd2195f507e None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:24.230843 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 172/345] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:51:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 00:51:24.237791 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819e533-757e-4587-b36d-38c8cced8890 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:24.274151 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:24.344727 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f72cd9-b4a3-4fcc-9148-8fd2195f507e None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:24.395005 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a52fd-56b6-4e2e-8035-dcdb45aea0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:24.395971 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a52fd-56b6-4e2e-8035-dcdb45aea0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:24.397391 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a52fd-56b6-4e2e-8035-dcdb45aea0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:24.397867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a52fd-56b6-4e2e-8035-dcdb45aea0f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:24.420708 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a52fd-56b6-4e2e-8035-dcdb45aea0f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:24.428112 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819e533-757e-4587-b36d-38c8cced8890 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:24.432533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-dd5a52fd-56b6-4e2e-8035-dcdb45aea0f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:51:24.432533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:24.432533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:24.432533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:24.432533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:24.432533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:24.432533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:24.432533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:24.432533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:24.432533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:24.432533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:24.432533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:24.432533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:24.432533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:24.432533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:24.432533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:24.433432 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:24.433432 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:24.433432 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:24.433432 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:24.433432 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:24.433432 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:24.433432 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:24.433432 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:24.433432 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:24.433432 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:24.433432 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:24.433432 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:24.433432 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:24.433432 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:24.433432 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:24.433432 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:24.434280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:24.434280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:24.434280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:24.434280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:24.434280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:24.434280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:24.434280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:24.434280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:24.434280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:24.434280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:24.434280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:51:24.434280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:24.437103 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 174/346] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:24.448471 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a52fd-56b6-4e2e-8035-dcdb45aea0f3 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:24.498699 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794185c-2ae7-433a-ac12-aad7bbaa23e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:24.499562 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794185c-2ae7-433a-ac12-aad7bbaa23e6 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:24.500058 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794185c-2ae7-433a-ac12-aad7bbaa23e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:24.500471 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794185c-2ae7-433a-ac12-aad7bbaa23e6 None admin] PATH_INFO: `/v3/projects/6b02aee449a54bf3bb79025645d7f35e` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:24.501728 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794185c-2ae7-433a-ac12-aad7bbaa23e6 None admin] RBAC: Authorizing `identity:get_project(project_id=6b02aee449a54bf3bb79025645d7f35e)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:24.503505 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794185c-2ae7-433a-ac12-aad7bbaa23e6 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:24.505585 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 173/347] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:24 2022] GET /identity/v3/projects/6b02aee449a54bf3bb79025645d7f35e => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:51:24.507714 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794185c-2ae7-433a-ac12-aad7bbaa23e6 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:24.541354 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:24.620233 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794185c-2ae7-433a-ac12-aad7bbaa23e6 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:24.660027 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa1676-d0b2-44ec-8214-88b8f181135c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:24.660641 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa1676-d0b2-44ec-8214-88b8f181135c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:24.660906 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa1676-d0b2-44ec-8214-88b8f181135c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:24.661150 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa1676-d0b2-44ec-8214-88b8f181135c None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:24.662105 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa1676-d0b2-44ec-8214-88b8f181135c None admin] RBAC: Adding query filter params (name=member) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:24.662408 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa1676-d0b2-44ec-8214-88b8f181135c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:24.664620 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa1676-d0b2-44ec-8214-88b8f181135c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:24.666975 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a52fd-56b6-4e2e-8035-dcdb45aea0f3 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:24.673692 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 174/348] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 14 00:51:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:24.674614 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa1676-d0b2-44ec-8214-88b8f181135c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:24.704605 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:24.722125 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c371a9-e7d0-428d-a2a0-41e3cf0cb9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:24.723205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c371a9-e7d0-428d-a2a0-41e3cf0cb9a2 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:24.723687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c371a9-e7d0-428d-a2a0-41e3cf0cb9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:24.724159 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c371a9-e7d0-428d-a2a0-41e3cf0cb9a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:24.735311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c371a9-e7d0-428d-a2a0-41e3cf0cb9a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:24.741183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-25c371a9-e7d0-428d-a2a0-41e3cf0cb9a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:51:24.741183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:24.741183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:24.741183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:24.741183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:24.741183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:24.741183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:24.741183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:24.741183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:24.741183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:24.741183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:24.741183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:24.741183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:24.741183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:24.741183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:24.741183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:24.742292 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:24.742292 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:24.742292 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:24.742292 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:24.742292 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:24.742292 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:24.742292 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:24.742292 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:24.742292 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:24.742292 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:24.742292 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:24.742292 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:24.742292 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:24.742292 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:24.742292 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:24.742292 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:24.743079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:24.743079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:24.743079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:24.743079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:24.743079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:24.743079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:24.743079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:24.743079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:24.743079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:24.743079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:24.743079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:51:24.743079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:24.745144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 175/349] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:24.746138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c371a9-e7d0-428d-a2a0-41e3cf0cb9a2 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:24.780381 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:24.793664 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa1676-d0b2-44ec-8214-88b8f181135c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:24.837628 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be1879-434e-42eb-a176-916d9873db79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:24.838478 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be1879-434e-42eb-a176-916d9873db79 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:24.838865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be1879-434e-42eb-a176-916d9873db79 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:24.839149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be1879-434e-42eb-a176-916d9873db79 None admin] PATH_INFO: `/v3/groups/c4c2ccd3233748b78095c4da4bcebf97` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:24.847128 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be1879-434e-42eb-a176-916d9873db79 None admin] RBAC: Authorizing `identity:get_group(group_id=c4c2ccd3233748b78095c4da4bcebf97)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:24.848705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be1879-434e-42eb-a176-916d9873db79 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:24.851629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 175/350] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 14 00:51:24 2022] GET /identity/v3/groups/c4c2ccd3233748b78095c4da4bcebf97 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:24.851758 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83642517-4c37-4aa6-981d-d4d71cfb1347 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:24.852213 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83642517-4c37-4aa6-981d-d4d71cfb1347 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:24.852213 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83642517-4c37-4aa6-981d-d4d71cfb1347 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:24.853556 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 176/351] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:24.854817 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83642517-4c37-4aa6-981d-d4d71cfb1347 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:24.891618 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c371a9-e7d0-428d-a2a0-41e3cf0cb9a2 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:24.940196 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1afd5-a683-4068-bac2-bc1e1d7370ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:24.940992 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1afd5-a683-4068-bac2-bc1e1d7370ea None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:24.941270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1afd5-a683-4068-bac2-bc1e1d7370ea None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:24.941535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1afd5-a683-4068-bac2-bc1e1d7370ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:24.964776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1afd5-a683-4068-bac2-bc1e1d7370ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:24.970092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-13d1afd5-a683-4068-bac2-bc1e1d7370ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 00:51:24.970092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:24.970092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:24.970092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:24.970092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:24.970092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:24.970092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:24.970092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:24.970092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:24.970092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:24.970092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:24.970092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:24.970092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:24.970092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:24.970092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:24.970092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:24.971035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:24.971035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:24.971035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:24.971035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:24.971035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:24.971035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:24.971035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:24.971035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:24.971035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:24.971035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:24.971035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:24.971035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:24.971035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:24.971035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:24.971035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:24.971035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:24.971804 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:24.971804 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:24.971804 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:24.971804 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:24.971804 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:24.971804 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:24.971804 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:24.971804 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:24.971804 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:24.971804 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:24.971804 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 00:51:24.971804 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:24.971804 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 176/352] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 14 00:51:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:24.972443 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1afd5-a683-4068-bac2-bc1e1d7370ea None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:24.999919 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83642517-4c37-4aa6-981d-d4d71cfb1347 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:25.035408 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:25.051630 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d75c5-223c-44e8-b279-b22cf3d12cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:25.052926 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d75c5-223c-44e8-b279-b22cf3d12cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:25.052926 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d75c5-223c-44e8-b279-b22cf3d12cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:25.053103 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d75c5-223c-44e8-b279-b22cf3d12cf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:25.082198 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:25.114128 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1afd5-a683-4068-bac2-bc1e1d7370ea None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:25.139915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d75c5-223c-44e8-b279-b22cf3d12cf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:25.142090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d75c5-223c-44e8-b279-b22cf3d12cf4 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:25.157642 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fc00f-693d-4ed4-bf02-180e1b1fff5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:25.158535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fc00f-693d-4ed4-bf02-180e1b1fff5a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:25.158812 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fc00f-693d-4ed4-bf02-180e1b1fff5a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:25.159083 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fc00f-693d-4ed4-bf02-180e1b1fff5a None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:25.159740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fc00f-693d-4ed4-bf02-180e1b1fff5a None admin] RBAC: Adding query filter params (name=member) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:25.160039 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fc00f-693d-4ed4-bf02-180e1b1fff5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:25.161380 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fc00f-693d-4ed4-bf02-180e1b1fff5a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:25.170579 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 177/353] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 14 00:51:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:25.171389 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fc00f-693d-4ed4-bf02-180e1b1fff5a None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:25.258752 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 177/354] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:51:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:51:25.259877 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc89ea8-db5a-4dd4-a526-8e337e34cd2e None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:25.260161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc89ea8-db5a-4dd4-a526-8e337e34cd2e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:25.260464 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc89ea8-db5a-4dd4-a526-8e337e34cd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:25.278793 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-8dc89ea8-db5a-4dd4-a526-8e337e34cd2e None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:25.280235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8dc89ea8-db5a-4dd4-a526-8e337e34cd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:25.281932 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fc00f-693d-4ed4-bf02-180e1b1fff5a None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:25.290267 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:25.325081 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5bcb13-9faa-4a4a-8299-1b2feac26214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:25.325989 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bcb13-9faa-4a4a-8299-1b2feac26214 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:25.326264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bcb13-9faa-4a4a-8299-1b2feac26214 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:25.326605 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bcb13-9faa-4a4a-8299-1b2feac26214 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:25.327338 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5bcb13-9faa-4a4a-8299-1b2feac26214 None admin] RBAC: Adding query filter params (group.id=c4c2ccd3233748b78095c4da4bcebf97, role.id=8373a23ee4ff4c7d94e82480d85b586b, scope.project.id=6b02aee449a54bf3bb79025645d7f35e) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:25.327644 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5bcb13-9faa-4a4a-8299-1b2feac26214 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:25.331656 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5bcb13-9faa-4a4a-8299-1b2feac26214 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:25.332687 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:25.337953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 178/355] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Sep 14 00:51:25 2022] GET /identity/v3/role_assignments?group.id=c4c2ccd3233748b78095c4da4bcebf97&scope.project.id=6b02aee449a54bf3bb79025645d7f35e&role.id=8373a23ee4ff4c7d94e82480d85b586b => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:25.339097 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5bcb13-9faa-4a4a-8299-1b2feac26214 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:25.361305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 178/356] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:25.362809 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c76d4-7fa7-4431-a6a7-2dc7bfc48ca6 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:25.362809 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c76d4-7fa7-4431-a6a7-2dc7bfc48ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:25.362979 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c76d4-7fa7-4431-a6a7-2dc7bfc48ca6 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:25.364278 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 179/357] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:25.365005 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c76d4-7fa7-4431-a6a7-2dc7bfc48ca6 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:25.490781 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5bcb13-9faa-4a4a-8299-1b2feac26214 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:25.516822 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c76d4-7fa7-4431-a6a7-2dc7bfc48ca6 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:25.543415 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef0922-2642-4cc3-b62a-b5204759798a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:25.543953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef0922-2642-4cc3-b62a-b5204759798a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:25.544230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef0922-2642-4cc3-b62a-b5204759798a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:25.544495 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef0922-2642-4cc3-b62a-b5204759798a None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:25.545165 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef0922-2642-4cc3-b62a-b5204759798a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:25.545782 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef0922-2642-4cc3-b62a-b5204759798a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:25.548411 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef0922-2642-4cc3-b62a-b5204759798a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:25.558583 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 179/358] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:51:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:25.558849 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef0922-2642-4cc3-b62a-b5204759798a None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:25.569106 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a346f-d2ac-4055-8b84-8d17928f577a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:25.570120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a346f-d2ac-4055-8b84-8d17928f577a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:25.570396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a346f-d2ac-4055-8b84-8d17928f577a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:25.570685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a346f-d2ac-4055-8b84-8d17928f577a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:25.606075 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:25.650282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:25.665470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a346f-d2ac-4055-8b84-8d17928f577a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:25.666997 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a346f-d2ac-4055-8b84-8d17928f577a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:25.693237 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef0922-2642-4cc3-b62a-b5204759798a None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:25.732584 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942762ab-c50c-42eb-9c5e-d2d6cf169be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:25.733222 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942762ab-c50c-42eb-9c5e-d2d6cf169be3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:25.733883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942762ab-c50c-42eb-9c5e-d2d6cf169be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:25.734200 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942762ab-c50c-42eb-9c5e-d2d6cf169be3 None admin] PATH_INFO: `/v3/projects/6b02aee449a54bf3bb79025645d7f35e` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:25.735616 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942762ab-c50c-42eb-9c5e-d2d6cf169be3 None admin] RBAC: Authorizing `identity:get_project(project_id=6b02aee449a54bf3bb79025645d7f35e)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:25.737085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942762ab-c50c-42eb-9c5e-d2d6cf169be3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:25.741512 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 180/359] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:25 2022] GET /identity/v3/projects/6b02aee449a54bf3bb79025645d7f35e => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:25.742816 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4b008-031f-4263-a29e-6b2f22159a74 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:25.743098 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4b008-031f-4263-a29e-6b2f22159a74 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:25.743368 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4b008-031f-4263-a29e-6b2f22159a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:25.762248 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-6bb4b008-031f-4263-a29e-6b2f22159a74 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:25.763438 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6bb4b008-031f-4263-a29e-6b2f22159a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:25.790397 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 180/360] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:51:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:51:25.791548 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a346f-d2ac-4055-8b84-8d17928f577a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:25.854141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 181/361] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:25.854908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4b008-031f-4263-a29e-6b2f22159a74 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:25.896637 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:25.903688 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:25.920850 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a346f-d2ac-4055-8b84-8d17928f577a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:25.965626 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c2715-5457-48fb-9ecd-33405fe0679c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:25.966096 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c2715-5457-48fb-9ecd-33405fe0679c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:25.966379 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c2715-5457-48fb-9ecd-33405fe0679c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:25.966646 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c2715-5457-48fb-9ecd-33405fe0679c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:26.007853 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4b008-031f-4263-a29e-6b2f22159a74 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:26.055081 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4c7cb-d55e-413a-a0a9-8ed970fc1b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:26.056358 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4c7cb-d55e-413a-a0a9-8ed970fc1b94 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:26.056912 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4c7cb-d55e-413a-a0a9-8ed970fc1b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:26.057422 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4c7cb-d55e-413a-a0a9-8ed970fc1b94 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:26.064329 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c2715-5457-48fb-9ecd-33405fe0679c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:26.066078 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c2715-5457-48fb-9ecd-33405fe0679c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:26.069656 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4c7cb-d55e-413a-a0a9-8ed970fc1b94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:26.077242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-afb4c7cb-d55e-413a-a0a9-8ed970fc1b94 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 00:51:26.077242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:26.077242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:26.077242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:26.077242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:26.077242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:26.077242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:26.077242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:26.077242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:26.077242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:26.077242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:26.077242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:26.077242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:26.077242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:26.077242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:26.077242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:26.078255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:26.078255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:26.078255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:26.078255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:26.078255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:26.078255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:26.078255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:26.078255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:26.078255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:26.078255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:26.078255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:26.078255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:26.078255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:26.078255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:26.078255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:26.078255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:26.079043 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:26.079043 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:26.079043 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:26.079043 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:26.079043 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:26.079043 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:26.079043 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:26.079043 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:26.079043 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:26.079043 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:26.079043 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 00:51:26.079043 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:26.080365 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 182/362] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:26.080541 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4c7cb-d55e-413a-a0a9-8ed970fc1b94 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:26.180529 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:26.203821 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:26.212563 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 181/363] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:51:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:51:26.214039 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c2715-5457-48fb-9ecd-33405fe0679c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:26.215406 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4c7cb-d55e-413a-a0a9-8ed970fc1b94 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:26.260466 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8390c-c52a-4336-b79a-85890abf6715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:26.261949 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8390c-c52a-4336-b79a-85890abf6715 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:26.262435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8390c-c52a-4336-b79a-85890abf6715 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:26.262905 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8390c-c52a-4336-b79a-85890abf6715 None admin] PATH_INFO: `/v3/groups/c4c2ccd3233748b78095c4da4bcebf97` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:26.264629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8390c-c52a-4336-b79a-85890abf6715 None admin] RBAC: Authorizing `identity:get_group(group_id=c4c2ccd3233748b78095c4da4bcebf97)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:26.266817 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8390c-c52a-4336-b79a-85890abf6715 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:26.268767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 183/364] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 14 00:51:26 2022] GET /identity/v3/groups/c4c2ccd3233748b78095c4da4bcebf97 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:26.269814 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8390c-c52a-4336-b79a-85890abf6715 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:26.333535 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c2715-5457-48fb-9ecd-33405fe0679c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:26.381518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c953790-85a4-463c-95ba-8b550ef1756a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:26.382616 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c953790-85a4-463c-95ba-8b550ef1756a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:26.382897 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c953790-85a4-463c-95ba-8b550ef1756a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:26.383320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c953790-85a4-463c-95ba-8b550ef1756a None admin] PATH_INFO: `/v3/projects/3adf86e652e34928b6066fc3d75c468f` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:26.384445 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c953790-85a4-463c-95ba-8b550ef1756a None admin] RBAC: Authorizing `identity:get_project(project_id=3adf86e652e34928b6066fc3d75c468f)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:26.385923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c953790-85a4-463c-95ba-8b550ef1756a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:26.387664 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 182/365] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:26 2022] GET /identity/v3/projects/3adf86e652e34928b6066fc3d75c468f => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:26.388350 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c953790-85a4-463c-95ba-8b550ef1756a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:26.395063 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8390c-c52a-4336-b79a-85890abf6715 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:26.437005 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000fa0f-defa-4aa5-924b-0e7b976911b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:26.437999 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000fa0f-defa-4aa5-924b-0e7b976911b4 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:26.438505 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000fa0f-defa-4aa5-924b-0e7b976911b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:26.441336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000fa0f-defa-4aa5-924b-0e7b976911b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:26.441336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000fa0f-defa-4aa5-924b-0e7b976911b4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:26.441336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000fa0f-defa-4aa5-924b-0e7b976911b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:26.441336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000fa0f-defa-4aa5-924b-0e7b976911b4 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:26.450428 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:26.450957 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 184/366] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 14 00:51:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:26.452645 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000fa0f-defa-4aa5-924b-0e7b976911b4 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:26.485642 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:26.520634 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c953790-85a4-463c-95ba-8b550ef1756a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:26.565007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881ddb5-df94-4ea6-a9d8-98f4eaa8591a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:26.565659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881ddb5-df94-4ea6-a9d8-98f4eaa8591a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:26.566235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881ddb5-df94-4ea6-a9d8-98f4eaa8591a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:26.566235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881ddb5-df94-4ea6-a9d8-98f4eaa8591a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:26.577775 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881ddb5-df94-4ea6-a9d8-98f4eaa8591a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:26.579790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000fa0f-defa-4aa5-924b-0e7b976911b4 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:26.583441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-7881ddb5-df94-4ea6-a9d8-98f4eaa8591a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:51:26.583441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:26.583441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:26.583441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:26.583441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:26.583441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:26.583441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:26.583441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:26.583441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:26.583441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:26.583441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:26.583441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:26.583441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:26.583441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:26.583441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:26.583441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:26.584294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:26.584294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:26.584294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:26.584294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:26.584294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:26.584294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:26.584294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:26.584294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:26.584294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:26.584294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:26.584294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:26.584294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:26.584294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:26.584294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:26.584294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:26.584294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:26.585120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:26.585120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:26.585120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:26.585120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:26.585120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:26.585120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:26.585120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:26.585120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:26.585120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:26.585120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:26.585120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:51:26.585120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:26.585120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 183/367] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:51:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:26.585120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881ddb5-df94-4ea6-a9d8-98f4eaa8591a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:26.622313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302bfdd-6d28-4d4b-b009-f3168c5f027d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:26.623311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302bfdd-6d28-4d4b-b009-f3168c5f027d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:26.623957 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302bfdd-6d28-4d4b-b009-f3168c5f027d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:26.624837 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302bfdd-6d28-4d4b-b009-f3168c5f027d None admin] PATH_INFO: `/v3/projects/3adf86e652e34928b6066fc3d75c468f` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:26.626009 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302bfdd-6d28-4d4b-b009-f3168c5f027d None admin] RBAC: Authorizing `identity:get_project(project_id=3adf86e652e34928b6066fc3d75c468f)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:26.627421 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302bfdd-6d28-4d4b-b009-f3168c5f027d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:26.629215 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 185/368] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:26 2022] GET /identity/v3/projects/3adf86e652e34928b6066fc3d75c468f => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:26.629787 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302bfdd-6d28-4d4b-b009-f3168c5f027d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:26.708930 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881ddb5-df94-4ea6-a9d8-98f4eaa8591a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:26.721178 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:26.747819 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:26.760863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdc252-71be-43bd-90f1-e44de2993282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:26.761650 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdc252-71be-43bd-90f1-e44de2993282 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:26.762002 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdc252-71be-43bd-90f1-e44de2993282 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:26.762272 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdc252-71be-43bd-90f1-e44de2993282 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:26.763011 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bdc252-71be-43bd-90f1-e44de2993282 None admin] RBAC: Adding query filter params (group.id=c4c2ccd3233748b78095c4da4bcebf97, role.id=ee3984f710984de6bf564de3bee00d33, scope.project.id=6b02aee449a54bf3bb79025645d7f35e) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:26.763313 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bdc252-71be-43bd-90f1-e44de2993282 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:26.763576 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302bfdd-6d28-4d4b-b009-f3168c5f027d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:26.764812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bdc252-71be-43bd-90f1-e44de2993282 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:26.772232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 184/369] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Sep 14 00:51:26 2022] GET /identity/v3/role_assignments?group.id=c4c2ccd3233748b78095c4da4bcebf97&scope.project.id=6b02aee449a54bf3bb79025645d7f35e&role.id=ee3984f710984de6bf564de3bee00d33 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:26.772858 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdc252-71be-43bd-90f1-e44de2993282 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:26.811731 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7b306-abe3-40bf-8a9d-0fb2273d2bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:26.813323 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7b306-abe3-40bf-8a9d-0fb2273d2bed None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:26.814030 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7b306-abe3-40bf-8a9d-0fb2273d2bed None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:26.815464 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7b306-abe3-40bf-8a9d-0fb2273d2bed None admin] PATH_INFO: `/v3/groups/c4c2ccd3233748b78095c4da4bcebf97` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:26.817059 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7b306-abe3-40bf-8a9d-0fb2273d2bed None admin] RBAC: Authorizing `identity:get_group(group_id=c4c2ccd3233748b78095c4da4bcebf97)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:26.818825 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7b306-abe3-40bf-8a9d-0fb2273d2bed None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:26.821461 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 186/370] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 14 00:51:26 2022] GET /identity/v3/groups/c4c2ccd3233748b78095c4da4bcebf97 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:26.823143 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7b306-abe3-40bf-8a9d-0fb2273d2bed None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:26.914018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdc252-71be-43bd-90f1-e44de2993282 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:26.952425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce0a18-5a9f-46f8-9fc7-f285ddc120a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:26.953615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce0a18-5a9f-46f8-9fc7-f285ddc120a6 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:26.953920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce0a18-5a9f-46f8-9fc7-f285ddc120a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:26.954240 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce0a18-5a9f-46f8-9fc7-f285ddc120a6 None admin] PATH_INFO: `/v3/users/e3970c7bc64647ebba754a7ba99dfc21` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:26.955324 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce0a18-5a9f-46f8-9fc7-f285ddc120a6 None admin] RBAC: Authorizing `identity:get_user(user_id=e3970c7bc64647ebba754a7ba99dfc21)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:26.957026 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce0a18-5a9f-46f8-9fc7-f285ddc120a6 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:26.958489 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 185/371] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:51:26 2022] GET /identity/v3/users/e3970c7bc64647ebba754a7ba99dfc21 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:26.959307 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce0a18-5a9f-46f8-9fc7-f285ddc120a6 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:26.964807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7b306-abe3-40bf-8a9d-0fb2273d2bed None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:27.007789 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e669d-98bc-469f-b94b-885757eb260c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:27.009067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e669d-98bc-469f-b94b-885757eb260c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:27.009788 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e669d-98bc-469f-b94b-885757eb260c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:27.010283 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e669d-98bc-469f-b94b-885757eb260c None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:27.011183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e669d-98bc-469f-b94b-885757eb260c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:27.011742 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e669d-98bc-469f-b94b-885757eb260c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:27.013436 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e669d-98bc-469f-b94b-885757eb260c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:27.022087 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:27.023856 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 187/372] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:27.024927 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e669d-98bc-469f-b94b-885757eb260c None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:27.050062 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:27.101857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce0a18-5a9f-46f8-9fc7-f285ddc120a6 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:27.145025 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e3f8f-a205-4b6d-a4a3-d26735829486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:27.145654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e3f8f-a205-4b6d-a4a3-d26735829486 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:27.146261 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e3f8f-a205-4b6d-a4a3-d26735829486 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:27.146553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e3f8f-a205-4b6d-a4a3-d26735829486 None admin] PATH_INFO: `/v3/groups/c4c2ccd3233748b78095c4da4bcebf97` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:27.147940 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e3f8f-a205-4b6d-a4a3-d26735829486 None admin] RBAC: Authorizing `identity:get_group(group_id=c4c2ccd3233748b78095c4da4bcebf97)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:27.149365 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e3f8f-a205-4b6d-a4a3-d26735829486 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:27.149733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e669d-98bc-469f-b94b-885757eb260c None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:27.150985 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 186/373] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 14 00:51:26 2022] GET /identity/v3/groups/c4c2ccd3233748b78095c4da4bcebf97 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:27.152103 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e3f8f-a205-4b6d-a4a3-d26735829486 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:27.192660 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b496cb-c69e-4cb8-8557-828be7de99e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:27.193649 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b496cb-c69e-4cb8-8557-828be7de99e6 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:27.194176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b496cb-c69e-4cb8-8557-828be7de99e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:27.194665 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b496cb-c69e-4cb8-8557-828be7de99e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:27.195834 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b496cb-c69e-4cb8-8557-828be7de99e6 None admin] RBAC: Adding query filter params (group.id=c4c2ccd3233748b78095c4da4bcebf97, role.id=ee3984f710984de6bf564de3bee00d33, scope.project.id=3adf86e652e34928b6066fc3d75c468f) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:27.197230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b496cb-c69e-4cb8-8557-828be7de99e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:27.198910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b496cb-c69e-4cb8-8557-828be7de99e6 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:27.207264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 188/374] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Sep 14 00:51:27 2022] GET /identity/v3/role_assignments?group.id=c4c2ccd3233748b78095c4da4bcebf97&scope.project.id=3adf86e652e34928b6066fc3d75c468f&role.id=ee3984f710984de6bf564de3bee00d33 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:27.208333 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b496cb-c69e-4cb8-8557-828be7de99e6 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:27.282745 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e3f8f-a205-4b6d-a4a3-d26735829486 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:27.299382 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:27.313087 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:27.334374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50f24d-9ec9-41ab-b7a1-966752b1ad29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:27.335244 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50f24d-9ec9-41ab-b7a1-966752b1ad29 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:27.335528 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50f24d-9ec9-41ab-b7a1-966752b1ad29 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:27.335801 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50f24d-9ec9-41ab-b7a1-966752b1ad29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:27.337005 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50f24d-9ec9-41ab-b7a1-966752b1ad29 None admin] RBAC: Adding query filter params (role.id=79f3e2103ea3417a946a9e54a4ae30f3, user.id=e3970c7bc64647ebba754a7ba99dfc21, scope.system=all) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:27.337315 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50f24d-9ec9-41ab-b7a1-966752b1ad29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:27.339113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50f24d-9ec9-41ab-b7a1-966752b1ad29 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:27.340135 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b496cb-c69e-4cb8-8557-828be7de99e6 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:27.357910 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 187/375] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Sep 14 00:51:27 2022] GET /identity/v3/role_assignments?user.id=e3970c7bc64647ebba754a7ba99dfc21&scope.system=all&role.id=79f3e2103ea3417a946a9e54a4ae30f3 => generated 510 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:27.359997 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50f24d-9ec9-41ab-b7a1-966752b1ad29 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:27.408762 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab48230-35ee-4a63-a1dc-194dc948f7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:27.409791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab48230-35ee-4a63-a1dc-194dc948f7d1 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:27.410300 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab48230-35ee-4a63-a1dc-194dc948f7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:27.410762 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab48230-35ee-4a63-a1dc-194dc948f7d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:27.559677 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50f24d-9ec9-41ab-b7a1-966752b1ad29 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:27.583398 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab48230-35ee-4a63-a1dc-194dc948f7d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:27.584846 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab48230-35ee-4a63-a1dc-194dc948f7d1 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:27.618641 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003ccfd-3069-4464-81d0-bc2467e77887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:27.619849 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003ccfd-3069-4464-81d0-bc2467e77887 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:27.620585 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003ccfd-3069-4464-81d0-bc2467e77887 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:27.621473 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003ccfd-3069-4464-81d0-bc2467e77887 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:27.622738 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003ccfd-3069-4464-81d0-bc2467e77887 None admin] RBAC: Adding query filter params (group.id=c4c2ccd3233748b78095c4da4bcebf97, role.id=8373a23ee4ff4c7d94e82480d85b586b, scope.project.id=3adf86e652e34928b6066fc3d75c468f) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:27.623248 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003ccfd-3069-4464-81d0-bc2467e77887 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:27.625186 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003ccfd-3069-4464-81d0-bc2467e77887 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:27.632613 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 188/376] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Sep 14 00:51:27 2022] GET /identity/v3/role_assignments?group.id=c4c2ccd3233748b78095c4da4bcebf97&scope.project.id=3adf86e652e34928b6066fc3d75c468f&role.id=8373a23ee4ff4c7d94e82480d85b586b => generated 260 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:27.709388 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:27.738565 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 189/377] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:51:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:51:27.744157 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003ccfd-3069-4464-81d0-bc2467e77887 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:27.798938 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:27.891665 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003ccfd-3069-4464-81d0-bc2467e77887 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:27.939374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387aecb1-d821-4fec-bbf0-5a687739c959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:27.940352 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aecb1-d821-4fec-bbf0-5a687739c959 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:27.940845 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aecb1-d821-4fec-bbf0-5a687739c959 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:27.941311 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aecb1-d821-4fec-bbf0-5a687739c959 None admin] PATH_INFO: `/v3/projects/77e0a2fe229b4532ac18c75cfe42e13c` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:27.942727 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387aecb1-d821-4fec-bbf0-5a687739c959 None admin] RBAC: Authorizing `identity:get_project(project_id=77e0a2fe229b4532ac18c75cfe42e13c)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:27.944472 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387aecb1-d821-4fec-bbf0-5a687739c959 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:27.946636 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 189/378] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:27 2022] GET /identity/v3/projects/77e0a2fe229b4532ac18c75cfe42e13c => generated 344 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:27.952053 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab48230-35ee-4a63-a1dc-194dc948f7d1 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:28.002690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16169d-b3ae-4a3b-9888-ba90540cbb04 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:28.002977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16169d-b3ae-4a3b-9888-ba90540cbb04 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:28.003251 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16169d-b3ae-4a3b-9888-ba90540cbb04 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:28.008472 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 190/379] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:28.009932 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8748d85-7396-43f9-9559-98e3ea5fd2c3 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:28.010229 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8748d85-7396-43f9-9559-98e3ea5fd2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:28.010493 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8748d85-7396-43f9-9559-98e3ea5fd2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:28.030316 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-b8748d85-7396-43f9-9559-98e3ea5fd2c3 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:28.032088 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b8748d85-7396-43f9-9559-98e3ea5fd2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:28.145527 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab48230-35ee-4a63-a1dc-194dc948f7d1 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:28.161936 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 191/380] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 00:51:28.209211 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6fc36-8b0e-4eff-b39f-0da0c3d420d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:28.209868 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6fc36-8b0e-4eff-b39f-0da0c3d420d2 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:28.210154 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6fc36-8b0e-4eff-b39f-0da0c3d420d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:28.210410 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6fc36-8b0e-4eff-b39f-0da0c3d420d2 None admin] PATH_INFO: `/v3/groups/af60b7f7ae0a4fa58cafedab1240e305` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:28.222957 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6fc36-8b0e-4eff-b39f-0da0c3d420d2 None admin] RBAC: Authorizing `identity:get_group(group_id=af60b7f7ae0a4fa58cafedab1240e305)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:28.224405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6fc36-8b0e-4eff-b39f-0da0c3d420d2 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:28.226114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 190/381] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 14 00:51:27 2022] GET /identity/v3/groups/af60b7f7ae0a4fa58cafedab1240e305 => generated 229 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:28.232089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8748d85-7396-43f9-9559-98e3ea5fd2c3 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:28.295503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:28.393665 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8748d85-7396-43f9-9559-98e3ea5fd2c3 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:28.432596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e63482-0daf-4bb8-8ce9-3e6a12a16859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:28.433123 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e63482-0daf-4bb8-8ce9-3e6a12a16859 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:28.433401 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e63482-0daf-4bb8-8ce9-3e6a12a16859 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:28.433670 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e63482-0daf-4bb8-8ce9-3e6a12a16859 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:28.434416 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e63482-0daf-4bb8-8ce9-3e6a12a16859 None admin] RBAC: Adding query filter params (group.id=af60b7f7ae0a4fa58cafedab1240e305, role.id=0d7a36bda723430eae02f10f4c775c96, scope.project.id=77e0a2fe229b4532ac18c75cfe42e13c) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:28.434722 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e63482-0daf-4bb8-8ce9-3e6a12a16859 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:28.436148 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e63482-0daf-4bb8-8ce9-3e6a12a16859 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:28.446258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 192/382] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Sep 14 00:51:28 2022] GET /identity/v3/role_assignments?group.id=af60b7f7ae0a4fa58cafedab1240e305&scope.project.id=77e0a2fe229b4532ac18c75cfe42e13c&role.id=0d7a36bda723430eae02f10f4c775c96 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:28.506758 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6fc36-8b0e-4eff-b39f-0da0c3d420d2 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:28.565923 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:28.627782 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6fc36-8b0e-4eff-b39f-0da0c3d420d2 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:28.673154 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939e909-8232-42ef-90ef-8bd6efba291e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:28.673816 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939e909-8232-42ef-90ef-8bd6efba291e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:28.674113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939e909-8232-42ef-90ef-8bd6efba291e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:28.674383 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939e909-8232-42ef-90ef-8bd6efba291e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:28.688717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939e909-8232-42ef-90ef-8bd6efba291e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:28.694379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-a939e909-8232-42ef-90ef-8bd6efba291e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 00:51:28.694379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:28.694379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:28.694379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:28.694379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:28.694379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:28.694379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:28.694379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:28.694379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:28.694379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:28.694379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:28.694379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:28.694379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:28.694379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:28.694379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:28.694379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:28.695435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:28.695435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:28.695435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:28.695435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:28.695435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:28.695435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:28.695435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:28.695435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:28.695435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:28.695435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:28.695435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:28.695435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:28.695435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:28.695435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:28.695435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:28.695435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:28.696433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:28.696433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:28.696433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:28.696433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:28.696433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:28.696433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:28.696433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:28.696433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:28.696433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:28.696433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:28.696433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 00:51:28.696433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:28.698565 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 191/383] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 14 00:51:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:28.704589 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e63482-0daf-4bb8-8ce9-3e6a12a16859 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:28.842548 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:28.852110 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e63482-0daf-4bb8-8ce9-3e6a12a16859 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:28.894699 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e3541-4d9a-4962-bb5e-f00c838b01e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:28.895311 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e3541-4d9a-4962-bb5e-f00c838b01e9 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:28.895590 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e3541-4d9a-4962-bb5e-f00c838b01e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:28.895861 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e3541-4d9a-4962-bb5e-f00c838b01e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:28.896535 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e3541-4d9a-4962-bb5e-f00c838b01e9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:28.896837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e3541-4d9a-4962-bb5e-f00c838b01e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:28.898242 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e3541-4d9a-4962-bb5e-f00c838b01e9 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:28.913142 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 193/384] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:51:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:28.918262 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939e909-8232-42ef-90ef-8bd6efba291e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:29.064926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939e909-8232-42ef-90ef-8bd6efba291e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:29.072090 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:29.099667 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988c9e3-5fe2-400d-ba7f-47b1b6960664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:29.100299 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988c9e3-5fe2-400d-ba7f-47b1b6960664 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:29.100597 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988c9e3-5fe2-400d-ba7f-47b1b6960664 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:29.100844 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988c9e3-5fe2-400d-ba7f-47b1b6960664 None admin] PATH_INFO: `/v3/groups/c4c2ccd3233748b78095c4da4bcebf97` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:29.101966 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988c9e3-5fe2-400d-ba7f-47b1b6960664 None admin] RBAC: Authorizing `identity:get_group(group_id=c4c2ccd3233748b78095c4da4bcebf97)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:29.103445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988c9e3-5fe2-400d-ba7f-47b1b6960664 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:29.105377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 192/385] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 14 00:51:28 2022] GET /identity/v3/groups/c4c2ccd3233748b78095c4da4bcebf97 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:29.110623 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e3541-4d9a-4962-bb5e-f00c838b01e9 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:29.251316 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e3541-4d9a-4962-bb5e-f00c838b01e9 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:29.286832 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63014ab7-c68f-447a-a0d0-c5ca3b07d8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:29.287805 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63014ab7-c68f-447a-a0d0-c5ca3b07d8bd None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:29.288283 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63014ab7-c68f-447a-a0d0-c5ca3b07d8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:29.288773 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63014ab7-c68f-447a-a0d0-c5ca3b07d8bd None admin] PATH_INFO: `/v3/projects/6b02aee449a54bf3bb79025645d7f35e` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:29.290131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63014ab7-c68f-447a-a0d0-c5ca3b07d8bd None admin] RBAC: Authorizing `identity:get_project(project_id=6b02aee449a54bf3bb79025645d7f35e)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:29.291827 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63014ab7-c68f-447a-a0d0-c5ca3b07d8bd None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:29.294009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 194/386] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:29 2022] GET /identity/v3/projects/6b02aee449a54bf3bb79025645d7f35e => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:29.303111 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988c9e3-5fe2-400d-ba7f-47b1b6960664 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:29.450274 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988c9e3-5fe2-400d-ba7f-47b1b6960664 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:29.510776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b196849-712d-4888-9dff-a80af0707a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:29.511364 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b196849-712d-4888-9dff-a80af0707a77 None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:29.511644 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b196849-712d-4888-9dff-a80af0707a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:29.511917 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b196849-712d-4888-9dff-a80af0707a77 None admin] PATH_INFO: `/v3/projects/6b02aee449a54bf3bb79025645d7f35e/groups/c4c2ccd3233748b78095c4da4bcebf97/roles/8373a23ee4ff4c7d94e82480d85b586b` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:29.514818 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b196849-712d-4888-9dff-a80af0707a77 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b02aee449a54bf3bb79025645d7f35e, group_id=c4c2ccd3233748b78095c4da4bcebf97, role_id=8373a23ee4ff4c7d94e82480d85b586b)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:29.517253 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b196849-712d-4888-9dff-a80af0707a77 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:29.545680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 193/387] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Sep 14 00:51:29 2022] PUT /identity/v3/projects/6b02aee449a54bf3bb79025645d7f35e/groups/c4c2ccd3233748b78095c4da4bcebf97/roles/8373a23ee4ff4c7d94e82480d85b586b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 00:51:29.646898 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8a6f2-de18-47b7-ab0e-fdaaf2ff6724 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:29.647727 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8a6f2-de18-47b7-ab0e-fdaaf2ff6724 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:29.648210 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8a6f2-de18-47b7-ab0e-fdaaf2ff6724 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:29.649950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 195/388] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:29.655807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4420ce-f54e-42f5-8c11-40782b2e1e7a None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:29.656110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4420ce-f54e-42f5-8c11-40782b2e1e7a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:29.656387 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4420ce-f54e-42f5-8c11-40782b2e1e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:29.687796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-8a4420ce-f54e-42f5-8c11-40782b2e1e7a None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:29.689680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8a4420ce-f54e-42f5-8c11-40782b2e1e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:29.734707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:29.780276 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 194/389] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:30.172328 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbe93d-e2f2-41e8-881c-9605cf62c8d2 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:30.172822 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbe93d-e2f2-41e8-881c-9605cf62c8d2 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:30.172822 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbe93d-e2f2-41e8-881c-9605cf62c8d2 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:30.174368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 196/390] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:30.179613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fce5bc-272d-4df4-b496-89d4b26890cf None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:30.179990 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fce5bc-272d-4df4-b496-89d4b26890cf None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:30.180165 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fce5bc-272d-4df4-b496-89d4b26890cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:30.198318 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-13fce5bc-272d-4df4-b496-89d4b26890cf None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:30.199508 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-13fce5bc-272d-4df4-b496-89d4b26890cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:30.217608 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbe93d-e2f2-41e8-881c-9605cf62c8d2 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:30.253660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:30.336462 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 195/391] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 00:51:30.362449 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbe93d-e2f2-41e8-881c-9605cf62c8d2 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:30.408563 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145dab5-4d55-4c5e-9cf6-5388afe04493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:30.409192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145dab5-4d55-4c5e-9cf6-5388afe04493 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:30.409470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145dab5-4d55-4c5e-9cf6-5388afe04493 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:30.409740 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145dab5-4d55-4c5e-9cf6-5388afe04493 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:30.425345 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145dab5-4d55-4c5e-9cf6-5388afe04493 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:30.430608 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-3145dab5-4d55-4c5e-9cf6-5388afe04493 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:51:30.430608 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:30.430608 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:30.430608 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:30.430608 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:30.430608 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:30.430608 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:30.430608 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:30.430608 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:30.430608 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:30.430608 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:30.430608 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:30.430608 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:30.430608 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:30.430608 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:30.430608 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:30.431455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:30.431455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:30.431455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:30.431455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:30.431455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:30.431455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:30.431455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:30.431455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:30.431455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:30.431455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:30.431455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:30.431455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:30.431455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:30.431455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:30.431455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:30.431455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:30.432660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:30.432660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:30.432660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:30.432660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:30.432660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:30.432660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:30.432660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:30.432660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:30.432660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:30.432660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:30.432660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:51:30.432660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:30.432660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 197/392] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:30.437861 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fce5bc-272d-4df4-b496-89d4b26890cf None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:30.557170 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:30.564057 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fce5bc-272d-4df4-b496-89d4b26890cf None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:30.598966 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adefb9f-84fd-4074-af22-dc346f030315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:30.599579 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adefb9f-84fd-4074-af22-dc346f030315 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:30.599858 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adefb9f-84fd-4074-af22-dc346f030315 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:30.600126 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adefb9f-84fd-4074-af22-dc346f030315 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:30.600784 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adefb9f-84fd-4074-af22-dc346f030315 None admin] RBAC: Adding query filter params (name=member) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:30.601086 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adefb9f-84fd-4074-af22-dc346f030315 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:30.602470 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adefb9f-84fd-4074-af22-dc346f030315 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:30.611080 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 196/393] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 14 00:51:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:30.616668 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145dab5-4d55-4c5e-9cf6-5388afe04493 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:30.679477 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109c2c2-bdf8-45b8-986c-447c64ccfb06 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:30.679770 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109c2c2-bdf8-45b8-986c-447c64ccfb06 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:30.679990 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109c2c2-bdf8-45b8-986c-447c64ccfb06 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:30.681678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 197/394] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:30.687778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23c5d5-d8fa-4845-823b-3d2e12d3f6e3 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:30.688326 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23c5d5-d8fa-4845-823b-3d2e12d3f6e3 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:30.688797 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23c5d5-d8fa-4845-823b-3d2e12d3f6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:30.729455 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-6b23c5d5-d8fa-4845-823b-3d2e12d3f6e3 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:30.732248 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6b23c5d5-d8fa-4845-823b-3d2e12d3f6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:30.739982 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:30.773544 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145dab5-4d55-4c5e-9cf6-5388afe04493 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:30.812765 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466bfc4-181c-4916-a0fd-6b5df91010b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:30.813827 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466bfc4-181c-4916-a0fd-6b5df91010b4 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:30.814301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466bfc4-181c-4916-a0fd-6b5df91010b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:30.814761 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466bfc4-181c-4916-a0fd-6b5df91010b4 None admin] PATH_INFO: `/v3/groups/c4c2ccd3233748b78095c4da4bcebf97` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:30.816142 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466bfc4-181c-4916-a0fd-6b5df91010b4 None admin] RBAC: Authorizing `identity:get_group(group_id=c4c2ccd3233748b78095c4da4bcebf97)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:30.817906 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466bfc4-181c-4916-a0fd-6b5df91010b4 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:30.820160 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 198/395] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 14 00:51:30 2022] GET /identity/v3/groups/c4c2ccd3233748b78095c4da4bcebf97 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:30.821159 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466bfc4-181c-4916-a0fd-6b5df91010b4 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:30.828409 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 198/396] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:30.829328 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23c5d5-d8fa-4845-823b-3d2e12d3f6e3 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:30.930152 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466bfc4-181c-4916-a0fd-6b5df91010b4 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:30.943226 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:30.974486 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23c5d5-d8fa-4845-823b-3d2e12d3f6e3 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:30.991078 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607185e6-0b3a-4bb4-8980-f9fc6a5c07a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:30.991727 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607185e6-0b3a-4bb4-8980-f9fc6a5c07a3 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:30.992004 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607185e6-0b3a-4bb4-8980-f9fc6a5c07a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:30.992274 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607185e6-0b3a-4bb4-8980-f9fc6a5c07a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:31.010679 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607185e6-0b3a-4bb4-8980-f9fc6a5c07a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:31.016987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-607185e6-0b3a-4bb4-8980-f9fc6a5c07a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:51:31.016987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:31.016987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:31.016987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:31.016987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:31.016987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:31.016987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:31.016987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:31.016987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:31.016987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:31.016987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:31.016987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:31.016987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:31.016987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:31.016987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:31.016987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:31.017865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:31.017865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:31.017865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:31.017865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:31.017865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:31.017865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:31.017865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:31.017865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:31.017865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:31.017865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:31.017865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:31.017865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:31.017865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:31.017865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:31.017865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:31.017865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:31.018716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:31.018716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:31.018716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:31.018716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:31.018716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:31.018716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:31.018716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:31.018716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:31.018716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:31.018716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:31.018716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:51:31.018716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:31.018716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 199/397] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:31.024674 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607185e6-0b3a-4bb4-8980-f9fc6a5c07a3 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:31.042421 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:31.066814 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e806a28-ea94-4509-8b95-bfd625abc7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:31.067502 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e806a28-ea94-4509-8b95-bfd625abc7b8 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:31.067779 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e806a28-ea94-4509-8b95-bfd625abc7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:31.068049 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e806a28-ea94-4509-8b95-bfd625abc7b8 None admin] PATH_INFO: `/v3/projects/6b02aee449a54bf3bb79025645d7f35e` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:31.069214 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e806a28-ea94-4509-8b95-bfd625abc7b8 None admin] RBAC: Authorizing `identity:get_project(project_id=6b02aee449a54bf3bb79025645d7f35e)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:31.071095 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e806a28-ea94-4509-8b95-bfd625abc7b8 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:31.073812 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 199/398] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:30 2022] GET /identity/v3/projects/6b02aee449a54bf3bb79025645d7f35e => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:31.075333 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4353b-c073-4ca2-9fa4-18c229a863c5 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:31.075614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4353b-c073-4ca2-9fa4-18c229a863c5 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:31.075883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4353b-c073-4ca2-9fa4-18c229a863c5 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:31.077949 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 200/399] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:31.083088 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5c1e9-7290-4be8-a201-72b9b863b27c None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:31.083369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5c1e9-7290-4be8-a201-72b9b863b27c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:31.083642 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5c1e9-7290-4be8-a201-72b9b863b27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:31.106472 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-4db5c1e9-7290-4be8-a201-72b9b863b27c None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:31.108050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4db5c1e9-7290-4be8-a201-72b9b863b27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:31.134745 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607185e6-0b3a-4bb4-8980-f9fc6a5c07a3 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:31.170827 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b668a6-18f7-4707-8978-d368474d235b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:31.172056 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b668a6-18f7-4707-8978-d368474d235b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:31.172488 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b668a6-18f7-4707-8978-d368474d235b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:31.173012 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b668a6-18f7-4707-8978-d368474d235b None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:31.173545 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b668a6-18f7-4707-8978-d368474d235b None admin] RBAC: Adding query filter params (name=member) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:31.173968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b668a6-18f7-4707-8978-d368474d235b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:31.175571 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b668a6-18f7-4707-8978-d368474d235b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:31.187791 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 200/400] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 14 00:51:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:51:31.187791 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b668a6-18f7-4707-8978-d368474d235b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:31.188026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 201/401] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:31.207213 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5c1e9-7290-4be8-a201-72b9b863b27c None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:31.282185 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:31.305268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:31.309303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b668a6-18f7-4707-8978-d368474d235b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:31.326242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5c1e9-7290-4be8-a201-72b9b863b27c None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:31.346948 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd8aef-e3e6-424f-ae03-e235b9a01cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:31.347648 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd8aef-e3e6-424f-ae03-e235b9a01cb2 None admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:31.347923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd8aef-e3e6-424f-ae03-e235b9a01cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:31.348191 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd8aef-e3e6-424f-ae03-e235b9a01cb2 None admin] PATH_INFO: `/v3/projects/6b02aee449a54bf3bb79025645d7f35e/groups/c4c2ccd3233748b78095c4da4bcebf97/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:31.350141 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd8aef-e3e6-424f-ae03-e235b9a01cb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b02aee449a54bf3bb79025645d7f35e, group_id=c4c2ccd3233748b78095c4da4bcebf97, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:31.351562 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd8aef-e3e6-424f-ae03-e235b9a01cb2 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:31.365415 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 201/402] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Sep 14 00:51:31 2022] PUT /identity/v3/projects/6b02aee449a54bf3bb79025645d7f35e/groups/c4c2ccd3233748b78095c4da4bcebf97/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 00:51:31.365640 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ec7e1-33ff-4211-9565-1fb5c3b412ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:31.366117 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd8aef-e3e6-424f-ae03-e235b9a01cb2 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:31.366330 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ec7e1-33ff-4211-9565-1fb5c3b412ef None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:31.366614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ec7e1-33ff-4211-9565-1fb5c3b412ef None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:31.366890 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ec7e1-33ff-4211-9565-1fb5c3b412ef None admin] PATH_INFO: `/v3/groups/c4c2ccd3233748b78095c4da4bcebf97` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:31.368132 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ec7e1-33ff-4211-9565-1fb5c3b412ef None admin] RBAC: Authorizing `identity:get_group(group_id=c4c2ccd3233748b78095c4da4bcebf97)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:31.369865 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ec7e1-33ff-4211-9565-1fb5c3b412ef None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:31.371895 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 202/403] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 14 00:51:31 2022] GET /identity/v3/groups/c4c2ccd3233748b78095c4da4bcebf97 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:51:31.377776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ec7e1-33ff-4211-9565-1fb5c3b412ef None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:31.492980 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd8aef-e3e6-424f-ae03-e235b9a01cb2 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:31.506432 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ec7e1-33ff-4211-9565-1fb5c3b412ef None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:31.546123 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d69a2-70cc-4014-80a3-3e72ede0f3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:31.546850 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06572c19-2a0e-4c09-a1f0-81561f86b934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:31.546999 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d69a2-70cc-4014-80a3-3e72ede0f3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:31.547425 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d69a2-70cc-4014-80a3-3e72ede0f3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:31.547910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d69a2-70cc-4014-80a3-3e72ede0f3a1 None admin] PATH_INFO: `/v3/projects/3adf86e652e34928b6066fc3d75c468f` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:31.548314 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06572c19-2a0e-4c09-a1f0-81561f86b934 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:31.548976 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06572c19-2a0e-4c09-a1f0-81561f86b934 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:31.549459 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06572c19-2a0e-4c09-a1f0-81561f86b934 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:31.549770 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d69a2-70cc-4014-80a3-3e72ede0f3a1 None admin] RBAC: Authorizing `identity:get_project(project_id=3adf86e652e34928b6066fc3d75c468f)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:31.552723 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:31.552926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d69a2-70cc-4014-80a3-3e72ede0f3a1 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:31.556144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 203/404] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:31 2022] GET /identity/v3/projects/3adf86e652e34928b6066fc3d75c468f => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:31.557270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d69a2-70cc-4014-80a3-3e72ede0f3a1 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:31.565885 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06572c19-2a0e-4c09-a1f0-81561f86b934 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:31.571830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-06572c19-2a0e-4c09-a1f0-81561f86b934 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 00:51:31.571830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:31.571830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:31.571830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:31.571830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:31.571830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:31.571830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:31.571830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:31.571830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:31.571830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:31.571830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:31.571830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:31.571830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:31.571830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:31.571830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:31.571830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:31.572748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:31.572748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:31.572748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:31.572748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:31.572748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:31.572748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:31.572748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:31.572748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:31.572748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:31.572748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:31.572748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:31.572748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:31.572748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:31.572748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:31.572748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:31.572748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:31.573512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:31.573512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:31.573512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:31.573512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:31.573512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:31.573512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:31.573512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:31.573512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:31.573512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:31.573512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:31.573512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 00:51:31.573512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:31.576405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 202/405] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 14 00:51:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:31.577626 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06572c19-2a0e-4c09-a1f0-81561f86b934 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:31.586624 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:31.679338 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d69a2-70cc-4014-80a3-3e72ede0f3a1 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:31.696804 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06572c19-2a0e-4c09-a1f0-81561f86b934 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:31.723001 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd8d26-dc17-4b65-811d-6b9bf4b1910c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:31.724029 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd8d26-dc17-4b65-811d-6b9bf4b1910c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:31.724534 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd8d26-dc17-4b65-811d-6b9bf4b1910c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:31.725172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd8d26-dc17-4b65-811d-6b9bf4b1910c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:31.738325 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd8d26-dc17-4b65-811d-6b9bf4b1910c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:31.740223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354a034-1dac-43a2-90ac-6405ac8e2a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:31.740884 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354a034-1dac-43a2-90ac-6405ac8e2a2f None admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:31.741164 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354a034-1dac-43a2-90ac-6405ac8e2a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:31.741446 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354a034-1dac-43a2-90ac-6405ac8e2a2f None admin] PATH_INFO: `/v3/projects/3adf86e652e34928b6066fc3d75c468f/groups/c4c2ccd3233748b78095c4da4bcebf97/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:31.743527 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354a034-1dac-43a2-90ac-6405ac8e2a2f None admin] RBAC: Authorizing `identity:create_grant(project_id=3adf86e652e34928b6066fc3d75c468f, group_id=c4c2ccd3233748b78095c4da4bcebf97, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:31.744925 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354a034-1dac-43a2-90ac-6405ac8e2a2f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:31.745953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-26fd8d26-dc17-4b65-811d-6b9bf4b1910c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:51:31.745953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:31.745953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:31.745953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:31.745953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:31.745953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:31.745953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:31.745953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:31.745953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:31.745953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:31.745953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:31.745953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:31.745953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:31.745953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:31.745953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:31.745953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:31.746776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:31.746776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:31.746776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:31.746776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:31.746776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:31.746776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:31.746776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:31.746776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:31.746776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:31.746776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:31.746776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:31.746776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:31.746776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:31.746776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:31.746776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:31.746776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:31.747536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:31.747536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:31.747536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:31.747536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:31.747536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:31.747536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:31.747536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:31.747536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:31.747536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:31.747536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:31.747536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:51:31.747536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:31.750431 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 204/406] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:51:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:31.751372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd8d26-dc17-4b65-811d-6b9bf4b1910c None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:31.763995 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 203/407] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Sep 14 00:51:31 2022] PUT /identity/v3/projects/3adf86e652e34928b6066fc3d75c468f/groups/c4c2ccd3233748b78095c4da4bcebf97/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 00:51:31.765777 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354a034-1dac-43a2-90ac-6405ac8e2a2f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:31.869958 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:31.894716 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:31.938934 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd8d26-dc17-4b65-811d-6b9bf4b1910c None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:31.967793 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354a034-1dac-43a2-90ac-6405ac8e2a2f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:31.981767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a2647-d5c6-43ee-96d0-03a12f7e7a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:31.982409 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a2647-d5c6-43ee-96d0-03a12f7e7a60 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:31.985885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a2647-d5c6-43ee-96d0-03a12f7e7a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:31.985885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a2647-d5c6-43ee-96d0-03a12f7e7a60 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:31.985885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a2647-d5c6-43ee-96d0-03a12f7e7a60 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:31.985885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a2647-d5c6-43ee-96d0-03a12f7e7a60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:31.986326 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a2647-d5c6-43ee-96d0-03a12f7e7a60 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:31.999483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 205/408] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:51:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:32.004081 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a2647-d5c6-43ee-96d0-03a12f7e7a60 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:32.006609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba8643-fee9-48b4-9e98-94ff9bef2a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:32.007209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba8643-fee9-48b4-9e98-94ff9bef2a99 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:32.007486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba8643-fee9-48b4-9e98-94ff9bef2a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:32.007755 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba8643-fee9-48b4-9e98-94ff9bef2a99 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:32.008421 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba8643-fee9-48b4-9e98-94ff9bef2a99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:32.008722 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba8643-fee9-48b4-9e98-94ff9bef2a99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:32.011670 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba8643-fee9-48b4-9e98-94ff9bef2a99 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:32.022597 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 204/409] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:32.029180 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba8643-fee9-48b4-9e98-94ff9bef2a99 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:32.135950 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a2647-d5c6-43ee-96d0-03a12f7e7a60 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:32.145155 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba8643-fee9-48b4-9e98-94ff9bef2a99 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:32.162643 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:32.179389 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453feb75-8603-4790-9154-52905369a404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:32.180331 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453feb75-8603-4790-9154-52905369a404 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:32.180881 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453feb75-8603-4790-9154-52905369a404 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:32.181163 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453feb75-8603-4790-9154-52905369a404 None admin] PATH_INFO: `/v3/groups/c4c2ccd3233748b78095c4da4bcebf97` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:32.182301 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453feb75-8603-4790-9154-52905369a404 None admin] RBAC: Authorizing `identity:get_group(group_id=c4c2ccd3233748b78095c4da4bcebf97)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:32.183723 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453feb75-8603-4790-9154-52905369a404 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:32.184532 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8c796-8d07-40dc-a9ef-d60e9587ffcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:32.185156 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8c796-8d07-40dc-a9ef-d60e9587ffcc None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:32.185503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8c796-8d07-40dc-a9ef-d60e9587ffcc None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:32.185752 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 206/410] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 14 00:51:32 2022] GET /identity/v3/groups/c4c2ccd3233748b78095c4da4bcebf97 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:32.185895 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8c796-8d07-40dc-a9ef-d60e9587ffcc None admin] PATH_INFO: `/v3/groups/af60b7f7ae0a4fa58cafedab1240e305` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:32.186928 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8c796-8d07-40dc-a9ef-d60e9587ffcc None admin] RBAC: Authorizing `identity:get_group(group_id=af60b7f7ae0a4fa58cafedab1240e305)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:32.187548 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29642022-e426-4b4f-b935-c11949f29692 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:32.187861 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29642022-e426-4b4f-b935-c11949f29692 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:32.188140 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29642022-e426-4b4f-b935-c11949f29692 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:32.189170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8c796-8d07-40dc-a9ef-d60e9587ffcc None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:32.189558 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 207/411] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:32.191000 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 205/412] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 14 00:51:32 2022] GET /identity/v3/groups/af60b7f7ae0a4fa58cafedab1240e305 => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:32.195982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29642022-e426-4b4f-b935-c11949f29692 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:32.196416 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcf2f2-28d6-4049-908e-962927455d57 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:32.196701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcf2f2-28d6-4049-908e-962927455d57 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:32.196975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcf2f2-28d6-4049-908e-962927455d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:32.210739 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:32.221955 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-9fbcf2f2-28d6-4049-908e-962927455d57 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:32.224131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9fbcf2f2-28d6-4049-908e-962927455d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:32.312934 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 206/413] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:32.314115 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbcf2f2-28d6-4049-908e-962927455d57 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:32.323327 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29642022-e426-4b4f-b935-c11949f29692 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:32.389959 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b75dde-262a-4635-b361-9546773149a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:32.390992 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b75dde-262a-4635-b361-9546773149a7 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:32.392600 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b75dde-262a-4635-b361-9546773149a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:32.393052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b75dde-262a-4635-b361-9546773149a7 None admin] PATH_INFO: `/v3/projects/3adf86e652e34928b6066fc3d75c468f` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:32.395497 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b75dde-262a-4635-b361-9546773149a7 None admin] RBAC: Authorizing `identity:get_project(project_id=3adf86e652e34928b6066fc3d75c468f)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:32.397103 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b75dde-262a-4635-b361-9546773149a7 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:32.399882 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 208/414] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:32 2022] GET /identity/v3/projects/3adf86e652e34928b6066fc3d75c468f => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:32.405684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b75dde-262a-4635-b361-9546773149a7 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:32.505950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbcf2f2-28d6-4049-908e-962927455d57 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:32.532439 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:32.556160 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb899b0-7057-4fa2-a9ab-80c6ccb5a70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:32.556836 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb899b0-7057-4fa2-a9ab-80c6ccb5a70a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:32.557108 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb899b0-7057-4fa2-a9ab-80c6ccb5a70a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:32.557373 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb899b0-7057-4fa2-a9ab-80c6ccb5a70a None admin] PATH_INFO: `/v3/projects/77e0a2fe229b4532ac18c75cfe42e13c` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:32.558092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:32.558833 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb899b0-7057-4fa2-a9ab-80c6ccb5a70a None admin] RBAC: Authorizing `identity:get_project(project_id=77e0a2fe229b4532ac18c75cfe42e13c)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:32.560154 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb899b0-7057-4fa2-a9ab-80c6ccb5a70a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:32.566706 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 207/415] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:32 2022] GET /identity/v3/projects/77e0a2fe229b4532ac18c75cfe42e13c => generated 344 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:32.567497 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb899b0-7057-4fa2-a9ab-80c6ccb5a70a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:32.599357 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b75dde-262a-4635-b361-9546773149a7 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:32.654238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18249778-5145-4cbe-b043-b33d830d8e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:32.655201 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18249778-5145-4cbe-b043-b33d830d8e29 None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:32.655487 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18249778-5145-4cbe-b043-b33d830d8e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:32.655995 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18249778-5145-4cbe-b043-b33d830d8e29 None admin] PATH_INFO: `/v3/projects/3adf86e652e34928b6066fc3d75c468f/groups/c4c2ccd3233748b78095c4da4bcebf97/roles/8373a23ee4ff4c7d94e82480d85b586b` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:32.658347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18249778-5145-4cbe-b043-b33d830d8e29 None admin] RBAC: Authorizing `identity:create_grant(project_id=3adf86e652e34928b6066fc3d75c468f, group_id=c4c2ccd3233748b78095c4da4bcebf97, role_id=8373a23ee4ff4c7d94e82480d85b586b)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:32.659893 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18249778-5145-4cbe-b043-b33d830d8e29 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:32.677307 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 209/416] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Sep 14 00:51:32 2022] PUT /identity/v3/projects/3adf86e652e34928b6066fc3d75c468f/groups/c4c2ccd3233748b78095c4da4bcebf97/roles/8373a23ee4ff4c7d94e82480d85b586b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 00:51:32.685837 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18249778-5145-4cbe-b043-b33d830d8e29 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:32.686029 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb899b0-7057-4fa2-a9ab-80c6ccb5a70a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:32.777571 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0d42c-bf27-4db7-821c-2e9a0ab38606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:32.778272 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0d42c-bf27-4db7-821c-2e9a0ab38606 None admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:32.778600 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0d42c-bf27-4db7-821c-2e9a0ab38606 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:32.778873 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0d42c-bf27-4db7-821c-2e9a0ab38606 None admin] PATH_INFO: `/v3/projects/77e0a2fe229b4532ac18c75cfe42e13c/groups/af60b7f7ae0a4fa58cafedab1240e305/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:32.782743 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0d42c-bf27-4db7-821c-2e9a0ab38606 None admin] RBAC: Authorizing `identity:create_grant(project_id=77e0a2fe229b4532ac18c75cfe42e13c, group_id=af60b7f7ae0a4fa58cafedab1240e305, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:32.784207 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0d42c-bf27-4db7-821c-2e9a0ab38606 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:32.809609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 208/417] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Sep 14 00:51:32 2022] PUT /identity/v3/projects/77e0a2fe229b4532ac18c75cfe42e13c/groups/af60b7f7ae0a4fa58cafedab1240e305/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 00:51:32.860093 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18249778-5145-4cbe-b043-b33d830d8e29 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:32.919339 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8adce9b-8a6a-428a-8155-501121ac7b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:32.920006 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8adce9b-8a6a-428a-8155-501121ac7b8c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:32.920286 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8adce9b-8a6a-428a-8155-501121ac7b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:32.920558 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8adce9b-8a6a-428a-8155-501121ac7b8c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:32.929387 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:32.939014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8adce9b-8a6a-428a-8155-501121ac7b8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:32.944356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-d8adce9b-8a6a-428a-8155-501121ac7b8c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 00:51:32.944356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:32.944356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:32.944356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:32.944356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:32.944356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:32.944356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:32.944356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:32.944356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:32.944356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:32.944356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:32.944356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:32.944356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:32.944356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:32.944356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:32.944356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:32.945451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:32.945451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:32.945451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:32.945451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:32.945451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:32.945451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:32.945451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:32.945451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:32.945451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:32.945451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:32.945451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:32.945451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:32.945451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:32.945451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:32.945451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:32.945451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:32.946458 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:32.946458 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:32.946458 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:32.946458 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:32.946458 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:32.946458 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:32.946458 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:32.946458 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:32.946458 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:32.946458 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:32.946458 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 00:51:32.946458 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:32.949078 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 210/418] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 14 00:51:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:32.955035 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0d42c-bf27-4db7-821c-2e9a0ab38606 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:33.021491 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:33.085642 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0d42c-bf27-4db7-821c-2e9a0ab38606 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:33.120706 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed218e9-2c36-4361-beb7-dadd37006dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:33.121273 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed218e9-2c36-4361-beb7-dadd37006dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:33.121549 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed218e9-2c36-4361-beb7-dadd37006dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:33.121830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed218e9-2c36-4361-beb7-dadd37006dd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:33.122491 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed218e9-2c36-4361-beb7-dadd37006dd3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:33.122786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed218e9-2c36-4361-beb7-dadd37006dd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:33.124151 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed218e9-2c36-4361-beb7-dadd37006dd3 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:33.133321 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 209/419] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:51:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:33.139180 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8adce9b-8a6a-428a-8155-501121ac7b8c None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:33.273625 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8adce9b-8a6a-428a-8155-501121ac7b8c None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:33.315788 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be89de-e5bb-41d7-902c-b4f290eaa4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:33.316392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be89de-e5bb-41d7-902c-b4f290eaa4d3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:33.316666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be89de-e5bb-41d7-902c-b4f290eaa4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:33.316933 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be89de-e5bb-41d7-902c-b4f290eaa4d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:33.398254 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:33.400385 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be89de-e5bb-41d7-902c-b4f290eaa4d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:33.402327 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be89de-e5bb-41d7-902c-b4f290eaa4d3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:33.533554 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 211/420] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:51:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:51:33.538969 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed218e9-2c36-4361-beb7-dadd37006dd3 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:33.690356 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed218e9-2c36-4361-beb7-dadd37006dd3 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:33.698876 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:33.742556 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fbf66-2065-4b3c-8a62-9888bd1fc234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:33.743187 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fbf66-2065-4b3c-8a62-9888bd1fc234 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:33.743466 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fbf66-2065-4b3c-8a62-9888bd1fc234 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:33.743734 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fbf66-2065-4b3c-8a62-9888bd1fc234 None admin] PATH_INFO: `/v3/projects/6b02aee449a54bf3bb79025645d7f35e` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:33.744859 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fbf66-2065-4b3c-8a62-9888bd1fc234 None admin] RBAC: Authorizing `identity:get_project(project_id=6b02aee449a54bf3bb79025645d7f35e)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:33.746333 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fbf66-2065-4b3c-8a62-9888bd1fc234 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:33.749214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 210/421] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:33 2022] GET /identity/v3/projects/6b02aee449a54bf3bb79025645d7f35e => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:33.754655 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be89de-e5bb-41d7-902c-b4f290eaa4d3 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:33.893120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:33.896835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be89de-e5bb-41d7-902c-b4f290eaa4d3 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:33.942124 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a51ac1-385a-44c8-901f-b250297c49f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:33.942681 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a51ac1-385a-44c8-901f-b250297c49f0 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:33.942958 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a51ac1-385a-44c8-901f-b250297c49f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:33.943220 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a51ac1-385a-44c8-901f-b250297c49f0 None admin] PATH_INFO: `/v3/groups/c4c2ccd3233748b78095c4da4bcebf97` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:33.944333 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a51ac1-385a-44c8-901f-b250297c49f0 None admin] RBAC: Authorizing `identity:get_group(group_id=c4c2ccd3233748b78095c4da4bcebf97)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:33.945763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a51ac1-385a-44c8-901f-b250297c49f0 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:33.947360 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 212/422] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 14 00:51:33 2022] GET /identity/v3/groups/c4c2ccd3233748b78095c4da4bcebf97 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:33.954128 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fbf66-2065-4b3c-8a62-9888bd1fc234 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:34.092488 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fbf66-2065-4b3c-8a62-9888bd1fc234 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:34.140956 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb31c48-4a3a-4250-b4e6-da381a8340d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:34.141605 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb31c48-4a3a-4250-b4e6-da381a8340d8 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:34.141909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb31c48-4a3a-4250-b4e6-da381a8340d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:34.142226 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb31c48-4a3a-4250-b4e6-da381a8340d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:34.142957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb31c48-4a3a-4250-b4e6-da381a8340d8 None admin] RBAC: Adding query filter params (group.id=c4c2ccd3233748b78095c4da4bcebf97, role.id=8373a23ee4ff4c7d94e82480d85b586b, scope.project.id=6b02aee449a54bf3bb79025645d7f35e) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:34.143260 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb31c48-4a3a-4250-b4e6-da381a8340d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:34.144690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb31c48-4a3a-4250-b4e6-da381a8340d8 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:34.155610 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 211/423] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Sep 14 00:51:33 2022] GET /identity/v3/role_assignments?group.id=c4c2ccd3233748b78095c4da4bcebf97&scope.project.id=6b02aee449a54bf3bb79025645d7f35e&role.id=8373a23ee4ff4c7d94e82480d85b586b => generated 611 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:34.302016 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbb890-91e3-4b8d-be67-4212e8c84b80 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:34.302546 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbb890-91e3-4b8d-be67-4212e8c84b80 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:34.302546 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbb890-91e3-4b8d-be67-4212e8c84b80 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:34.304247 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 213/424] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:34.316478 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261f7fb-dcea-40ab-8b2e-3a9bca01de15 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:34.316787 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261f7fb-dcea-40ab-8b2e-3a9bca01de15 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:34.317032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261f7fb-dcea-40ab-8b2e-3a9bca01de15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:34.338496 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-7261f7fb-dcea-40ab-8b2e-3a9bca01de15 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:34.339680 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7261f7fb-dcea-40ab-8b2e-3a9bca01de15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:34.382828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:34.435781 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 212/425] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:34.520902 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9978f-bbc0-4eb0-b807-0374b93549cd None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:34.521369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9978f-bbc0-4eb0-b807-0374b93549cd None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:34.521955 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9978f-bbc0-4eb0-b807-0374b93549cd None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:34.524099 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 214/426] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 00:51:34.532045 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b52001-2dea-4769-b459-41100ccb03be None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:34.532546 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b52001-2dea-4769-b459-41100ccb03be None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:34.532913 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b52001-2dea-4769-b459-41100ccb03be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:34.555235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-13b52001-2dea-4769-b459-41100ccb03be None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:34.556338 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-13b52001-2dea-4769-b459-41100ccb03be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:34.627196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 213/427] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:34.757926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9978f-bbc0-4eb0-b807-0374b93549cd None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:34.871227 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9978f-bbc0-4eb0-b807-0374b93549cd None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:34.906856 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb69b94-ada7-41ec-aaf3-72582d023381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:34.907484 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb69b94-ada7-41ec-aaf3-72582d023381 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:34.907767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb69b94-ada7-41ec-aaf3-72582d023381 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:34.908036 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb69b94-ada7-41ec-aaf3-72582d023381 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:34.919135 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b52001-2dea-4769-b459-41100ccb03be None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:34.922033 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb69b94-ada7-41ec-aaf3-72582d023381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:34.926231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-6fb69b94-ada7-41ec-aaf3-72582d023381 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:51:34.926231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:34.926231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:34.926231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:34.926231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:34.926231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:34.926231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:34.926231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:34.926231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:34.926231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:34.926231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:34.926231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:34.926231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:34.926231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:34.926231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:34.926231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:34.927181 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:34.927181 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:34.927181 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:34.927181 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:34.927181 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:34.927181 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:34.927181 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:34.927181 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:34.927181 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:34.927181 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:34.927181 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:34.927181 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:34.927181 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:34.927181 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:34.927181 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:34.927181 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:34.928651 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:34.928651 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:34.928651 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:34.928651 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:34.928651 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:34.928651 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:34.928651 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:34.928651 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:34.928651 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:34.928651 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:34.928651 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:51:34.928651 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:34.928651 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 215/428] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:34.934904 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb69b94-ada7-41ec-aaf3-72582d023381 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:34.963838 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:35.048873 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb69b94-ada7-41ec-aaf3-72582d023381 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:35.059203 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:35.067547 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b52001-2dea-4769-b459-41100ccb03be None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:35.087705 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932ab4b-dce7-4dd3-9660-0c318389a1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:35.088684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932ab4b-dce7-4dd3-9660-0c318389a1af None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:35.089100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932ab4b-dce7-4dd3-9660-0c318389a1af None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:35.089515 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932ab4b-dce7-4dd3-9660-0c318389a1af None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:35.090389 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932ab4b-dce7-4dd3-9660-0c318389a1af None admin] RBAC: Adding query filter params (name=member) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:35.090827 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932ab4b-dce7-4dd3-9660-0c318389a1af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:35.092379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932ab4b-dce7-4dd3-9660-0c318389a1af None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:35.106945 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 216/429] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 14 00:51:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:35.107577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932ab4b-dce7-4dd3-9660-0c318389a1af None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:35.111521 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d8a82-549e-4a5e-9047-146ed62a7d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:35.113116 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d8a82-549e-4a5e-9047-146ed62a7d53 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:35.113394 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d8a82-549e-4a5e-9047-146ed62a7d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:35.113667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d8a82-549e-4a5e-9047-146ed62a7d53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:35.127479 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d8a82-549e-4a5e-9047-146ed62a7d53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:35.133795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-9a9d8a82-549e-4a5e-9047-146ed62a7d53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:51:35.133795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:35.133795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:35.133795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:35.133795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:35.133795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:35.133795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:35.133795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:35.133795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:35.133795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:35.133795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:35.133795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:35.133795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:35.133795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:35.133795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:35.133795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:35.134678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:35.134678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:35.134678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:35.134678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:35.134678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:35.134678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:35.134678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:35.134678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:35.134678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:35.134678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:35.134678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:35.134678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:35.134678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:35.134678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:35.134678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:35.134678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:35.135516 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:35.135516 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:35.135516 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:35.135516 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:35.135516 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:35.135516 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:35.135516 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:35.135516 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:35.135516 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:35.135516 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:35.135516 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 00:51:35.135516 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:35.135516 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 214/430] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:35.140814 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d8a82-549e-4a5e-9047-146ed62a7d53 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:35.216904 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:35.234069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932ab4b-dce7-4dd3-9660-0c318389a1af None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:35.272973 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d8a82-549e-4a5e-9047-146ed62a7d53 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:35.278874 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096b0aa-0780-4f9f-aa90-b3196e31a718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:35.279968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096b0aa-0780-4f9f-aa90-b3196e31a718 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:35.280398 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096b0aa-0780-4f9f-aa90-b3196e31a718 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:35.281426 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096b0aa-0780-4f9f-aa90-b3196e31a718 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:35.312727 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480da29-16d2-4383-8bce-5186161fb51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:35.313031 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480da29-16d2-4383-8bce-5186161fb51a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:35.313310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480da29-16d2-4383-8bce-5186161fb51a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:35.313584 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480da29-16d2-4383-8bce-5186161fb51a None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:35.314301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480da29-16d2-4383-8bce-5186161fb51a None admin] RBAC: Adding query filter params (name=member) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:35.314604 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480da29-16d2-4383-8bce-5186161fb51a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:35.316023 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480da29-16d2-4383-8bce-5186161fb51a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:35.325496 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 215/431] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 14 00:51:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:35.331169 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480da29-16d2-4383-8bce-5186161fb51a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:35.351490 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:35.364333 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096b0aa-0780-4f9f-aa90-b3196e31a718 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:35.365776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096b0aa-0780-4f9f-aa90-b3196e31a718 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:35.441687 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480da29-16d2-4383-8bce-5186161fb51a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:35.462058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:35.474798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062521d6-4f82-4d2f-9fee-3cd741919f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:35.475391 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062521d6-4f82-4d2f-9fee-3cd741919f8e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:35.475596 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 217/432] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:51:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 00:51:35.475694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062521d6-4f82-4d2f-9fee-3cd741919f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:35.475924 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062521d6-4f82-4d2f-9fee-3cd741919f8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:35.476880 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7706cb-4077-44dc-95e1-6d81a042e9be None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:35.477170 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7706cb-4077-44dc-95e1-6d81a042e9be None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:35.477443 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7706cb-4077-44dc-95e1-6d81a042e9be None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:35.478697 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 218/433] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:35.479707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10ea17-e932-4d2e-9ba5-62ef6b88cdec None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:35.480173 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10ea17-e932-4d2e-9ba5-62ef6b88cdec None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:35.480461 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10ea17-e932-4d2e-9ba5-62ef6b88cdec None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:35.481627 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 219/434] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:35.482402 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10ea17-e932-4d2e-9ba5-62ef6b88cdec None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:35.550254 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062521d6-4f82-4d2f-9fee-3cd741919f8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:35.551694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062521d6-4f82-4d2f-9fee-3cd741919f8e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:35.570785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:35.586054 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10ea17-e932-4d2e-9ba5-62ef6b88cdec None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:35.618713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c652e2a-ee63-4cf7-927f-48c4dc9d4a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:35.619329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c652e2a-ee63-4cf7-927f-48c4dc9d4a53 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:35.619607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c652e2a-ee63-4cf7-927f-48c4dc9d4a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:35.619881 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c652e2a-ee63-4cf7-927f-48c4dc9d4a53 None admin] PATH_INFO: `/v3/projects/6b02aee449a54bf3bb79025645d7f35e` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:35.621016 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c652e2a-ee63-4cf7-927f-48c4dc9d4a53 None admin] RBAC: Authorizing `identity:get_project(project_id=6b02aee449a54bf3bb79025645d7f35e)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:35.622479 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c652e2a-ee63-4cf7-927f-48c4dc9d4a53 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:35.624086 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 220/435] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:35 2022] GET /identity/v3/projects/6b02aee449a54bf3bb79025645d7f35e => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:35.625203 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975ea21-1d37-4e5a-935d-d8d22beb36ae None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:35.625482 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975ea21-1d37-4e5a-935d-d8d22beb36ae None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:35.625748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975ea21-1d37-4e5a-935d-d8d22beb36ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:35.643145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-8975ea21-1d37-4e5a-935d-d8d22beb36ae None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:35.644326 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8975ea21-1d37-4e5a-935d-d8d22beb36ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:35.659009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 216/436] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:51:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:51:35.659009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f84e17-a6d7-444c-8681-773bcc476b72 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:35.659009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f84e17-a6d7-444c-8681-773bcc476b72 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:35.659009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f84e17-a6d7-444c-8681-773bcc476b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:35.675973 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-13f84e17-a6d7-444c-8681-773bcc476b72 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:35.677129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-13f84e17-a6d7-444c-8681-773bcc476b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:35.694638 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:35.711460 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 221/437] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:35.712269 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975ea21-1d37-4e5a-935d-d8d22beb36ae None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:35.753032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 217/438] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:35.754661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f84e17-a6d7-444c-8681-773bcc476b72 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:35.828518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:35.831591 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975ea21-1d37-4e5a-935d-d8d22beb36ae None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:35.870394 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9aaed-3bf1-40a4-a626-aa7b3672d094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:35.871367 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9aaed-3bf1-40a4-a626-aa7b3672d094 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:35.871854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9aaed-3bf1-40a4-a626-aa7b3672d094 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:35.872319 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9aaed-3bf1-40a4-a626-aa7b3672d094 None admin] PATH_INFO: `/v3/groups/c4c2ccd3233748b78095c4da4bcebf97` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:35.874155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9aaed-3bf1-40a4-a626-aa7b3672d094 None admin] RBAC: Authorizing `identity:get_group(group_id=c4c2ccd3233748b78095c4da4bcebf97)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:35.876446 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9aaed-3bf1-40a4-a626-aa7b3672d094 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:35.879270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 222/439] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 14 00:51:35 2022] GET /identity/v3/groups/c4c2ccd3233748b78095c4da4bcebf97 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:35.884845 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9aaed-3bf1-40a4-a626-aa7b3672d094 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:35.890622 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f84e17-a6d7-444c-8681-773bcc476b72 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:35.933852 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3e8cb-6aa9-42af-b428-8a8b1764e022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:35.934478 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3e8cb-6aa9-42af-b428-8a8b1764e022 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:35.934805 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3e8cb-6aa9-42af-b428-8a8b1764e022 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:35.935074 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3e8cb-6aa9-42af-b428-8a8b1764e022 None admin] PATH_INFO: `/v3/projects/3adf86e652e34928b6066fc3d75c468f` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:35.936640 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3e8cb-6aa9-42af-b428-8a8b1764e022 None admin] RBAC: Authorizing `identity:get_project(project_id=3adf86e652e34928b6066fc3d75c468f)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:35.938720 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3e8cb-6aa9-42af-b428-8a8b1764e022 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:35.945391 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 218/440] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:35 2022] GET /identity/v3/projects/3adf86e652e34928b6066fc3d75c468f => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:35.946857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3e8cb-6aa9-42af-b428-8a8b1764e022 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:35.956141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:36.008765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9aaed-3bf1-40a4-a626-aa7b3672d094 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:36.043972 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057e0f4-c80c-4cd5-8094-54c9c510c18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:36.044573 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057e0f4-c80c-4cd5-8094-54c9c510c18f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:36.044855 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057e0f4-c80c-4cd5-8094-54c9c510c18f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:36.045123 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057e0f4-c80c-4cd5-8094-54c9c510c18f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:36.045857 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d057e0f4-c80c-4cd5-8094-54c9c510c18f None admin] RBAC: Adding query filter params (group.id=c4c2ccd3233748b78095c4da4bcebf97, role.id=ee3984f710984de6bf564de3bee00d33, scope.project.id=6b02aee449a54bf3bb79025645d7f35e) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:36.046993 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d057e0f4-c80c-4cd5-8094-54c9c510c18f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:36.048225 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d057e0f4-c80c-4cd5-8094-54c9c510c18f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:36.060300 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 223/441] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Sep 14 00:51:35 2022] GET /identity/v3/role_assignments?group.id=c4c2ccd3233748b78095c4da4bcebf97&scope.project.id=6b02aee449a54bf3bb79025645d7f35e&role.id=ee3984f710984de6bf564de3bee00d33 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:51:36.060300 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057e0f4-c80c-4cd5-8094-54c9c510c18f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:36.060617 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3e8cb-6aa9-42af-b428-8a8b1764e022 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:36.079643 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:36.105360 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd9de4-43d3-4cfd-a21a-7d979481e99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:36.106164 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd9de4-43d3-4cfd-a21a-7d979481e99f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:36.106442 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd9de4-43d3-4cfd-a21a-7d979481e99f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:36.106969 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd9de4-43d3-4cfd-a21a-7d979481e99f None admin] PATH_INFO: `/v3/groups/c4c2ccd3233748b78095c4da4bcebf97` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:36.108624 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd9de4-43d3-4cfd-a21a-7d979481e99f None admin] RBAC: Authorizing `identity:get_group(group_id=c4c2ccd3233748b78095c4da4bcebf97)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:36.110246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd9de4-43d3-4cfd-a21a-7d979481e99f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:36.114003 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 219/442] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 14 00:51:35 2022] GET /identity/v3/groups/c4c2ccd3233748b78095c4da4bcebf97 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:51:36.115216 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd9de4-43d3-4cfd-a21a-7d979481e99f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:36.168508 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057e0f4-c80c-4cd5-8094-54c9c510c18f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:36.187145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:36.207442 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaccdb8-562f-4431-aebc-47a178f89871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:36.207992 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaccdb8-562f-4431-aebc-47a178f89871 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:36.208269 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaccdb8-562f-4431-aebc-47a178f89871 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:36.208583 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaccdb8-562f-4431-aebc-47a178f89871 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:36.221231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaccdb8-562f-4431-aebc-47a178f89871 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:36.223001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd9de4-43d3-4cfd-a21a-7d979481e99f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:36.226717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-dbaccdb8-562f-4431-aebc-47a178f89871 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 00:51:36.226717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:36.226717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:36.226717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:36.226717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:36.226717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:36.226717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:36.226717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:36.226717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:36.226717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:36.226717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:36.226717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:36.226717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:36.226717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:36.226717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:36.226717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:36.227577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:36.227577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:36.227577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:36.227577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:36.227577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:36.227577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:36.227577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:36.227577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:36.227577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:36.227577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:36.227577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:36.227577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:36.227577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:36.227577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:36.227577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:36.227577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:36.228359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:36.228359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:36.228359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:36.228359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:36.228359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:36.228359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:36.228359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:36.228359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:36.228359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:36.228359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:36.228359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 00:51:36.228359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:36.229408 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 224/443] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 14 00:51:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:36.230735 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaccdb8-562f-4431-aebc-47a178f89871 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:36.263585 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85a6b8-852e-413e-b33d-c8158970970b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:36.264208 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85a6b8-852e-413e-b33d-c8158970970b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:36.264486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85a6b8-852e-413e-b33d-c8158970970b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:36.264749 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85a6b8-852e-413e-b33d-c8158970970b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:36.276628 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab85a6b8-852e-413e-b33d-c8158970970b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:36.283512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-ab85a6b8-852e-413e-b33d-c8158970970b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:51:36.283512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:36.283512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:36.283512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:36.283512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:36.283512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:36.283512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:36.283512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:36.283512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:36.283512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:36.283512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:36.283512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:36.283512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:36.283512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:36.283512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:36.283512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:36.284440 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:36.284440 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:36.284440 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:36.284440 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:36.284440 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:36.284440 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:36.284440 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:36.284440 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:36.284440 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:36.284440 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:36.284440 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:36.284440 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:36.284440 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:36.284440 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:36.284440 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:36.284440 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:36.285281 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:36.285281 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:36.285281 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:36.285281 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:36.285281 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:36.285281 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:36.285281 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:36.285281 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:36.285281 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:36.285281 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:36.285281 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:51:36.285281 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:36.286069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 220/444] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:51:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:36.286931 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85a6b8-852e-413e-b33d-c8158970970b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:36.336013 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:36.359211 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaccdb8-562f-4431-aebc-47a178f89871 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:36.399178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca620de-43cd-4364-9250-55d7f185d735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:36.399803 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca620de-43cd-4364-9250-55d7f185d735 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:36.400039 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca620de-43cd-4364-9250-55d7f185d735 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:36.400298 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca620de-43cd-4364-9250-55d7f185d735 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:36.400486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85a6b8-852e-413e-b33d-c8158970970b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:36.401011 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca620de-43cd-4364-9250-55d7f185d735 None admin] RBAC: Adding query filter params (group.id=c4c2ccd3233748b78095c4da4bcebf97, role.id=ee3984f710984de6bf564de3bee00d33, scope.project.id=3adf86e652e34928b6066fc3d75c468f) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:36.401312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca620de-43cd-4364-9250-55d7f185d735 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:36.404183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca620de-43cd-4364-9250-55d7f185d735 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:36.409304 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 225/445] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Sep 14 00:51:36 2022] GET /identity/v3/role_assignments?group.id=c4c2ccd3233748b78095c4da4bcebf97&scope.project.id=3adf86e652e34928b6066fc3d75c468f&role.id=ee3984f710984de6bf564de3bee00d33 => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:36.409971 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca620de-43cd-4364-9250-55d7f185d735 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:36.448308 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d3a53-796a-4a8a-a769-785aaf7aeb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:36.449409 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d3a53-796a-4a8a-a769-785aaf7aeb6b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:36.449869 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d3a53-796a-4a8a-a769-785aaf7aeb6b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:36.450149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d3a53-796a-4a8a-a769-785aaf7aeb6b None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:36.450833 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d3a53-796a-4a8a-a769-785aaf7aeb6b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:36.451136 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d3a53-796a-4a8a-a769-785aaf7aeb6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:36.453079 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d3a53-796a-4a8a-a769-785aaf7aeb6b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:36.464261 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 221/446] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:51:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:36.464850 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:36.471721 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d3a53-796a-4a8a-a769-785aaf7aeb6b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:36.556915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca620de-43cd-4364-9250-55d7f185d735 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:36.604684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ff255-8525-4f14-adc1-e584a609739f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:36.605465 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ff255-8525-4f14-adc1-e584a609739f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:36.606182 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ff255-8525-4f14-adc1-e584a609739f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:36.606446 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ff255-8525-4f14-adc1-e584a609739f None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:36.607379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ff255-8525-4f14-adc1-e584a609739f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:36.607676 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ff255-8525-4f14-adc1-e584a609739f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:36.609161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ff255-8525-4f14-adc1-e584a609739f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:36.615240 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d3a53-796a-4a8a-a769-785aaf7aeb6b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:36.621419 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 226/447] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:36.626771 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:36.629081 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ff255-8525-4f14-adc1-e584a609739f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:36.662602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2676451-f8f9-4878-8e3c-9b70d3c0f097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:36.663556 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2676451-f8f9-4878-8e3c-9b70d3c0f097 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:36.663976 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2676451-f8f9-4878-8e3c-9b70d3c0f097 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:36.664244 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2676451-f8f9-4878-8e3c-9b70d3c0f097 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:36.742283 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2676451-f8f9-4878-8e3c-9b70d3c0f097 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:36.743733 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2676451-f8f9-4878-8e3c-9b70d3c0f097 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:36.748301 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ff255-8525-4f14-adc1-e584a609739f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:36.752810 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:36.790736 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0ec35-1e29-4fc8-8923-ed0258804ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:36.791376 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0ec35-1e29-4fc8-8923-ed0258804ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:36.791602 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0ec35-1e29-4fc8-8923-ed0258804ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:36.791871 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0ec35-1e29-4fc8-8923-ed0258804ee0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:36.861397 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 222/448] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:51:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 00:51:36.867594 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2676451-f8f9-4878-8e3c-9b70d3c0f097 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:36.872881 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0ec35-1e29-4fc8-8923-ed0258804ee0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:36.874946 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0ec35-1e29-4fc8-8923-ed0258804ee0 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:36.876124 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:36.964389 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2676451-f8f9-4878-8e3c-9b70d3c0f097 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:36.972157 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 227/449] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:51:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 00:51:36.977693 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0ec35-1e29-4fc8-8923-ed0258804ee0 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:36.981138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:37.000429 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1eb1e-6065-46da-980c-99c6ff5f25b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:37.000704 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1eb1e-6065-46da-980c-99c6ff5f25b0 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:37.001009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1eb1e-6065-46da-980c-99c6ff5f25b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:37.001279 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1eb1e-6065-46da-980c-99c6ff5f25b0 None admin] PATH_INFO: `/v3/projects/3adf86e652e34928b6066fc3d75c468f` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:37.002430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c1eb1e-6065-46da-980c-99c6ff5f25b0 None admin] RBAC: Authorizing `identity:get_project(project_id=3adf86e652e34928b6066fc3d75c468f)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:37.003866 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c1eb1e-6065-46da-980c-99c6ff5f25b0 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:37.005720 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 223/450] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:36 2022] GET /identity/v3/projects/3adf86e652e34928b6066fc3d75c468f => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:37.010757 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1eb1e-6065-46da-980c-99c6ff5f25b0 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:37.077055 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0ec35-1e29-4fc8-8923-ed0258804ee0 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:37.084448 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:37.109785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1eb1e-6065-46da-980c-99c6ff5f25b0 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:37.110611 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377cdcc6-c575-44bf-8e98-16421a9dabed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:37.111239 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cdcc6-c575-44bf-8e98-16421a9dabed None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:37.111515 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cdcc6-c575-44bf-8e98-16421a9dabed None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:37.111785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cdcc6-c575-44bf-8e98-16421a9dabed None admin] PATH_INFO: `/v3/projects/77e0a2fe229b4532ac18c75cfe42e13c` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:37.112920 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377cdcc6-c575-44bf-8e98-16421a9dabed None admin] RBAC: Authorizing `identity:get_project(project_id=77e0a2fe229b4532ac18c75cfe42e13c)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:37.114386 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377cdcc6-c575-44bf-8e98-16421a9dabed None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:37.115993 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 228/451] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:51:36 2022] GET /identity/v3/projects/77e0a2fe229b4532ac18c75cfe42e13c => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:51:37.121322 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377cdcc6-c575-44bf-8e98-16421a9dabed None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:37.143113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ff71f-89f9-4a0f-8626-3a4d646d7a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:37.143723 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ff71f-89f9-4a0f-8626-3a4d646d7a09 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:37.143993 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ff71f-89f9-4a0f-8626-3a4d646d7a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:37.144261 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ff71f-89f9-4a0f-8626-3a4d646d7a09 None admin] PATH_INFO: `/v3/groups/c4c2ccd3233748b78095c4da4bcebf97` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:37.145353 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ff71f-89f9-4a0f-8626-3a4d646d7a09 None admin] RBAC: Authorizing `identity:get_group(group_id=c4c2ccd3233748b78095c4da4bcebf97)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:37.146788 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ff71f-89f9-4a0f-8626-3a4d646d7a09 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:37.152958 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 224/452] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 14 00:51:37 2022] GET /identity/v3/groups/c4c2ccd3233748b78095c4da4bcebf97 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:51:37.153862 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ff71f-89f9-4a0f-8626-3a4d646d7a09 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:37.188745 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:37.219289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377cdcc6-c575-44bf-8e98-16421a9dabed None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:37.248333 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ff71f-89f9-4a0f-8626-3a4d646d7a09 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:37.251816 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bb70e-a876-40c3-9777-b9f98538a39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:37.252382 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bb70e-a876-40c3-9777-b9f98538a39e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:37.252660 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bb70e-a876-40c3-9777-b9f98538a39e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:37.252930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bb70e-a876-40c3-9777-b9f98538a39e None admin] PATH_INFO: `/v3/groups/af60b7f7ae0a4fa58cafedab1240e305` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:37.254050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bb70e-a876-40c3-9777-b9f98538a39e None admin] RBAC: Authorizing `identity:get_group(group_id=af60b7f7ae0a4fa58cafedab1240e305)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:37.255467 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bb70e-a876-40c3-9777-b9f98538a39e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:37.257317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 229/453] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 14 00:51:37 2022] GET /identity/v3/groups/af60b7f7ae0a4fa58cafedab1240e305 => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:51:37.263287 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bb70e-a876-40c3-9777-b9f98538a39e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:37.282947 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1211e3-48e3-45d8-ba88-f04adcae9b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:37.283536 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1211e3-48e3-45d8-ba88-f04adcae9b66 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:37.283811 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1211e3-48e3-45d8-ba88-f04adcae9b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:37.284082 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1211e3-48e3-45d8-ba88-f04adcae9b66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:37.284789 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1211e3-48e3-45d8-ba88-f04adcae9b66 None admin] RBAC: Adding query filter params (group.id=c4c2ccd3233748b78095c4da4bcebf97, role.id=8373a23ee4ff4c7d94e82480d85b586b, scope.project.id=3adf86e652e34928b6066fc3d75c468f) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:37.285089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1211e3-48e3-45d8-ba88-f04adcae9b66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:37.286527 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1211e3-48e3-45d8-ba88-f04adcae9b66 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:37.292125 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 225/454] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Sep 14 00:51:37 2022] GET /identity/v3/role_assignments?group.id=c4c2ccd3233748b78095c4da4bcebf97&scope.project.id=3adf86e652e34928b6066fc3d75c468f&role.id=8373a23ee4ff4c7d94e82480d85b586b => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:51:37.369353 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bb70e-a876-40c3-9777-b9f98538a39e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:37.404175 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb976de-67ce-4d73-bdaf-1f74b22e5230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:37.405087 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb976de-67ce-4d73-bdaf-1f74b22e5230 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:37.405314 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb976de-67ce-4d73-bdaf-1f74b22e5230 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:37.405586 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb976de-67ce-4d73-bdaf-1f74b22e5230 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:37.406404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb976de-67ce-4d73-bdaf-1f74b22e5230 None admin] RBAC: Adding query filter params (group.id=af60b7f7ae0a4fa58cafedab1240e305, role.id=0d7a36bda723430eae02f10f4c775c96, scope.project.id=77e0a2fe229b4532ac18c75cfe42e13c) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:37.406714 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb976de-67ce-4d73-bdaf-1f74b22e5230 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:37.408196 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb976de-67ce-4d73-bdaf-1f74b22e5230 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:37.414687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 230/455] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Sep 14 00:51:37 2022] GET /identity/v3/role_assignments?group.id=af60b7f7ae0a4fa58cafedab1240e305&scope.project.id=77e0a2fe229b4532ac18c75cfe42e13c&role.id=0d7a36bda723430eae02f10f4c775c96 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:51:40.016200 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e011d-4b9a-4627-b19d-b21a4b9a05fd None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:40.016681 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e011d-4b9a-4627-b19d-b21a4b9a05fd None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:40.016789 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e011d-4b9a-4627-b19d-b21a4b9a05fd None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:40.018326 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 226/456] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:40.025506 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462118ff-1261-4add-83b6-ebea75053e84 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:40.025912 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462118ff-1261-4add-83b6-ebea75053e84 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:40.026077 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462118ff-1261-4add-83b6-ebea75053e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:40.042316 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:40.055832 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-462118ff-1261-4add-83b6-ebea75053e84 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:40.057014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-462118ff-1261-4add-83b6-ebea75053e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:40.150593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 231/457] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 00:51:40.335112 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a4072-d185-439c-823c-eb33b0177be7 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:40.335297 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a4072-d185-439c-823c-eb33b0177be7 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:40.335563 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a4072-d185-439c-823c-eb33b0177be7 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:40.337321 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 227/458] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:40.342406 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8626a50-4e71-4b00-bd2b-868c1f0b5f3e None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:40.342855 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8626a50-4e71-4b00-bd2b-868c1f0b5f3e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:40.343799 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8626a50-4e71-4b00-bd2b-868c1f0b5f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:40.366792 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-f8626a50-4e71-4b00-bd2b-868c1f0b5f3e None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:40.368165 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f8626a50-4e71-4b00-bd2b-868c1f0b5f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:40.455111 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 232/459] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:40.517257 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a4072-d185-439c-823c-eb33b0177be7 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:40.526681 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:40.617517 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4271d-31fb-4681-9ff4-3fa95013accf None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:40.618164 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4271d-31fb-4681-9ff4-3fa95013accf None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:40.618633 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4271d-31fb-4681-9ff4-3fa95013accf None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:40.621471 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 233/460] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:40.625757 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b25e1f-0d25-4e6f-bebf-a5a89a2b80d0 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:40.626307 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b25e1f-0d25-4e6f-bebf-a5a89a2b80d0 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:40.626807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b25e1f-0d25-4e6f-bebf-a5a89a2b80d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:40.661669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-f1b25e1f-0d25-4e6f-bebf-a5a89a2b80d0 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:40.662893 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f1b25e1f-0d25-4e6f-bebf-a5a89a2b80d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:40.669949 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a4072-d185-439c-823c-eb33b0177be7 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:40.737939 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77661691-a319-4351-a81f-edd9b435125a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:40.738564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77661691-a319-4351-a81f-edd9b435125a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:40.738836 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77661691-a319-4351-a81f-edd9b435125a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:40.739101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77661691-a319-4351-a81f-edd9b435125a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:40.765414 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77661691-a319-4351-a81f-edd9b435125a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:40.766909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77661691-a319-4351-a81f-edd9b435125a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:40.782090 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:40.787030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-77661691-a319-4351-a81f-edd9b435125a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:40.787030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:40.787030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:40.787030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:40.787030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:40.787030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:40.787030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:40.787030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:40.787030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:40.787030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:40.787030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:40.787030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:40.787030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:51:40.787030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:51:40.787030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:51:40.787030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:51:40.788094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:40.788094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:40.788094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:40.788094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:40.788094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:40.788094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:40.788094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:40.788094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:40.788094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:40.788094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:40.788094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:40.788094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:40.788094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:40.788094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:40.788094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:40.788094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:40.788094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:51:40.788928 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:51:40.788928 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:40.788928 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:40.790399 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 228/461] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:40.791177 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77661691-a319-4351-a81f-edd9b435125a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:40.797887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 234/462] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:40.802901 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b25e1f-0d25-4e6f-bebf-a5a89a2b80d0 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:40.869595 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:40.915312 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77661691-a319-4351-a81f-edd9b435125a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:40.956425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b161329-8290-46a1-9f8b-a53fa33d97fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:40.957051 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b161329-8290-46a1-9f8b-a53fa33d97fc None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:40.957370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b161329-8290-46a1-9f8b-a53fa33d97fc None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:40.957640 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b161329-8290-46a1-9f8b-a53fa33d97fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:40.973228 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b161329-8290-46a1-9f8b-a53fa33d97fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:40.974809 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b161329-8290-46a1-9f8b-a53fa33d97fc None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:40.989852 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-3b161329-8290-46a1-9f8b-a53fa33d97fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:40.989852 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:40.989852 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:40.989852 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:40.989852 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:40.989852 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:40.989852 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:40.989852 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:40.989852 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:40.989852 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:40.989852 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:40.989852 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:40.989852 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:51:40.989852 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:51:40.989852 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:51:40.989852 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:51:40.990740 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:40.990740 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:40.990740 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:40.990740 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:40.990740 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:40.990740 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:40.990740 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:40.990740 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:40.990740 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:40.990740 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:40.990740 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:40.990740 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:40.990740 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:40.990740 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:40.990740 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:40.990740 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:40.990740 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:51:40.992074 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:51:40.992074 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:40.992074 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:40.992074 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 229/463] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:40.992497 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742db2da-fe17-46b5-af52-14a4724af49b None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:40.992778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742db2da-fe17-46b5-af52-14a4724af49b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:40.993045 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742db2da-fe17-46b5-af52-14a4724af49b None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:40.998416 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 230/464] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:40.999222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742db2da-fe17-46b5-af52-14a4724af49b None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:41.021725 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b25e1f-0d25-4e6f-bebf-a5a89a2b80d0 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:41.071719 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25822fb3-ced7-493f-a97b-c6087544c3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:41.072661 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25822fb3-ced7-493f-a97b-c6087544c3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:41.072922 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25822fb3-ced7-493f-a97b-c6087544c3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:41.073200 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25822fb3-ced7-493f-a97b-c6087544c3a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:41.073925 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25822fb3-ced7-493f-a97b-c6087544c3a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:41.074498 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25822fb3-ced7-493f-a97b-c6087544c3a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:41.076834 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25822fb3-ced7-493f-a97b-c6087544c3a2 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:41.094037 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 235/465] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:41.099560 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38a094-30fb-4fd9-b791-5dd2508ed5e7 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:41.099775 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38a094-30fb-4fd9-b791-5dd2508ed5e7 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:41.100052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38a094-30fb-4fd9-b791-5dd2508ed5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:41.108674 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742db2da-fe17-46b5-af52-14a4724af49b None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:41.117703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-df38a094-30fb-4fd9-b791-5dd2508ed5e7 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:41.118946 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-df38a094-30fb-4fd9-b791-5dd2508ed5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:41.119882 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:41.147827 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56705a80-6eb3-4088-897d-9c41b8466e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:41.148450 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56705a80-6eb3-4088-897d-9c41b8466e5c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:41.148723 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56705a80-6eb3-4088-897d-9c41b8466e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:41.148985 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56705a80-6eb3-4088-897d-9c41b8466e5c None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:41.149610 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56705a80-6eb3-4088-897d-9c41b8466e5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:41.149934 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56705a80-6eb3-4088-897d-9c41b8466e5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:41.151301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56705a80-6eb3-4088-897d-9c41b8466e5c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:41.174219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 231/466] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:41.174219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56705a80-6eb3-4088-897d-9c41b8466e5c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:41.177308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:41.196310 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 236/467] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:41.197311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38a094-30fb-4fd9-b791-5dd2508ed5e7 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:41.298828 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38a094-30fb-4fd9-b791-5dd2508ed5e7 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:41.309275 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56705a80-6eb3-4088-897d-9c41b8466e5c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:41.335244 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9adcb-90e9-4e4c-9ca4-78daaaeda448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:41.336071 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9adcb-90e9-4e4c-9ca4-78daaaeda448 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:41.336494 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9adcb-90e9-4e4c-9ca4-78daaaeda448 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:41.336909 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9adcb-90e9-4e4c-9ca4-78daaaeda448 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:41.337720 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d9adcb-90e9-4e4c-9ca4-78daaaeda448 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:41.339387 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d9adcb-90e9-4e4c-9ca4-78daaaeda448 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:41.355347 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff6c17-1bb8-4a38-bba1-bafdbb53c73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:41.355973 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff6c17-1bb8-4a38-bba1-bafdbb53c73e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:41.356527 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff6c17-1bb8-4a38-bba1-bafdbb53c73e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:41.356817 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff6c17-1bb8-4a38-bba1-bafdbb53c73e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:41.368705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff6c17-1bb8-4a38-bba1-bafdbb53c73e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:41.369355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 237/468] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 14 00:51:41 2022] POST /identity/v3/users => generated 246 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:51:41.370340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff6c17-1bb8-4a38-bba1-bafdbb53c73e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:41.370878 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9adcb-90e9-4e4c-9ca4-78daaaeda448 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:41.389118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-a1ff6c17-1bb8-4a38-bba1-bafdbb53c73e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:41.389118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:41.389118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:41.389118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:41.389118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:41.389118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:41.389118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:41.389118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:41.389118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:41.389118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:41.389118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:41.389118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:41.389118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:51:41.389118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:51:41.389118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:51:41.389118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:51:41.390209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:41.390209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:41.390209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:41.390209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:41.390209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:41.390209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:41.390209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:41.390209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:41.390209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:41.390209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:41.390209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:41.390209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:41.390209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:41.390209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:41.390209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:41.390209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:41.390209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:51:41.391062 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:51:41.391062 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:41.391062 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:41.396497 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 232/469] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:41.399322 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff6c17-1bb8-4a38-bba1-bafdbb53c73e None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:41.435424 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:41.462148 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:41.538639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff6c17-1bb8-4a38-bba1-bafdbb53c73e None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:41.552242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9adcb-90e9-4e4c-9ca4-78daaaeda448 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:41.589700 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090ba15-e5a2-46ac-9ccc-90498ec09e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:41.590342 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090ba15-e5a2-46ac-9ccc-90498ec09e21 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:41.590620 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090ba15-e5a2-46ac-9ccc-90498ec09e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:41.590883 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090ba15-e5a2-46ac-9ccc-90498ec09e21 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:41.591541 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090ba15-e5a2-46ac-9ccc-90498ec09e21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:41.591833 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090ba15-e5a2-46ac-9ccc-90498ec09e21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:41.593351 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090ba15-e5a2-46ac-9ccc-90498ec09e21 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:41.600777 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7e436-7d0c-4b02-9ed9-9e84cca6bef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:41.602071 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7e436-7d0c-4b02-9ed9-9e84cca6bef4 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:41.602347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7e436-7d0c-4b02-9ed9-9e84cca6bef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:41.602612 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7e436-7d0c-4b02-9ed9-9e84cca6bef4 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:41.603722 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7e436-7d0c-4b02-9ed9-9e84cca6bef4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:41.605168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7e436-7d0c-4b02-9ed9-9e84cca6bef4 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:41.606545 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 233/470] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:41.607628 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090ba15-e5a2-46ac-9ccc-90498ec09e21 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:41.629100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 238/471] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 14 00:51:41 2022] POST /identity/v3/users => generated 248 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:51:41.630289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd818c1f-a7a9-4180-b780-f0c9ab934a02 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:41.630573 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd818c1f-a7a9-4180-b780-f0c9ab934a02 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:41.630844 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd818c1f-a7a9-4180-b780-f0c9ab934a02 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:41.632034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 239/472] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:41.632717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd818c1f-a7a9-4180-b780-f0c9ab934a02 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:41.720277 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:41.753108 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090ba15-e5a2-46ac-9ccc-90498ec09e21 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:41.767726 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:41.776984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd818c1f-a7a9-4180-b780-f0c9ab934a02 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:41.799530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdec44f-59c0-4af3-b896-89c6a266d951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:41.800477 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdec44f-59c0-4af3-b896-89c6a266d951 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:41.800934 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdec44f-59c0-4af3-b896-89c6a266d951 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:41.801413 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdec44f-59c0-4af3-b896-89c6a266d951 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:41.816700 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdec44f-59c0-4af3-b896-89c6a266d951 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:41.818458 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdec44f-59c0-4af3-b896-89c6a266d951 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:41.822535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d745d-c0b1-4cc8-85b3-fa698516085d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:41.823919 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d745d-c0b1-4cc8-85b3-fa698516085d None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:41.823919 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d745d-c0b1-4cc8-85b3-fa698516085d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:41.823919 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d745d-c0b1-4cc8-85b3-fa698516085d None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:41.824226 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d745d-c0b1-4cc8-85b3-fa698516085d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:41.825627 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d745d-c0b1-4cc8-85b3-fa698516085d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:41.837685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-3fdec44f-59c0-4af3-b896-89c6a266d951 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:41.837685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:41.837685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:41.837685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:41.837685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:41.837685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:41.837685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:41.837685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:41.837685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:41.837685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:41.837685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:41.837685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:41.837685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:51:41.837685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:51:41.837685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:51:41.837685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:51:41.838746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:41.838746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:41.838746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:41.838746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:41.838746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:41.838746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:41.838746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:41.838746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:41.838746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:41.838746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:41.838746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:41.838746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:41.838746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:41.838746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:41.838746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:41.838746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:41.838746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:51:41.839566 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:51:41.839566 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:41.839566 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:41.839725 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 234/473] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:41.841301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499ed1f-151d-4991-adb2-e27f9d9ceec0 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:41.841301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499ed1f-151d-4991-adb2-e27f9d9ceec0 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:41.841632 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499ed1f-151d-4991-adb2-e27f9d9ceec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:41.854336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 240/474] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 14 00:51:41 2022] POST /identity/v3/users => generated 248 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:51:41.855272 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d745d-c0b1-4cc8-85b3-fa698516085d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:41.867349 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-6499ed1f-151d-4991-adb2-e27f9d9ceec0 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:41.868599 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6499ed1f-151d-4991-adb2-e27f9d9ceec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:41.956559 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 235/475] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:41.995329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d745d-c0b1-4cc8-85b3-fa698516085d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:42.036127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89720d3-0dd6-42ee-9c51-357fb4512f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:42.037135 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89720d3-0dd6-42ee-9c51-357fb4512f08 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:42.037625 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89720d3-0dd6-42ee-9c51-357fb4512f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:42.038123 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89720d3-0dd6-42ee-9c51-357fb4512f08 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:42.039000 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89720d3-0dd6-42ee-9c51-357fb4512f08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:42.039517 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89720d3-0dd6-42ee-9c51-357fb4512f08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:42.041120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89720d3-0dd6-42ee-9c51-357fb4512f08 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:42.055023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 241/476] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:42.060515 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499ed1f-151d-4991-adb2-e27f9d9ceec0 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:42.133020 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:42.180599 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499ed1f-151d-4991-adb2-e27f9d9ceec0 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:42.215441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a52fe8-7bb0-4b60-b579-b7bbce1fac47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:42.215925 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a52fe8-7bb0-4b60-b579-b7bbce1fac47 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:42.216196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a52fe8-7bb0-4b60-b579-b7bbce1fac47 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:42.216455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a52fe8-7bb0-4b60-b579-b7bbce1fac47 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:42.217084 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a52fe8-7bb0-4b60-b579-b7bbce1fac47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:42.218598 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a52fe8-7bb0-4b60-b579-b7bbce1fac47 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:42.243923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 236/477] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 14 00:51:42 2022] POST /identity/v3/users => generated 249 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:51:42.299579 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89720d3-0dd6-42ee-9c51-357fb4512f08 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:42.321995 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:42.437609 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89720d3-0dd6-42ee-9c51-357fb4512f08 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:42.484766 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4273e-0784-481c-ac81-f4bd7e434483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:42.485378 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4273e-0784-481c-ac81-f4bd7e434483 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:42.485651 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4273e-0784-481c-ac81-f4bd7e434483 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:42.485954 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4273e-0784-481c-ac81-f4bd7e434483 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:42.486627 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4273e-0784-481c-ac81-f4bd7e434483 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:42.488089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4273e-0784-481c-ac81-f4bd7e434483 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:42.500187 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.sql.core [None req-b7e4273e-0784-481c-ac81-f4bd7e434483 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 14 00:51:42.500187 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 14 00:51:42.500187 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [parameters: {'id': 'a739044544c34a4787af09b7acdf5ad2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 14 00:51:42.500187 dv-cinder-857528-1-smb devstack@keystone.service[81475]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81475) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 14 00:51:42.518346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-b7e4273e-0784-481c-ac81-f4bd7e434483 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 14 00:51:42.518346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:42.518346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 00:51:42.518346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 00:51:42.518346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 00:51:42.518346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 00:51:42.518346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 00:51:42.518346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 00:51:42.518346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 00:51:42.518346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application conn.query(q) Sep 14 00:51:42.518346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 00:51:42.518346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 00:51:42.518346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 00:51:42.518346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application result.read() Sep 14 00:51:42.518346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 00:51:42.519224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 00:51:42.519224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 00:51:42.519224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 00:51:42.519224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 00:51:42.519224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 00:51:42.519224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 00:51:42.519224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 00:51:42.519224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 14 00:51:42.519224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:42.519224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 14 00:51:42.519224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:42.519224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:42.519224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 14 00:51:42.519224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 14 00:51:42.519224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 14 00:51:42.519224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return ref.to_dict() Sep 14 00:51:42.519224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 00:51:42.519224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application next(self.gen) Sep 14 00:51:42.520108 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 14 00:51:42.520108 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application yield resource Sep 14 00:51:42.520108 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 00:51:42.520108 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application next(self.gen) Sep 14 00:51:42.520108 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 14 00:51:42.520108 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self.session.rollback() Sep 14 00:51:42.520108 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 00:51:42.520108 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self.force_reraise() Sep 14 00:51:42.520108 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 00:51:42.520108 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise self.value Sep 14 00:51:42.520108 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 14 00:51:42.520108 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 14 00:51:42.520108 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 14 00:51:42.520108 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application session.commit() Sep 14 00:51:42.520108 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 14 00:51:42.520108 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 14 00:51:42.520108 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 14 00:51:42.520944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._prepare_impl() Sep 14 00:51:42.520944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 14 00:51:42.520944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self.session.flush() Sep 14 00:51:42.520944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 14 00:51:42.520944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._flush(objects) Sep 14 00:51:42.520944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 14 00:51:42.520944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 14 00:51:42.520944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 14 00:51:42.520944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application compat.raise_( Sep 14 00:51:42.520944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 00:51:42.520944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception Sep 14 00:51:42.520944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 14 00:51:42.520944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application flush_context.execute() Sep 14 00:51:42.520944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 14 00:51:42.520944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rec.execute(self) Sep 14 00:51:42.520944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 14 00:51:42.520944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 14 00:51:42.521855 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 14 00:51:42.521855 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 14 00:51:42.521855 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 14 00:51:42.521855 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 14 00:51:42.521855 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 14 00:51:42.521855 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 14 00:51:42.521855 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 14 00:51:42.521855 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 14 00:51:42.521855 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 14 00:51:42.521855 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 14 00:51:42.521855 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 14 00:51:42.521855 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 14 00:51:42.521855 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 14 00:51:42.521855 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 14 00:51:42.521855 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 00:51:42.521855 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception Sep 14 00:51:42.522662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 00:51:42.522662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 00:51:42.522662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 00:51:42.522662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 00:51:42.522662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 00:51:42.522662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 00:51:42.522662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 00:51:42.522662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application conn.query(q) Sep 14 00:51:42.522662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 00:51:42.522662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 00:51:42.522662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 00:51:42.522662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application result.read() Sep 14 00:51:42.522662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 00:51:42.522662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 00:51:42.522662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 00:51:42.522662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 00:51:42.523424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 00:51:42.523424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 00:51:42.523424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 00:51:42.523424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 00:51:42.523424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 14 00:51:42.523424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 14 00:51:42.523424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [parameters: {'id': 'a739044544c34a4787af09b7acdf5ad2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 14 00:51:42.523424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 14 00:51:42.523424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:42.523424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:51:42.523424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:42.523424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:42.523424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:42.523424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:42.523424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:42.523424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:42.524198 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:42.524198 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:42.524198 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:42.524198 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:42.524198 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:42.524198 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:42.524198 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 14 00:51:42.524198 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 14 00:51:42.524198 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:42.524198 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:42.524198 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 14 00:51:42.524198 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 14 00:51:42.524198 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 14 00:51:42.524198 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 14 00:51:42.524198 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 14 00:51:42.524198 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:42.525006 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 242/478] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Sep 14 00:51:42 2022] POST /identity/v3/roles => generated 144 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:42.532637 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a52fe8-7bb0-4b60-b579-b7bbce1fac47 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:42.640618 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a52fe8-7bb0-4b60-b579-b7bbce1fac47 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:42.664601 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:42.681642 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ea0eb-9a1a-4a53-a924-6c62f204e653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:42.682311 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ea0eb-9a1a-4a53-a924-6c62f204e653 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:42.682588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ea0eb-9a1a-4a53-a924-6c62f204e653 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:42.682858 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ea0eb-9a1a-4a53-a924-6c62f204e653 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:42.696277 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ea0eb-9a1a-4a53-a924-6c62f204e653 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:42.701690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-7e2ea0eb-9a1a-4a53-a924-6c62f204e653 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 00:51:42.701690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:42.701690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:42.701690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:42.701690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:42.701690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:42.701690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:42.701690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:42.701690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:42.701690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:42.701690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:42.701690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:42.701690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:42.701690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:42.701690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:42.701690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:42.702582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:42.702582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:42.702582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:42.702582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:42.702582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:42.702582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:42.702582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:42.702582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:42.702582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:42.702582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:42.702582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:42.702582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:42.702582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:42.702582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:42.702582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:42.702582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:42.703782 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:42.703782 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:42.703782 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:42.703782 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:42.703782 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:42.703782 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:42.703782 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:42.703782 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:42.703782 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:42.703782 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:42.703782 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 00:51:42.703782 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:42.703782 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 237/479] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 14 00:51:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:42.708908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4273e-0784-481c-ac81-f4bd7e434483 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:42.820802 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:42.848537 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4273e-0784-481c-ac81-f4bd7e434483 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:42.883510 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee2fed-22dd-4349-982d-d2e4852bd8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:42.884116 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee2fed-22dd-4349-982d-d2e4852bd8f6 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:42.884393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee2fed-22dd-4349-982d-d2e4852bd8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:42.884662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee2fed-22dd-4349-982d-d2e4852bd8f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:42.885313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee2fed-22dd-4349-982d-d2e4852bd8f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:42.885612 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee2fed-22dd-4349-982d-d2e4852bd8f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:42.887075 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee2fed-22dd-4349-982d-d2e4852bd8f6 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:42.896471 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 243/480] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:51:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:44.324522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f584c5-0012-4745-930f-f29b1827da65 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:44.325058 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f584c5-0012-4745-930f-f29b1827da65 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:44.325058 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f584c5-0012-4745-930f-f29b1827da65 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:44.326912 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 238/481] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:44.332805 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2c4f0-2c21-4492-8311-7c942b4405eb None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:44.333334 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2c4f0-2c21-4492-8311-7c942b4405eb None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:44.333334 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2c4f0-2c21-4492-8311-7c942b4405eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:44.359051 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-6ce2c4f0-2c21-4492-8311-7c942b4405eb None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:44.360293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6ce2c4f0-2c21-4492-8311-7c942b4405eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:44.449279 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 244/482] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:44.519385 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2ab79-9679-47fc-b6e8-11ed94b8bd0a None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:44.519711 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2ab79-9679-47fc-b6e8-11ed94b8bd0a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:44.519981 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2ab79-9679-47fc-b6e8-11ed94b8bd0a None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:44.521307 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 239/483] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:44.526755 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec2099-1388-4f2b-822c-b6ec93e8c47a None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:44.527041 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec2099-1388-4f2b-822c-b6ec93e8c47a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:44.527315 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec2099-1388-4f2b-822c-b6ec93e8c47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:44.553546 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ccec2099-1388-4f2b-822c-b6ec93e8c47a None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:44.554770 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ccec2099-1388-4f2b-822c-b6ec93e8c47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:44.605413 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222dcc3-bc3c-4cca-bb94-eb580e9ce18b None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:44.605691 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222dcc3-bc3c-4cca-bb94-eb580e9ce18b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:44.605911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222dcc3-bc3c-4cca-bb94-eb580e9ce18b None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:44.607487 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 240/484] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 00:51:44.612899 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56ba40-4443-4745-94ff-93fd886f3e4f None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:44.613179 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56ba40-4443-4745-94ff-93fd886f3e4f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:44.613446 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56ba40-4443-4745-94ff-93fd886f3e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:44.618886 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:44.625758 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 245/485] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:44.632033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-9c56ba40-4443-4745-94ff-93fd886f3e4f None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:44.633213 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9c56ba40-4443-4745-94ff-93fd886f3e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:44.705902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 241/486] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:44.871050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec2099-1388-4f2b-822c-b6ec93e8c47a None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:44.976321 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56ba40-4443-4745-94ff-93fd886f3e4f None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:44.999706 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec2099-1388-4f2b-822c-b6ec93e8c47a None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:45.043654 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41cb94-c960-4540-b250-7b2dacb0fd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:45.044288 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41cb94-c960-4540-b250-7b2dacb0fd91 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:45.044576 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41cb94-c960-4540-b250-7b2dacb0fd91 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:45.044841 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41cb94-c960-4540-b250-7b2dacb0fd91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:45.055744 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41cb94-c960-4540-b250-7b2dacb0fd91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:45.060582 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-ed41cb94-c960-4540-b250-7b2dacb0fd91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:51:45.060582 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:45.060582 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:45.060582 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:45.060582 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:45.060582 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:45.060582 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:45.060582 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:45.060582 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:45.060582 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:45.060582 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:45.060582 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:45.060582 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:45.060582 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:45.060582 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:45.060582 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:45.061428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:45.061428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:45.061428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:45.061428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:45.061428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:45.061428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:45.061428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:45.061428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:45.061428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:45.061428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:45.061428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:45.061428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:45.061428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:45.061428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:45.061428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:45.061428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:45.062276 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:45.062276 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:45.062276 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:45.062276 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:45.062276 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:45.062276 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:45.062276 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:45.062276 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:45.062276 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:45.062276 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:45.062276 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:51:45.062276 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:45.062276 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 246/487] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 14 00:51:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:45.062914 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577769b-f140-446b-a966-380593fe9f3f None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:45.063164 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577769b-f140-446b-a966-380593fe9f3f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:45.063580 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577769b-f140-446b-a966-380593fe9f3f None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:45.064967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 247/488] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:45.065717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577769b-f140-446b-a966-380593fe9f3f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:45.102038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56ba40-4443-4745-94ff-93fd886f3e4f None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:45.117995 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:45.133579 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:45.150024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3995da-edc6-47a2-ab19-da464551f809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:45.150857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3995da-edc6-47a2-ab19-da464551f809 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:45.151687 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3995da-edc6-47a2-ab19-da464551f809 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:45.152136 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3995da-edc6-47a2-ab19-da464551f809 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:45.163606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3995da-edc6-47a2-ab19-da464551f809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:45.168428 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-7b3995da-edc6-47a2-ab19-da464551f809 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:51:45.168428 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:45.168428 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:45.168428 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:45.168428 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:45.168428 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:45.168428 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:45.168428 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:45.168428 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:45.168428 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:45.168428 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:45.168428 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:45.168428 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:45.168428 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:45.168428 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:45.168428 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:45.169294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:45.169294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:45.169294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:45.169294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:45.169294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:45.169294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:45.169294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:45.169294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:45.169294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:45.169294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:45.169294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:45.169294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:45.169294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:45.169294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:45.169294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:45.169294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:45.170736 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:45.170736 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:45.170736 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:45.170736 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:45.170736 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:45.170736 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:45.170736 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:45.170736 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:45.170736 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:45.170736 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:45.170736 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:51:45.170736 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:45.170736 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 242/489] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 14 00:51:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:45.170736 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3995da-edc6-47a2-ab19-da464551f809 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:45.183778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577769b-f140-446b-a966-380593fe9f3f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:45.222102 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7c3cc-25bb-4b68-a220-8bf47f9972bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:45.223107 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7c3cc-25bb-4b68-a220-8bf47f9972bc None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:45.223390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7c3cc-25bb-4b68-a220-8bf47f9972bc None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:45.223660 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7c3cc-25bb-4b68-a220-8bf47f9972bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:45.234240 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7c3cc-25bb-4b68-a220-8bf47f9972bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:45.238944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-75c7c3cc-25bb-4b68-a220-8bf47f9972bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:51:45.238944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:45.238944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:45.238944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:45.238944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:45.238944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:45.238944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:45.238944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:45.238944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:45.238944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:45.238944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:45.238944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:45.238944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:45.238944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:45.238944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:45.238944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:45.239830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:45.239830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:45.239830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:45.239830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:45.239830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:45.239830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:45.239830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:45.239830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:45.239830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:45.239830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:45.239830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:45.239830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:45.239830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:45.239830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:45.239830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:45.239830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:45.240620 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:45.240620 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:45.240620 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:45.240620 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:45.240620 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:45.240620 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:45.240620 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:45.240620 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:45.240620 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:45.240620 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:45.240620 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:51:45.240620 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:45.240620 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 248/490] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 14 00:51:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:45.241288 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc0326-018b-4184-889f-9503c2b5214f None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:45.241357 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc0326-018b-4184-889f-9503c2b5214f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:45.241962 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc0326-018b-4184-889f-9503c2b5214f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:45.259169 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-1cbc0326-018b-4184-889f-9503c2b5214f None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:45.260340 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1cbc0326-018b-4184-889f-9503c2b5214f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:45.286477 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3995da-edc6-47a2-ab19-da464551f809 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:45.322771 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ec3d9-00d4-475d-95cc-e0616e223533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:45.323683 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ec3d9-00d4-475d-95cc-e0616e223533 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:45.324025 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ec3d9-00d4-475d-95cc-e0616e223533 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:45.324303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ec3d9-00d4-475d-95cc-e0616e223533 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:45.324964 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ec3d9-00d4-475d-95cc-e0616e223533 None admin] RBAC: Adding query filter params (name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:45.325501 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ec3d9-00d4-475d-95cc-e0616e223533 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:45.326653 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ec3d9-00d4-475d-95cc-e0616e223533 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:45.328823 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 249/491] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:45.329506 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc0326-018b-4184-889f-9503c2b5214f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:45.338072 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 243/492] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 14 00:51:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:45.339828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ec3d9-00d4-475d-95cc-e0616e223533 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:45.373904 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:45.392871 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:45.462010 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ec3d9-00d4-475d-95cc-e0616e223533 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:45.470300 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc0326-018b-4184-889f-9503c2b5214f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:45.497383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ad1ea-8361-4ef2-85a5-624d1bf38b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:45.498023 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ad1ea-8361-4ef2-85a5-624d1bf38b08 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:45.498294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ad1ea-8361-4ef2-85a5-624d1bf38b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:45.498560 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ad1ea-8361-4ef2-85a5-624d1bf38b08 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:45.499244 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ad1ea-8361-4ef2-85a5-624d1bf38b08 None admin] RBAC: Adding query filter params (name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:45.499539 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ad1ea-8361-4ef2-85a5-624d1bf38b08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:45.500898 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ad1ea-8361-4ef2-85a5-624d1bf38b08 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:45.513691 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 244/493] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 14 00:51:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:45.513691 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ad1ea-8361-4ef2-85a5-624d1bf38b08 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:45.522889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b03205-3183-43bd-8abc-cc91f2442bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:45.523796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b03205-3183-43bd-8abc-cc91f2442bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:45.524669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b03205-3183-43bd-8abc-cc91f2442bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:45.525093 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b03205-3183-43bd-8abc-cc91f2442bd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:45.526191 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b03205-3183-43bd-8abc-cc91f2442bd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:45.527246 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b03205-3183-43bd-8abc-cc91f2442bd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:45.528637 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b03205-3183-43bd-8abc-cc91f2442bd0 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:45.542007 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 250/494] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 14 00:51:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:45.542939 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b03205-3183-43bd-8abc-cc91f2442bd0 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:45.643043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:45.650214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ad1ea-8361-4ef2-85a5-624d1bf38b08 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:45.654763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b03205-3183-43bd-8abc-cc91f2442bd0 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:45.666938 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:45.689560 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c449d8a-34d6-4fc8-b286-4f2e8723301a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:45.690252 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c449d8a-34d6-4fc8-b286-4f2e8723301a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:45.690558 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c449d8a-34d6-4fc8-b286-4f2e8723301a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:45.690821 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c449d8a-34d6-4fc8-b286-4f2e8723301a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:45.692466 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11f051-c30d-432a-a15e-9bad21f9331d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:45.693084 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11f051-c30d-432a-a15e-9bad21f9331d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:45.693356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11f051-c30d-432a-a15e-9bad21f9331d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:45.693623 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11f051-c30d-432a-a15e-9bad21f9331d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:45.702380 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c449d8a-34d6-4fc8-b286-4f2e8723301a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:45.703850 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c449d8a-34d6-4fc8-b286-4f2e8723301a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:45.704386 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11f051-c30d-432a-a15e-9bad21f9331d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:45.705793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11f051-c30d-432a-a15e-9bad21f9331d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:45.719475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-1c449d8a-34d6-4fc8-b286-4f2e8723301a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:45.719475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:45.719475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:45.719475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:45.719475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:45.719475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:45.719475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:45.719475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:45.719475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:45.719475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:45.719475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:45.719475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:45.719475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:51:45.719475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:51:45.719475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:51:45.719475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:51:45.720367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:45.720367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:45.720367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:45.720367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:45.720367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:45.720367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:45.720367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:45.720367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:45.720367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:45.720367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:45.720367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:45.720367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:45.720367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:45.720367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:45.720367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:45.720367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:45.720367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:51:45.721195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:51:45.721195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:45.721195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:45.721355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-ec11f051-c30d-432a-a15e-9bad21f9331d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:45.721355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:45.721355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:45.721355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:45.721355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:45.721355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:45.721355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:45.721355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:45.721355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:45.721355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:45.721355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:45.721355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:45.721355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:51:45.721355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:51:45.721355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:51:45.721355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:51:45.727405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:45.727405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:45.727405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:45.727405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:45.727405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:45.727405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:45.727405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:45.727405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:45.727405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:45.727405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:45.727405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:45.727405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:45.727405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:45.727405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:45.727405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:45.727405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:45.727405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:51:45.728221 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:51:45.728221 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:45.728221 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:45.728221 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 251/495] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:45.728221 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11f051-c30d-432a-a15e-9bad21f9331d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:45.728489 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 245/496] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:45.728489 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c449d8a-34d6-4fc8-b286-4f2e8723301a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:45.833238 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c449d8a-34d6-4fc8-b286-4f2e8723301a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:45.833432 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11f051-c30d-432a-a15e-9bad21f9331d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:45.868083 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3d24c-0c67-4aaa-853f-4a04978bb470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:45.868280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c416838-dc68-4a3d-a625-ac043b5bb245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:45.868707 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3d24c-0c67-4aaa-853f-4a04978bb470 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:45.868808 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c416838-dc68-4a3d-a625-ac043b5bb245 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:45.868979 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3d24c-0c67-4aaa-853f-4a04978bb470 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:45.869072 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c416838-dc68-4a3d-a625-ac043b5bb245 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:45.869251 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3d24c-0c67-4aaa-853f-4a04978bb470 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:45.869345 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c416838-dc68-4a3d-a625-ac043b5bb245 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:45.881606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3d24c-0c67-4aaa-853f-4a04978bb470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:45.882588 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c416838-dc68-4a3d-a625-ac043b5bb245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:45.884074 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c416838-dc68-4a3d-a625-ac043b5bb245 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:45.887033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-a5e3d24c-0c67-4aaa-853f-4a04978bb470 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:51:45.887033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:45.887033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:45.887033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:45.887033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:45.887033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:45.887033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:45.887033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:45.887033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:45.887033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:45.887033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:45.887033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:45.887033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:45.887033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:45.887033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:45.887033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:45.887907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:45.887907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:45.887907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:45.887907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:45.887907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:45.887907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:45.887907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:45.887907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:45.887907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:45.887907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:45.887907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:45.887907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:45.887907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:45.887907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:45.887907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:45.887907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:45.888672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:45.888672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:45.888672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:45.888672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:45.888672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:45.888672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:45.888672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:45.888672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:45.888672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:45.888672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:45.888672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:51:45.888672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:45.888672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 246/497] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 14 00:51:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:45.889334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3d24c-0c67-4aaa-853f-4a04978bb470 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:45.898011 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:45.904168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-9c416838-dc68-4a3d-a625-ac043b5bb245 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:45.904168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:45.904168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:45.904168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:45.904168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:45.904168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:45.904168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:45.904168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:45.904168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:45.904168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:45.904168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:45.904168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:45.904168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:51:45.904168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:51:45.904168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:51:45.904168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:51:45.905351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:45.905351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:45.905351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:45.905351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:45.905351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:45.905351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:45.905351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:45.905351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:45.905351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:45.905351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:45.905351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:45.905351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:45.905351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:45.905351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:45.905351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:45.905351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:45.905351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:51:45.906785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:51:45.906785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:45.906785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:45.906785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 252/498] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:45.907163 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c416838-dc68-4a3d-a625-ac043b5bb245 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:45.923193 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:45.995829 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3d24c-0c67-4aaa-853f-4a04978bb470 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:46.007102 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c416838-dc68-4a3d-a625-ac043b5bb245 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:46.032856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0317c1-06ec-4214-a127-4fe4f836ebf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:46.033447 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0317c1-06ec-4214-a127-4fe4f836ebf6 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:46.033716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0317c1-06ec-4214-a127-4fe4f836ebf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:46.034015 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0317c1-06ec-4214-a127-4fe4f836ebf6 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:46.034641 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0317c1-06ec-4214-a127-4fe4f836ebf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:46.034934 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0317c1-06ec-4214-a127-4fe4f836ebf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:46.036302 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0317c1-06ec-4214-a127-4fe4f836ebf6 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:46.040461 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821efbe-22fd-4b61-9980-018ebdf0ef45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:46.041059 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821efbe-22fd-4b61-9980-018ebdf0ef45 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:46.041341 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821efbe-22fd-4b61-9980-018ebdf0ef45 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:46.041613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821efbe-22fd-4b61-9980-018ebdf0ef45 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:46.042284 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821efbe-22fd-4b61-9980-018ebdf0ef45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:46.042587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821efbe-22fd-4b61-9980-018ebdf0ef45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:46.043939 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821efbe-22fd-4b61-9980-018ebdf0ef45 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:46.047950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 247/499] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:46.049086 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1d8df-2850-4874-b0ba-72c68a1f0361 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:46.049360 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1d8df-2850-4874-b0ba-72c68a1f0361 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:46.049623 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1d8df-2850-4874-b0ba-72c68a1f0361 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:46.051012 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 248/500] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:46.051487 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1d8df-2850-4874-b0ba-72c68a1f0361 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:46.061645 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 253/501] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:46.062572 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821efbe-22fd-4b61-9980-018ebdf0ef45 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:46.115273 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:46.136228 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:46.150196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1d8df-2850-4874-b0ba-72c68a1f0361 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:46.161262 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821efbe-22fd-4b61-9980-018ebdf0ef45 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:46.182325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07f70d-a16d-49b2-98de-c9c291a949af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:46.182906 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07f70d-a16d-49b2-98de-c9c291a949af None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:46.183182 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07f70d-a16d-49b2-98de-c9c291a949af None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:46.183446 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07f70d-a16d-49b2-98de-c9c291a949af None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:46.184088 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07f70d-a16d-49b2-98de-c9c291a949af None admin] RBAC: Adding query filter params (name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:46.184381 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07f70d-a16d-49b2-98de-c9c291a949af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:46.185728 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07f70d-a16d-49b2-98de-c9c291a949af None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:46.193751 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 249/502] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 14 00:51:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:46.194532 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07f70d-a16d-49b2-98de-c9c291a949af None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:46.196377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908dabb7-2e44-49ef-8c18-b63bbe4ff271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:46.196982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dabb7-2e44-49ef-8c18-b63bbe4ff271 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:46.197264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dabb7-2e44-49ef-8c18-b63bbe4ff271 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:46.197535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dabb7-2e44-49ef-8c18-b63bbe4ff271 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:46.198558 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908dabb7-2e44-49ef-8c18-b63bbe4ff271 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:46.198558 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908dabb7-2e44-49ef-8c18-b63bbe4ff271 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:46.199845 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908dabb7-2e44-49ef-8c18-b63bbe4ff271 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:46.211630 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 254/503] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:46.212895 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72628162-81cc-46f1-97bb-73c82db64a56 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:46.213188 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72628162-81cc-46f1-97bb-73c82db64a56 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:46.213464 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72628162-81cc-46f1-97bb-73c82db64a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:46.231446 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-72628162-81cc-46f1-97bb-73c82db64a56 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:46.232656 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-72628162-81cc-46f1-97bb-73c82db64a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:46.295612 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07f70d-a16d-49b2-98de-c9c291a949af None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:46.296808 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 255/504] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:46.297629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72628162-81cc-46f1-97bb-73c82db64a56 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:46.330627 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:46.339008 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf348d-0a0b-43f2-b2d2-e19c8e85a2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:46.339623 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf348d-0a0b-43f2-b2d2-e19c8e85a2db None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:46.339893 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf348d-0a0b-43f2-b2d2-e19c8e85a2db None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:46.340162 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf348d-0a0b-43f2-b2d2-e19c8e85a2db None admin] PATH_INFO: `/v3/users/nova` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:46.348079 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf348d-0a0b-43f2-b2d2-e19c8e85a2db None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:46.349517 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf348d-0a0b-43f2-b2d2-e19c8e85a2db None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:46.361996 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:46.363046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-3cdf348d-0a0b-43f2-b2d2-e19c8e85a2db None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 00:51:46.363046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:46.363046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:46.363046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:46.363046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:46.363046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:46.363046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:46.363046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:46.363046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:46.363046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:46.363046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:46.363046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:46.363046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:51:46.363046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:51:46.363046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:51:46.363046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:51:46.364235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:46.364235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:46.364235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:51:46.364235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:51:46.364235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:51:46.364235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:51:46.364235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:46.364235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:46.364235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:46.364235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:46.364235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:46.364235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:46.364235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:46.364235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:46.364235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:46.364235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:46.364235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:46.364235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:46.365430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:46.365430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:46.365430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:51:46.365430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:51:46.365430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:51:46.365430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:51:46.365430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:51:46.365430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:51:46.365430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 00:51:46.365430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:46.368881 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 250/505] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Sep 14 00:51:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:46.369592 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf348d-0a0b-43f2-b2d2-e19c8e85a2db None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:46.406135 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72628162-81cc-46f1-97bb-73c82db64a56 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:46.439359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d88f7-6ecd-4000-b918-cc74bc1fe857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:46.439972 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d88f7-6ecd-4000-b918-cc74bc1fe857 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:46.440249 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d88f7-6ecd-4000-b918-cc74bc1fe857 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:46.440516 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d88f7-6ecd-4000-b918-cc74bc1fe857 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:46.448453 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d88f7-6ecd-4000-b918-cc74bc1fe857 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:46.449952 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d88f7-6ecd-4000-b918-cc74bc1fe857 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:46.463120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-290d88f7-6ecd-4000-b918-cc74bc1fe857 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 14 00:51:46.463120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:46.463120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:46.463120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:46.463120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:46.463120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:46.463120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:46.463120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:46.463120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:46.463120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:46.463120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:46.463120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:46.463120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:51:46.463120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:51:46.463120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:51:46.463120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:51:46.464025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:46.464025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:46.464025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:51:46.464025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:51:46.464025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:51:46.464025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:51:46.464025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:46.464025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:46.464025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:46.464025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:46.464025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:46.464025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:46.464025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:46.464025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:46.464025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:46.464025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:46.464025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:46.464025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:46.464898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:46.464898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:46.464898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:51:46.464898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:51:46.464898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:51:46.464898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:51:46.464898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:51:46.464898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:51:46.464898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 14 00:51:46.464898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:46.464898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 256/506] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:46.465454 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d88f7-6ecd-4000-b918-cc74bc1fe857 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:46.481956 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf348d-0a0b-43f2-b2d2-e19c8e85a2db None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:46.516048 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a895c-f641-406e-bdb3-106462ee6e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:46.516662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a895c-f641-406e-bdb3-106462ee6e0a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:46.516941 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a895c-f641-406e-bdb3-106462ee6e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:46.517211 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a895c-f641-406e-bdb3-106462ee6e0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:46.528905 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a895c-f641-406e-bdb3-106462ee6e0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:46.531174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a895c-f641-406e-bdb3-106462ee6e0a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:46.548397 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-605a895c-f641-406e-bdb3-106462ee6e0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:46.548397 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:46.548397 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:46.548397 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:46.548397 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:46.548397 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:46.548397 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:46.548397 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:46.548397 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:46.548397 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:46.548397 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:46.548397 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:46.548397 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:51:46.548397 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:51:46.548397 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:51:46.548397 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:51:46.549299 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:46.549299 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:46.549299 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:46.549299 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:46.549299 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:46.549299 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:46.549299 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:46.549299 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:46.549299 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:46.549299 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:46.549299 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:46.549299 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:46.549299 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:46.549299 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:46.549299 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:46.549299 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:46.549299 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:51:46.550152 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:51:46.550152 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:46.550152 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:46.550152 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 251/507] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:46.550358 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a895c-f641-406e-bdb3-106462ee6e0a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:46.580593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d88f7-6ecd-4000-b918-cc74bc1fe857 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:46.594327 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:46.604138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:46.616236 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84606f6f-8a90-4cff-b262-b3939487f285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:46.616852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84606f6f-8a90-4cff-b262-b3939487f285 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:46.617129 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84606f6f-8a90-4cff-b262-b3939487f285 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:46.617397 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84606f6f-8a90-4cff-b262-b3939487f285 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:46.624644 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84606f6f-8a90-4cff-b262-b3939487f285 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:46.626128 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84606f6f-8a90-4cff-b262-b3939487f285 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:46.637887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-84606f6f-8a90-4cff-b262-b3939487f285 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 00:51:46.637887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:46.637887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:46.637887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:46.637887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:46.637887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:46.637887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:46.637887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:46.637887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:46.637887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:46.637887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:46.637887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:46.637887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:51:46.637887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:51:46.637887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:51:46.637887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:51:46.638967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:46.638967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:46.638967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:51:46.638967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:51:46.638967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:51:46.638967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:51:46.638967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:46.638967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:46.638967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:46.638967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:46.638967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:46.638967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:46.638967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:46.638967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:46.638967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:46.638967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:46.638967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:46.638967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:46.639890 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:46.639890 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:46.639890 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:51:46.639890 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:51:46.639890 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:51:46.639890 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:51:46.639890 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:51:46.639890 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:51:46.639890 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 00:51:46.639890 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:46.639890 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 257/508] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:46.640480 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84606f6f-8a90-4cff-b262-b3939487f285 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:46.656111 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a895c-f641-406e-bdb3-106462ee6e0a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:46.689504 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a1090-6adc-4d0f-83be-e876a42d56fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:46.690067 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a1090-6adc-4d0f-83be-e876a42d56fd None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:46.690341 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a1090-6adc-4d0f-83be-e876a42d56fd None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:46.690603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a1090-6adc-4d0f-83be-e876a42d56fd None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:46.691366 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a1090-6adc-4d0f-83be-e876a42d56fd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:46.691668 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a1090-6adc-4d0f-83be-e876a42d56fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:46.693121 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a1090-6adc-4d0f-83be-e876a42d56fd None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:46.730202 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 252/509] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Sep 14 00:51:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:46.730804 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a1090-6adc-4d0f-83be-e876a42d56fd None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:46.743879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84606f6f-8a90-4cff-b262-b3939487f285 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:46.776374 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0965646-e93f-4134-b173-ae4d24361a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:46.776963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0965646-e93f-4134-b173-ae4d24361a29 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:46.777237 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0965646-e93f-4134-b173-ae4d24361a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:46.777518 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0965646-e93f-4134-b173-ae4d24361a29 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:46.778239 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0965646-e93f-4134-b173-ae4d24361a29 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:46.778540 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0965646-e93f-4134-b173-ae4d24361a29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:46.780204 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0965646-e93f-4134-b173-ae4d24361a29 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:46.816743 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 258/510] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Sep 14 00:51:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:46.817568 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0965646-e93f-4134-b173-ae4d24361a29 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:46.827257 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:46.830978 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a1090-6adc-4d0f-83be-e876a42d56fd None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:46.858298 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:46.865502 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93dbd8-808e-4809-9db7-dd91afe5e907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:46.866123 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93dbd8-808e-4809-9db7-dd91afe5e907 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:46.866393 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93dbd8-808e-4809-9db7-dd91afe5e907 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:46.866657 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93dbd8-808e-4809-9db7-dd91afe5e907 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:46.867288 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93dbd8-808e-4809-9db7-dd91afe5e907 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:46.867582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93dbd8-808e-4809-9db7-dd91afe5e907 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:46.868949 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93dbd8-808e-4809-9db7-dd91afe5e907 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:46.880403 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 253/511] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:46.881177 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93dbd8-808e-4809-9db7-dd91afe5e907 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:46.916135 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0965646-e93f-4134-b173-ae4d24361a29 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:46.949418 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7d6bf-82d0-47aa-81db-253bf0e28bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:46.950004 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7d6bf-82d0-47aa-81db-253bf0e28bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:46.950281 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7d6bf-82d0-47aa-81db-253bf0e28bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:46.950550 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7d6bf-82d0-47aa-81db-253bf0e28bc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:46.960252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7d6bf-82d0-47aa-81db-253bf0e28bc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:46.961675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7d6bf-82d0-47aa-81db-253bf0e28bc8 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:46.975721 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-2ff7d6bf-82d0-47aa-81db-253bf0e28bc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:46.975721 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:46.975721 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:46.975721 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:46.975721 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:46.975721 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:46.975721 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:46.975721 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:46.975721 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:46.975721 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:46.975721 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:46.975721 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:46.975721 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:51:46.975721 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:51:46.975721 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:51:46.975721 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:51:46.976740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:46.976740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:46.976740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:46.976740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:46.976740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:46.976740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:46.976740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:46.976740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:46.976740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:46.976740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:46.976740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:46.976740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:46.976740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:46.976740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:46.976740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:46.976740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:46.976740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:51:46.977560 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:51:46.977560 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:46.977560 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:46.977718 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93dbd8-808e-4809-9db7-dd91afe5e907 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:46.977983 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 259/512] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:46.977983 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7d6bf-82d0-47aa-81db-253bf0e28bc8 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:47.014753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34926556-db24-4df2-83c3-d0c7a9da082a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:47.015349 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34926556-db24-4df2-83c3-d0c7a9da082a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:47.015621 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34926556-db24-4df2-83c3-d0c7a9da082a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:47.015885 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34926556-db24-4df2-83c3-d0c7a9da082a None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:47.016594 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34926556-db24-4df2-83c3-d0c7a9da082a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:47.016897 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34926556-db24-4df2-83c3-d0c7a9da082a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:47.018375 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34926556-db24-4df2-83c3-d0c7a9da082a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:47.035653 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 254/513] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Sep 14 00:51:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:47.036540 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34926556-db24-4df2-83c3-d0c7a9da082a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:47.055185 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:47.075230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:47.081681 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7d6bf-82d0-47aa-81db-253bf0e28bc8 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:47.114677 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e43702-8b9d-4f65-9c9c-703064f4d995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:47.115280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e43702-8b9d-4f65-9c9c-703064f4d995 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:47.115558 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e43702-8b9d-4f65-9c9c-703064f4d995 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:47.115827 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e43702-8b9d-4f65-9c9c-703064f4d995 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:47.134245 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34926556-db24-4df2-83c3-d0c7a9da082a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:47.166701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ece1d-7939-4d58-aca3-8760b7a26726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:47.167284 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ece1d-7939-4d58-aca3-8760b7a26726 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:47.167555 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ece1d-7939-4d58-aca3-8760b7a26726 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:47.167816 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ece1d-7939-4d58-aca3-8760b7a26726 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:47.180724 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e43702-8b9d-4f65-9c9c-703064f4d995 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:47.182384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e43702-8b9d-4f65-9c9c-703064f4d995 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:47.232965 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ece1d-7939-4d58-aca3-8760b7a26726 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:47.234439 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ece1d-7939-4d58-aca3-8760b7a26726 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:47.251000 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:47.271710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:47.280309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 260/514] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:51:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:51:47.281378 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e43702-8b9d-4f65-9c9c-703064f4d995 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:47.331160 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 255/515] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:51:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:51:47.331982 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ece1d-7939-4d58-aca3-8760b7a26726 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:47.382451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e43702-8b9d-4f65-9c9c-703064f4d995 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:47.416651 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605035e7-44c7-480d-8ed3-1f1a6a20d828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:47.417248 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605035e7-44c7-480d-8ed3-1f1a6a20d828 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:47.417528 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605035e7-44c7-480d-8ed3-1f1a6a20d828 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:47.417820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605035e7-44c7-480d-8ed3-1f1a6a20d828 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:47.425026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605035e7-44c7-480d-8ed3-1f1a6a20d828 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:47.426525 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605035e7-44c7-480d-8ed3-1f1a6a20d828 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:47.427424 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ece1d-7939-4d58-aca3-8760b7a26726 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:47.438684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-605035e7-44c7-480d-8ed3-1f1a6a20d828 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 00:51:47.438684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:47.438684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:47.438684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:47.438684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:47.438684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:47.438684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:47.438684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:47.438684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:47.438684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:47.438684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:47.438684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:47.438684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:51:47.438684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:51:47.438684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:51:47.438684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:51:47.439587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:47.439587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:47.439587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:51:47.439587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:51:47.439587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:51:47.439587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:51:47.439587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:47.439587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:47.439587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:47.439587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:47.439587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:47.439587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:47.439587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:47.439587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:47.439587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:47.439587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:47.439587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:47.439587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:47.440448 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:47.440448 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:47.440448 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:51:47.440448 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:51:47.440448 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:51:47.440448 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:51:47.440448 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:51:47.440448 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:51:47.440448 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 00:51:47.440448 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:47.440448 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 261/516] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 14 00:51:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:47.440983 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605035e7-44c7-480d-8ed3-1f1a6a20d828 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:47.447678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:47.465555 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8c465-9290-4fed-8e8d-2a5c78bd7ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:47.466169 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8c465-9290-4fed-8e8d-2a5c78bd7ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:47.466441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8c465-9290-4fed-8e8d-2a5c78bd7ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:47.466705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8c465-9290-4fed-8e8d-2a5c78bd7ee3 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:47.467334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8c465-9290-4fed-8e8d-2a5c78bd7ee3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:47.467628 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8c465-9290-4fed-8e8d-2a5c78bd7ee3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:47.469052 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8c465-9290-4fed-8e8d-2a5c78bd7ee3 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:47.479759 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 256/517] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:47.480522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8c465-9290-4fed-8e8d-2a5c78bd7ee3 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:47.493476 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:47.537111 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605035e7-44c7-480d-8ed3-1f1a6a20d828 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:47.569252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792c444-6409-484e-ab16-5293afef485f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:47.569873 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792c444-6409-484e-ab16-5293afef485f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:47.570153 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792c444-6409-484e-ab16-5293afef485f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:47.570426 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792c444-6409-484e-ab16-5293afef485f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:47.577881 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8c465-9290-4fed-8e8d-2a5c78bd7ee3 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:47.612828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b88f7-bea3-43e5-a7e3-b50e87acf2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:47.613443 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b88f7-bea3-43e5-a7e3-b50e87acf2ad None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:47.613718 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b88f7-bea3-43e5-a7e3-b50e87acf2ad None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:47.614015 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b88f7-bea3-43e5-a7e3-b50e87acf2ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:47.626002 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b88f7-bea3-43e5-a7e3-b50e87acf2ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:47.627509 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b88f7-bea3-43e5-a7e3-b50e87acf2ad None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:47.639572 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792c444-6409-484e-ab16-5293afef485f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:47.641038 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792c444-6409-484e-ab16-5293afef485f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:47.641678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-417b88f7-bea3-43e5-a7e3-b50e87acf2ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:47.641678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:47.641678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:47.641678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:47.641678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:47.641678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:47.641678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:47.641678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:47.641678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:47.641678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:47.641678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:47.641678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:47.641678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:51:47.641678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:51:47.641678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:51:47.641678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:51:47.642741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:47.642741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:47.642741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:47.642741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:47.642741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:47.642741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:47.642741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:47.642741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:47.642741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:47.642741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:47.642741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:47.642741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:47.642741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:47.642741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:47.642741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:47.642741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:47.642741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:51:47.644062 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:51:47.644062 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:47.644062 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:47.644062 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 257/518] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:47.644062 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b88f7-bea3-43e5-a7e3-b50e87acf2ad None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:47.670582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:47.698056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:47.741866 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b88f7-bea3-43e5-a7e3-b50e87acf2ad None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:47.742535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 262/519] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:51:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:51:47.743357 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792c444-6409-484e-ab16-5293afef485f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:47.775260 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8a173-5b80-493d-b79c-bfe19a5d6640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:47.775803 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8a173-5b80-493d-b79c-bfe19a5d6640 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:47.776096 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8a173-5b80-493d-b79c-bfe19a5d6640 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:47.776341 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8a173-5b80-493d-b79c-bfe19a5d6640 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:47.787032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8a173-5b80-493d-b79c-bfe19a5d6640 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:47.788456 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8a173-5b80-493d-b79c-bfe19a5d6640 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:47.803089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-dbf8a173-5b80-493d-b79c-bfe19a5d6640 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:47.803089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:47.803089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:47.803089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:47.803089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:47.803089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:47.803089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:47.803089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:47.803089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:47.803089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:47.803089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:47.803089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:47.803089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:51:47.803089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:51:47.803089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:51:47.803089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:51:47.803975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:47.803975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:47.803975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:47.803975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:47.803975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:47.803975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:47.803975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:47.803975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:47.803975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:47.803975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:47.803975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:47.803975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:47.803975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:47.803975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:47.803975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:47.803975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:47.803975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:51:47.804798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:51:47.804798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:47.804798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:47.804798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 258/520] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:47.805006 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8a173-5b80-493d-b79c-bfe19a5d6640 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:47.846076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792c444-6409-484e-ab16-5293afef485f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:47.878901 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1d4f9-f046-4fa2-ac28-530105ad38ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:47.879491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1d4f9-f046-4fa2-ac28-530105ad38ac None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:47.879770 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1d4f9-f046-4fa2-ac28-530105ad38ac None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:47.880041 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1d4f9-f046-4fa2-ac28-530105ad38ac None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:47.880754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1d4f9-f046-4fa2-ac28-530105ad38ac None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:47.881054 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1d4f9-f046-4fa2-ac28-530105ad38ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:47.882514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1d4f9-f046-4fa2-ac28-530105ad38ac None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:47.882841 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:47.899612 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 263/521] 10.222.0.20 () {56 vars in 1139 bytes} [Wed Sep 14 00:51:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:47.900409 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1d4f9-f046-4fa2-ac28-530105ad38ac None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:47.903276 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8a173-5b80-493d-b79c-bfe19a5d6640 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:47.914227 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:47.936374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c40b6e-8ab9-421f-aa36-7fcfaf9f13c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:47.937488 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c40b6e-8ab9-421f-aa36-7fcfaf9f13c5 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:47.937770 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c40b6e-8ab9-421f-aa36-7fcfaf9f13c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:47.938069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c40b6e-8ab9-421f-aa36-7fcfaf9f13c5 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:47.938733 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c40b6e-8ab9-421f-aa36-7fcfaf9f13c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:47.940177 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c40b6e-8ab9-421f-aa36-7fcfaf9f13c5 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:47.960502 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 259/522] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 14 00:51:47 2022] POST /identity/v3/users => generated 247 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:51:47.961293 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c40b6e-8ab9-421f-aa36-7fcfaf9f13c5 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:48.017400 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1d4f9-f046-4fa2-ac28-530105ad38ac None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:48.062436 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0884cf8-3b25-4d54-b40f-f6b0a73fdb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:48.063119 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0884cf8-3b25-4d54-b40f-f6b0a73fdb81 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:48.063717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0884cf8-3b25-4d54-b40f-f6b0a73fdb81 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:48.064033 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0884cf8-3b25-4d54-b40f-f6b0a73fdb81 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:48.064647 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0884cf8-3b25-4d54-b40f-f6b0a73fdb81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:48.064954 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0884cf8-3b25-4d54-b40f-f6b0a73fdb81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:48.066884 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0884cf8-3b25-4d54-b40f-f6b0a73fdb81 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:48.079745 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 264/523] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:48.080610 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0884cf8-3b25-4d54-b40f-f6b0a73fdb81 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:48.080943 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c40b6e-8ab9-421f-aa36-7fcfaf9f13c5 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:48.124759 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c28d9-466c-40c9-be95-fe86a8ba05d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:48.125398 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c28d9-466c-40c9-be95-fe86a8ba05d5 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:48.125673 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c28d9-466c-40c9-be95-fe86a8ba05d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:48.125996 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c28d9-466c-40c9-be95-fe86a8ba05d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:48.129461 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:48.142850 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c28d9-466c-40c9-be95-fe86a8ba05d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:48.145238 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c28d9-466c-40c9-be95-fe86a8ba05d5 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:48.159579 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:48.162218 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-9a1c28d9-466c-40c9-be95-fe86a8ba05d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:48.162218 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:48.162218 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:48.162218 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:48.162218 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:48.162218 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:48.162218 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:48.162218 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:48.162218 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:48.162218 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:48.162218 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:48.162218 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:48.162218 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:51:48.162218 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:51:48.162218 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:51:48.162218 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:51:48.163320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:48.163320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:48.163320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:48.163320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:48.163320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:48.163320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:48.163320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:48.163320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:48.163320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:48.163320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:48.163320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:48.163320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:48.163320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:48.163320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:48.163320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:48.163320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:48.163320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:51:48.164499 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:51:48.164499 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:48.164499 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:48.164499 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 260/524] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:48.164499 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c28d9-466c-40c9-be95-fe86a8ba05d5 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:48.197610 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0884cf8-3b25-4d54-b40f-f6b0a73fdb81 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:48.235330 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c3286-be01-4c82-87c0-6e6205db15bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:48.235935 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c3286-be01-4c82-87c0-6e6205db15bc None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:48.236216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c3286-be01-4c82-87c0-6e6205db15bc None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:48.236497 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c3286-be01-4c82-87c0-6e6205db15bc None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:48.237144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c3286-be01-4c82-87c0-6e6205db15bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:48.237448 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c3286-be01-4c82-87c0-6e6205db15bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:48.238933 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c3286-be01-4c82-87c0-6e6205db15bc None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:48.254920 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 265/525] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:48.254920 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c3286-be01-4c82-87c0-6e6205db15bc None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:48.280341 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c28d9-466c-40c9-be95-fe86a8ba05d5 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:48.315957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45aae79-d56f-4b5e-b493-19e848db8b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:48.316594 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45aae79-d56f-4b5e-b493-19e848db8b75 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:48.316872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45aae79-d56f-4b5e-b493-19e848db8b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:48.317140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45aae79-d56f-4b5e-b493-19e848db8b75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:48.354822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c3286-be01-4c82-87c0-6e6205db15bc None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:48.376324 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:48.386014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:48.390482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45aae79-d56f-4b5e-b493-19e848db8b75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:48.391918 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45aae79-d56f-4b5e-b493-19e848db8b75 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:48.392742 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36a8d9-80f0-4390-8bc6-8e2d0718c776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:48.393361 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36a8d9-80f0-4390-8bc6-8e2d0718c776 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:48.393914 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36a8d9-80f0-4390-8bc6-8e2d0718c776 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:48.394191 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36a8d9-80f0-4390-8bc6-8e2d0718c776 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:48.402699 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36a8d9-80f0-4390-8bc6-8e2d0718c776 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:48.405080 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36a8d9-80f0-4390-8bc6-8e2d0718c776 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:48.419613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-db36a8d9-80f0-4390-8bc6-8e2d0718c776 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:51:48.419613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:48.419613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:48.419613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:48.419613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:48.419613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:48.419613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:48.419613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:48.419613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:48.419613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:48.419613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:48.419613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:48.419613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:51:48.419613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:51:48.419613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:51:48.420889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:51:48.420889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:48.420889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:48.420889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:48.420889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:48.420889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:48.420889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:48.420889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:48.420889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:48.420889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:48.420889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:48.420889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:48.420889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:48.420889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:48.420889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:48.420889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:48.420889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:48.422883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:51:48.422883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:51:48.422883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:51:48.422883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:51:48.422883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:51:48.422883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:51:48.422883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:51:48.422883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:48.422883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 266/526] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:51:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:48.422883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36a8d9-80f0-4390-8bc6-8e2d0718c776 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:48.511149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 261/527] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:51:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:51:48.511149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45aae79-d56f-4b5e-b493-19e848db8b75 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:48.540322 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36a8d9-80f0-4390-8bc6-8e2d0718c776 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:48.579689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c30a4-776a-4dc5-a27d-13bbe6f292cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:48.580221 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c30a4-776a-4dc5-a27d-13bbe6f292cc None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:48.580801 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c30a4-776a-4dc5-a27d-13bbe6f292cc None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:48.581073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c30a4-776a-4dc5-a27d-13bbe6f292cc None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:48.581759 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c30a4-776a-4dc5-a27d-13bbe6f292cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:48.582037 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c30a4-776a-4dc5-a27d-13bbe6f292cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:48.583385 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c30a4-776a-4dc5-a27d-13bbe6f292cc None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:48.600735 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 267/528] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:48.600735 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c30a4-776a-4dc5-a27d-13bbe6f292cc None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:48.602056 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:48.613873 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45aae79-d56f-4b5e-b493-19e848db8b75 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:48.651577 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7c3cb-8651-4ebf-a517-5b9dd521673c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:48.652524 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7c3cb-8651-4ebf-a517-5b9dd521673c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:48.652978 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7c3cb-8651-4ebf-a517-5b9dd521673c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:48.653414 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7c3cb-8651-4ebf-a517-5b9dd521673c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:48.658740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:48.661236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7c3cb-8651-4ebf-a517-5b9dd521673c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:48.662709 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7c3cb-8651-4ebf-a517-5b9dd521673c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:48.674969 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-d2e7c3cb-8651-4ebf-a517-5b9dd521673c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:51:48.674969 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:48.674969 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:48.674969 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:48.674969 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:48.674969 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:48.674969 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:48.674969 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:48.674969 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:48.674969 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:48.674969 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:48.674969 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:48.674969 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:51:48.674969 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:51:48.674969 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:51:48.675814 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:51:48.675814 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:48.675814 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:48.675814 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:48.675814 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:48.675814 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:48.675814 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:48.675814 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:48.675814 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:48.675814 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:48.675814 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:48.675814 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:48.675814 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:48.675814 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:48.675814 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:48.675814 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:48.675814 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:48.676640 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:51:48.676640 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:51:48.676640 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:51:48.676640 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:51:48.676640 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:51:48.676640 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:51:48.676640 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:51:48.676640 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:48.676640 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 262/529] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:51:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:48.677602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7c3cb-8651-4ebf-a517-5b9dd521673c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:48.713674 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c30a4-776a-4dc5-a27d-13bbe6f292cc None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:48.752798 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f806dda-77b1-49ef-961d-d8428ba665cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:48.753487 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f806dda-77b1-49ef-961d-d8428ba665cc None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:48.753768 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f806dda-77b1-49ef-961d-d8428ba665cc None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:48.754079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f806dda-77b1-49ef-961d-d8428ba665cc None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:48.754756 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f806dda-77b1-49ef-961d-d8428ba665cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:48.755055 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f806dda-77b1-49ef-961d-d8428ba665cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:48.756476 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f806dda-77b1-49ef-961d-d8428ba665cc None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:48.774971 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 268/530] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:51:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:48.775736 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f806dda-77b1-49ef-961d-d8428ba665cc None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:48.786047 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7c3cb-8651-4ebf-a517-5b9dd521673c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:48.822607 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bf0fd-1908-4034-b95d-916062a20288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:48.823191 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bf0fd-1908-4034-b95d-916062a20288 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:48.823511 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bf0fd-1908-4034-b95d-916062a20288 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:48.823722 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bf0fd-1908-4034-b95d-916062a20288 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:48.836512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bf0fd-1908-4034-b95d-916062a20288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:48.837962 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bf0fd-1908-4034-b95d-916062a20288 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:48.846733 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:48.853898 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-847bf0fd-1908-4034-b95d-916062a20288 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:48.853898 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:48.853898 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:48.853898 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:48.853898 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:48.853898 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:48.853898 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:48.853898 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:48.853898 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:48.853898 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:48.853898 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:48.853898 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:48.853898 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:51:48.853898 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:51:48.853898 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:51:48.853898 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:51:48.854798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:48.854798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:48.854798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:48.854798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:48.854798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:48.854798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:48.854798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:48.854798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:48.854798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:48.854798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:48.854798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:48.854798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:48.854798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:48.854798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:48.854798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:48.854798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:48.854798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:51:48.855639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:51:48.855639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:48.855639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:48.864029 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 263/531] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:48.865192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bf0fd-1908-4034-b95d-916062a20288 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:48.890126 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f806dda-77b1-49ef-961d-d8428ba665cc None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:48.905211 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:48.928692 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4a1e9-65e0-466f-9f75-8dc09b3d7216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:48.929419 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4a1e9-65e0-466f-9f75-8dc09b3d7216 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:48.929698 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4a1e9-65e0-466f-9f75-8dc09b3d7216 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:48.930116 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4a1e9-65e0-466f-9f75-8dc09b3d7216 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:48.937378 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4a1e9-65e0-466f-9f75-8dc09b3d7216 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:48.938843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4a1e9-65e0-466f-9f75-8dc09b3d7216 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:48.950822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-06b4a1e9-65e0-466f-9f75-8dc09b3d7216 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:51:48.950822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:48.950822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:48.950822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:48.950822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:48.950822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:48.950822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:48.950822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:48.950822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:48.950822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:48.950822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:48.950822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:48.950822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:51:48.950822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:51:48.950822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:51:48.951653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:51:48.951653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:48.951653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:48.951653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:48.951653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:48.951653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:48.951653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:48.951653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:48.951653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:48.951653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:48.951653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:48.951653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:48.951653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:48.951653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:48.951653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:48.951653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:48.951653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:48.953010 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:51:48.953010 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:51:48.953010 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:51:48.953010 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:51:48.953010 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:51:48.953010 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:51:48.953010 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:51:48.953010 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:48.953010 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 269/532] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:51:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:48.953462 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4a1e9-65e0-466f-9f75-8dc09b3d7216 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:48.972259 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bf0fd-1908-4034-b95d-916062a20288 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:49.013406 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b75dc3-8d5a-45b3-a2e1-58692cad6980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:49.014030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b75dc3-8d5a-45b3-a2e1-58692cad6980 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:49.014307 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b75dc3-8d5a-45b3-a2e1-58692cad6980 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:49.014577 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b75dc3-8d5a-45b3-a2e1-58692cad6980 None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:49.015283 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b75dc3-8d5a-45b3-a2e1-58692cad6980 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:49.015582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b75dc3-8d5a-45b3-a2e1-58692cad6980 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:49.016984 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b75dc3-8d5a-45b3-a2e1-58692cad6980 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:49.035569 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 264/533] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:51:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:49.036286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b75dc3-8d5a-45b3-a2e1-58692cad6980 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:49.068539 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4a1e9-65e0-466f-9f75-8dc09b3d7216 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:49.100790 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:49.109719 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553837e7-1a36-4ad4-9a50-5ce179b9e69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:49.110753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553837e7-1a36-4ad4-9a50-5ce179b9e69d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:49.111196 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553837e7-1a36-4ad4-9a50-5ce179b9e69d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:49.111605 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553837e7-1a36-4ad4-9a50-5ce179b9e69d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:49.112464 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553837e7-1a36-4ad4-9a50-5ce179b9e69d None admin] RBAC: Adding query filter params (role.id=b9c910c1c68948858203c62521b73efc, scope.project.id=f37c835c05924364bcd1530d44f024fe, user.id=c05caac9e8b9498583780306887734be) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:49.112908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553837e7-1a36-4ad4-9a50-5ce179b9e69d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:49.114699 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553837e7-1a36-4ad4-9a50-5ce179b9e69d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:49.129826 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 270/534] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:51:48 2022] GET /identity/v3/role_assignments?user.id=c05caac9e8b9498583780306887734be&scope.project.id=f37c835c05924364bcd1530d44f024fe&role.id=b9c910c1c68948858203c62521b73efc => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:49.129826 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553837e7-1a36-4ad4-9a50-5ce179b9e69d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:49.168567 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:49.170518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b75dc3-8d5a-45b3-a2e1-58692cad6980 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:49.225104 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd401fe1-0e59-46b1-b506-946fdf0b1b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:49.225915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd401fe1-0e59-46b1-b506-946fdf0b1b9c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:49.226294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd401fe1-0e59-46b1-b506-946fdf0b1b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:49.226818 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd401fe1-0e59-46b1-b506-946fdf0b1b9c None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:49.227622 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd401fe1-0e59-46b1-b506-946fdf0b1b9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:49.227976 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd401fe1-0e59-46b1-b506-946fdf0b1b9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:49.229488 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd401fe1-0e59-46b1-b506-946fdf0b1b9c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:49.243302 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 265/535] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:49.244184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd401fe1-0e59-46b1-b506-946fdf0b1b9c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:49.255100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553837e7-1a36-4ad4-9a50-5ce179b9e69d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:49.295856 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b347b-8994-4087-a4c4-5a734e79d936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:49.295856 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b347b-8994-4087-a4c4-5a734e79d936 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:49.296669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b347b-8994-4087-a4c4-5a734e79d936 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:49.296905 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b347b-8994-4087-a4c4-5a734e79d936 None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:49.297824 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b347b-8994-4087-a4c4-5a734e79d936 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:49.298393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b347b-8994-4087-a4c4-5a734e79d936 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:49.300224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b347b-8994-4087-a4c4-5a734e79d936 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:49.314133 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 271/536] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:51:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:49.315855 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b347b-8994-4087-a4c4-5a734e79d936 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:49.370897 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd401fe1-0e59-46b1-b506-946fdf0b1b9c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:49.398233 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:49.417912 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665f4c5-761e-4690-a992-2f75406a46c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:49.418732 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665f4c5-761e-4690-a992-2f75406a46c3 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:49.419104 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665f4c5-761e-4690-a992-2f75406a46c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:49.419463 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665f4c5-761e-4690-a992-2f75406a46c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:49.420275 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665f4c5-761e-4690-a992-2f75406a46c3 None admin] RBAC: Adding query filter params (role.id=b9c910c1c68948858203c62521b73efc, scope.project.id=f37c835c05924364bcd1530d44f024fe, user.id=ee54ed3a092e4eef9082c4e86bd918a2) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:49.420676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665f4c5-761e-4690-a992-2f75406a46c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:49.422953 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665f4c5-761e-4690-a992-2f75406a46c3 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:49.429439 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 266/537] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:51:49 2022] GET /identity/v3/role_assignments?user.id=ee54ed3a092e4eef9082c4e86bd918a2&scope.project.id=f37c835c05924364bcd1530d44f024fe&role.id=b9c910c1c68948858203c62521b73efc => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:49.429897 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:49.431339 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665f4c5-761e-4690-a992-2f75406a46c3 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:49.437512 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b347b-8994-4087-a4c4-5a734e79d936 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:49.480404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52875a01-5523-4a0a-8b09-7d0a5f3a8a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:49.481042 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52875a01-5523-4a0a-8b09-7d0a5f3a8a21 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:49.481322 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52875a01-5523-4a0a-8b09-7d0a5f3a8a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:49.481595 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52875a01-5523-4a0a-8b09-7d0a5f3a8a21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:49.490609 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52875a01-5523-4a0a-8b09-7d0a5f3a8a21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:49.492319 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52875a01-5523-4a0a-8b09-7d0a5f3a8a21 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:49.507239 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-52875a01-5523-4a0a-8b09-7d0a5f3a8a21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:51:49.507239 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:49.507239 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:49.507239 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:49.507239 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:49.507239 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:49.507239 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:49.507239 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:49.507239 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:49.507239 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:49.507239 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:49.507239 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:49.507239 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:51:49.507239 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:51:49.507239 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:51:49.509026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:51:49.509026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:49.509026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:49.509026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:49.509026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:49.509026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:49.509026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:49.509026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:49.509026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:49.509026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:49.509026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:49.509026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:49.509026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:49.509026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:49.509026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:49.509026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:49.509026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:49.510854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:51:49.510854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:51:49.510854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:51:49.510854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:51:49.510854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:51:49.510854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:51:49.510854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:51:49.510854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:49.517828 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 272/538] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:51:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:49.517828 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52875a01-5523-4a0a-8b09-7d0a5f3a8a21 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:49.551862 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665f4c5-761e-4690-a992-2f75406a46c3 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:49.593970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cd6b9-d514-4500-af51-a959055eea57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:49.594790 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cd6b9-d514-4500-af51-a959055eea57 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:49.595130 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cd6b9-d514-4500-af51-a959055eea57 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:49.595594 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cd6b9-d514-4500-af51-a959055eea57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:49.596383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976cd6b9-d514-4500-af51-a959055eea57 None admin] RBAC: Adding query filter params (role.id=b9c910c1c68948858203c62521b73efc, scope.project.id=f37c835c05924364bcd1530d44f024fe, user.id=50394b1ba51b45a6bf833b63ff7e423b) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:49.596769 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976cd6b9-d514-4500-af51-a959055eea57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:49.598485 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976cd6b9-d514-4500-af51-a959055eea57 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:49.605162 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 267/539] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:51:49 2022] GET /identity/v3/role_assignments?user.id=50394b1ba51b45a6bf833b63ff7e423b&scope.project.id=f37c835c05924364bcd1530d44f024fe&role.id=b9c910c1c68948858203c62521b73efc => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:49.694362 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52875a01-5523-4a0a-8b09-7d0a5f3a8a21 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:49.747203 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f566927-7d1f-42d6-88c6-67f26553938c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:49.747819 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f566927-7d1f-42d6-88c6-67f26553938c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:49.748096 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f566927-7d1f-42d6-88c6-67f26553938c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:49.748358 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f566927-7d1f-42d6-88c6-67f26553938c None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:49.750305 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f566927-7d1f-42d6-88c6-67f26553938c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:49.750612 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f566927-7d1f-42d6-88c6-67f26553938c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:49.752089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f566927-7d1f-42d6-88c6-67f26553938c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:49.766200 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 273/540] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:51:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:51:49.772236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cd6b9-d514-4500-af51-a959055eea57 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:49.849864 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:49.908863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cd6b9-d514-4500-af51-a959055eea57 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:49.945371 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15670fc9-cb65-4a1f-830a-d5829ec07dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:49.945922 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15670fc9-cb65-4a1f-830a-d5829ec07dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:49.946199 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15670fc9-cb65-4a1f-830a-d5829ec07dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:49.946507 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15670fc9-cb65-4a1f-830a-d5829ec07dc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:49.947235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15670fc9-cb65-4a1f-830a-d5829ec07dc1 None admin] RBAC: Adding query filter params (role.id=b9c910c1c68948858203c62521b73efc, scope.project.id=f37c835c05924364bcd1530d44f024fe, user.id=b4444b17075f4224a4da1ef501fd4eb5) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:49.947537 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15670fc9-cb65-4a1f-830a-d5829ec07dc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:49.948985 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15670fc9-cb65-4a1f-830a-d5829ec07dc1 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:49.962720 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 268/541] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:51:49 2022] GET /identity/v3/role_assignments?user.id=b4444b17075f4224a4da1ef501fd4eb5&scope.project.id=f37c835c05924364bcd1530d44f024fe&role.id=b9c910c1c68948858203c62521b73efc => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:50.401972 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f9662-3314-4e08-83b0-8569d0bbf0d0 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:50.402353 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f9662-3314-4e08-83b0-8569d0bbf0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:50.402551 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f9662-3314-4e08-83b0-8569d0bbf0d0 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:50.404105 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 274/542] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:50.409373 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadc512-567e-4826-9279-2c7f72f6cb78 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:50.409915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadc512-567e-4826-9279-2c7f72f6cb78 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:50.409915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadc512-567e-4826-9279-2c7f72f6cb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:50.433125 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-dbadc512-567e-4826-9279-2c7f72f6cb78 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:50.434376 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-dbadc512-567e-4826-9279-2c7f72f6cb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:50.523980 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 269/543] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:50.950216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f9662-3314-4e08-83b0-8569d0bbf0d0 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:50.976430 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:51.093761 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f9662-3314-4e08-83b0-8569d0bbf0d0 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:51.144839 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85f455-9a9e-4e3f-b673-09698a04d54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:51.145470 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85f455-9a9e-4e3f-b673-09698a04d54d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:51.145748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85f455-9a9e-4e3f-b673-09698a04d54d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:51.146041 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85f455-9a9e-4e3f-b673-09698a04d54d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:51.162434 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85f455-9a9e-4e3f-b673-09698a04d54d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:51.167252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-5a85f455-9a9e-4e3f-b673-09698a04d54d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:51:51.167252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:51.167252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:51.167252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:51.167252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:51.167252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:51.167252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:51.167252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:51.167252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:51.167252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:51.167252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:51.167252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:51.167252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:51.167252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:51.167252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:51.167252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:51.168101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:51.168101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:51.168101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:51.168101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:51.168101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:51.168101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:51.168101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:51.168101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:51.168101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:51.168101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:51.168101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:51.168101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:51.168101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:51.168101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:51.168101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:51.168101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:51.168860 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:51.168860 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:51.168860 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:51.168860 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:51.168860 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:51.168860 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:51.168860 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:51.168860 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:51.168860 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:51.168860 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:51.168860 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:51:51.168860 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:51.168860 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 275/544] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 14 00:51:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:51.174461 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbadc512-567e-4826-9279-2c7f72f6cb78 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:51.229305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:51.305534 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbadc512-567e-4826-9279-2c7f72f6cb78 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:51.340665 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25065ff0-ea2d-47fb-9357-28775e3f8603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:51.341262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25065ff0-ea2d-47fb-9357-28775e3f8603 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:51.341537 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25065ff0-ea2d-47fb-9357-28775e3f8603 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:51.341833 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25065ff0-ea2d-47fb-9357-28775e3f8603 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:51.342482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25065ff0-ea2d-47fb-9357-28775e3f8603 None admin] RBAC: Adding query filter params (name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:51.342854 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25065ff0-ea2d-47fb-9357-28775e3f8603 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:51.344215 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25065ff0-ea2d-47fb-9357-28775e3f8603 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:51.352779 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 270/545] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 14 00:51:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:51.358905 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85f455-9a9e-4e3f-b673-09698a04d54d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:51.442624 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:51.466409 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85f455-9a9e-4e3f-b673-09698a04d54d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:51.500953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddad818-b1d9-4c38-82dd-958c2da589f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:51.501980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddad818-b1d9-4c38-82dd-958c2da589f5 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:51.502465 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddad818-b1d9-4c38-82dd-958c2da589f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:51.502954 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddad818-b1d9-4c38-82dd-958c2da589f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:51.515975 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddad818-b1d9-4c38-82dd-958c2da589f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:51.517645 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddad818-b1d9-4c38-82dd-958c2da589f5 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:51.534623 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-eddad818-b1d9-4c38-82dd-958c2da589f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:51.534623 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:51.534623 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:51.534623 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:51.534623 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:51.534623 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:51.534623 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:51.534623 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:51.534623 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:51.534623 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:51.534623 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:51.534623 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:51.534623 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:51:51.534623 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:51:51.534623 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:51:51.534623 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:51:51.535575 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:51.535575 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:51.535575 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:51.535575 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:51.535575 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:51.535575 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:51.535575 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:51.535575 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:51.535575 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:51.535575 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:51.535575 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:51.535575 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:51.535575 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:51.535575 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:51.535575 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:51.535575 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:51.535575 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:51:51.536431 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:51:51.536431 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:51.536431 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:51.536431 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 276/546] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:51.541967 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25065ff0-ea2d-47fb-9357-28775e3f8603 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:51.665174 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394f340-0502-4291-b910-c3a0f1593849 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:51.665495 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394f340-0502-4291-b910-c3a0f1593849 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:51.665713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394f340-0502-4291-b910-c3a0f1593849 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:51.667070 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 277/547] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:51.667176 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25065ff0-ea2d-47fb-9357-28775e3f8603 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:51.669632 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:51.672701 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c5ce7-e597-49e3-ad46-929e712343ab None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:51.673006 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c5ce7-e597-49e3-ad46-929e712343ab None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:51.673285 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c5ce7-e597-49e3-ad46-929e712343ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:51.696989 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e82c5ce7-e597-49e3-ad46-929e712343ab None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:51.698391 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e82c5ce7-e597-49e3-ad46-929e712343ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:51.709393 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5828014-cf04-410a-9646-4b02499884e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:51.710131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5828014-cf04-410a-9646-4b02499884e4 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:51.710414 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5828014-cf04-410a-9646-4b02499884e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:51.710687 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5828014-cf04-410a-9646-4b02499884e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:51.711432 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5828014-cf04-410a-9646-4b02499884e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:51.711737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5828014-cf04-410a-9646-4b02499884e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:51.713103 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5828014-cf04-410a-9646-4b02499884e4 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:51.726969 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 271/548] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:51.732323 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5828014-cf04-410a-9646-4b02499884e4 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:51.829756 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 278/549] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:51.967278 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5828014-cf04-410a-9646-4b02499884e4 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:52.074537 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77ae54-1f68-4a5e-aa56-5cd570614425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:52.075181 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77ae54-1f68-4a5e-aa56-5cd570614425 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:52.075460 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77ae54-1f68-4a5e-aa56-5cd570614425 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:52.075732 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77ae54-1f68-4a5e-aa56-5cd570614425 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:52.095000 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77ae54-1f68-4a5e-aa56-5cd570614425 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:52.096386 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77ae54-1f68-4a5e-aa56-5cd570614425 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:52.122286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-fa77ae54-1f68-4a5e-aa56-5cd570614425 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 00:51:52.122286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:52.122286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:52.122286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:52.122286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:52.122286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:52.122286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:52.122286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:52.122286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:52.122286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:52.122286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:52.122286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:52.122286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:51:52.122286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:51:52.122286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:51:52.122286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:51:52.124032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:52.124032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:52.124032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:51:52.124032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:51:52.124032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:51:52.124032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:51:52.124032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:52.124032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:52.124032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:52.124032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:52.124032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:52.124032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:52.124032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:52.124032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:52.124032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:52.124032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:52.124032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:52.124032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:52.125531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:52.125531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:52.125531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:51:52.125531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:51:52.125531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:51:52.125531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:51:52.125531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:51:52.125531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:51:52.125531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 00:51:52.125531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:52.125531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 272/550] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:51:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:51:52.131289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c5ce7-e597-49e3-ad46-929e712343ab None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:52.136920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a49715-a9e3-4663-a929-d649721ef2d6 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:52.137202 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a49715-a9e3-4663-a929-d649721ef2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:52.137478 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a49715-a9e3-4663-a929-d649721ef2d6 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:52.138861 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 273/551] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 00:51:52.144998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbfdaf-cc47-4780-a72c-db70c6d5cd72 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:52.145280 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbfdaf-cc47-4780-a72c-db70c6d5cd72 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:52.145547 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbfdaf-cc47-4780-a72c-db70c6d5cd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:52.199084 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-e1dbfdaf-cc47-4780-a72c-db70c6d5cd72 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:52.202049 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e1dbfdaf-cc47-4780-a72c-db70c6d5cd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:52.224361 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:52.250984 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:52.268680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c5ce7-e597-49e3-ad46-929e712343ab None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:52.344526 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb977d-ad22-46f4-902d-6e793a02b064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:52.345193 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb977d-ad22-46f4-902d-6e793a02b064 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:52.345414 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb977d-ad22-46f4-902d-6e793a02b064 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:52.345682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb977d-ad22-46f4-902d-6e793a02b064 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:52.346420 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb977d-ad22-46f4-902d-6e793a02b064 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:52.346631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 274/552] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:52.346730 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb977d-ad22-46f4-902d-6e793a02b064 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:52.347786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dbfdaf-cc47-4780-a72c-db70c6d5cd72 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:52.348133 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb977d-ad22-46f4-902d-6e793a02b064 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:52.377125 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 279/553] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Sep 14 00:51:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:52.385736 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb977d-ad22-46f4-902d-6e793a02b064 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:52.504124 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb977d-ad22-46f4-902d-6e793a02b064 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:52.524472 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dbfdaf-cc47-4780-a72c-db70c6d5cd72 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:52.538396 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:52.540591 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466cfe4-ec5e-4bbf-a335-76aadb34926c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:52.541264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466cfe4-ec5e-4bbf-a335-76aadb34926c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:52.541840 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466cfe4-ec5e-4bbf-a335-76aadb34926c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:52.541840 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466cfe4-ec5e-4bbf-a335-76aadb34926c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:52.561853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99de98e-933b-4eba-aca1-a7e340a5abc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:52.562542 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99de98e-933b-4eba-aca1-a7e340a5abc9 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:52.562822 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99de98e-933b-4eba-aca1-a7e340a5abc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:52.563091 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99de98e-933b-4eba-aca1-a7e340a5abc9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:52.574099 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99de98e-933b-4eba-aca1-a7e340a5abc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:52.579204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-d99de98e-933b-4eba-aca1-a7e340a5abc9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:51:52.579204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:52.579204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:52.579204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:52.579204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:52.579204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:52.579204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:52.579204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:52.579204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:52.579204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:52.579204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:52.579204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:52.579204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:52.579204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:52.579204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:52.579204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:52.580124 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:52.580124 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:52.580124 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:52.580124 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:52.580124 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:52.580124 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:52.580124 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:52.580124 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:52.580124 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:52.580124 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:52.580124 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:52.580124 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:52.580124 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:52.580124 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:52.580124 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:52.580124 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:52.581531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:52.581531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:52.581531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:52.581531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:52.581531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:52.581531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:52.581531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:52.581531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:52.581531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:52.581531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:52.581531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:51:52.581531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:52.581531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 275/554] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 14 00:51:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:52.582272 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca9671-21c1-40b1-817a-d4cd2a320b8d None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:52.582272 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca9671-21c1-40b1-817a-d4cd2a320b8d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:52.582615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca9671-21c1-40b1-817a-d4cd2a320b8d None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:52.583931 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 276/555] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:52.588605 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca9671-21c1-40b1-817a-d4cd2a320b8d None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:52.606070 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:52.621896 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466cfe4-ec5e-4bbf-a335-76aadb34926c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:52.623568 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466cfe4-ec5e-4bbf-a335-76aadb34926c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:52.699342 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca9671-21c1-40b1-817a-d4cd2a320b8d None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:52.734267 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cc26a-dceb-429a-9a12-cee33f1358e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:52.734863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cc26a-dceb-429a-9a12-cee33f1358e4 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:52.735138 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cc26a-dceb-429a-9a12-cee33f1358e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:52.735400 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cc26a-dceb-429a-9a12-cee33f1358e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:52.736061 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cc26a-dceb-429a-9a12-cee33f1358e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:52.736358 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cc26a-dceb-429a-9a12-cee33f1358e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:52.737826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cc26a-dceb-429a-9a12-cee33f1358e4 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:52.740867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 280/556] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:51:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:51:52.742219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81424d6e-bd29-496f-83d8-04e0a3601510 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:52.742509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81424d6e-bd29-496f-83d8-04e0a3601510 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:52.742781 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81424d6e-bd29-496f-83d8-04e0a3601510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:52.746289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 277/557] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 14 00:51:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:52.747078 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cc26a-dceb-429a-9a12-cee33f1358e4 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:52.766055 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-81424d6e-bd29-496f-83d8-04e0a3601510 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:52.767240 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-81424d6e-bd29-496f-83d8-04e0a3601510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:52.778445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:52.830961 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:52.845837 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 281/558] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:52.845837 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81424d6e-bd29-496f-83d8-04e0a3601510 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:52.865054 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cc26a-dceb-429a-9a12-cee33f1358e4 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:52.909596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5140d-bbd7-454e-a66c-2cd8701c4af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:52.910657 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5140d-bbd7-454e-a66c-2cd8701c4af3 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:52.910933 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5140d-bbd7-454e-a66c-2cd8701c4af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:52.911477 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5140d-bbd7-454e-a66c-2cd8701c4af3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:52.926322 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5140d-bbd7-454e-a66c-2cd8701c4af3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:52.931596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-a2d5140d-bbd7-454e-a66c-2cd8701c4af3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:51:52.931596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:52.931596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:52.931596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:52.931596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:52.931596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:52.931596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:52.931596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:52.931596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:52.931596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:52.931596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:52.931596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:52.931596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:52.931596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:52.931596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:52.931596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:52.932492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:52.932492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:52.932492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:52.932492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:52.932492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:52.932492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:52.932492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:52.932492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:52.932492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:52.932492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:52.932492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:52.932492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:52.932492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:52.932492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:52.932492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:52.932492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:52.933318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:52.933318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:52.933318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:52.933318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:52.933318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:52.933318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:52.933318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:52.933318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:52.933318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:52.933318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:52.933318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:51:52.933318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:52.937662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 278/559] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 14 00:51:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:52.938511 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5140d-bbd7-454e-a66c-2cd8701c4af3 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:52.970121 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81424d6e-bd29-496f-83d8-04e0a3601510 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:53.011024 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34415a3-1958-4999-9a9a-ab6cf7fdbef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:53.011964 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34415a3-1958-4999-9a9a-ab6cf7fdbef9 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:53.012518 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34415a3-1958-4999-9a9a-ab6cf7fdbef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:53.012991 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34415a3-1958-4999-9a9a-ab6cf7fdbef9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:53.027248 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34415a3-1958-4999-9a9a-ab6cf7fdbef9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:53.028978 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34415a3-1958-4999-9a9a-ab6cf7fdbef9 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:53.038431 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:53.047384 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5140d-bbd7-454e-a66c-2cd8701c4af3 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:53.050410 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-d34415a3-1958-4999-9a9a-ab6cf7fdbef9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:53.050410 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:53.050410 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:53.050410 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:53.050410 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:53.050410 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:53.050410 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:53.050410 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:53.050410 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:53.050410 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:53.050410 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:53.050410 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:53.050410 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:51:53.050410 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:51:53.050410 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:51:53.050410 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:51:53.051311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:53.051311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:53.051311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:53.051311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:53.051311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:53.051311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:53.051311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:53.051311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:53.051311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:53.051311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:53.051311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:53.051311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:53.051311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:53.051311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:53.051311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:53.051311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:53.051311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:51:53.052179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:51:53.052179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:53.052179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:53.052179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 282/560] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:53.057250 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34415a3-1958-4999-9a9a-ab6cf7fdbef9 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:53.097850 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5259119-f91f-43aa-b247-6f191aa6c910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:53.098997 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5259119-f91f-43aa-b247-6f191aa6c910 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:53.098997 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5259119-f91f-43aa-b247-6f191aa6c910 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:53.099171 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5259119-f91f-43aa-b247-6f191aa6c910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:53.101786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:53.111238 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5259119-f91f-43aa-b247-6f191aa6c910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:53.112682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5259119-f91f-43aa-b247-6f191aa6c910 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:53.129131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-f5259119-f91f-43aa-b247-6f191aa6c910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:53.129131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:53.129131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:53.129131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:53.129131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:53.129131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:53.129131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:53.129131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:53.129131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:53.129131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:53.129131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:53.129131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:53.129131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:51:53.129131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:51:53.129131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:51:53.129131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:51:53.130830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:53.130830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:53.130830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:53.130830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:53.130830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:53.130830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:53.130830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:53.130830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:53.130830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:53.130830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:53.130830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:53.130830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:53.130830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:53.130830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:53.130830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:53.130830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:53.130830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:51:53.131882 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:51:53.131882 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:53.131882 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:53.131882 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 279/561] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:53.131882 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5259119-f91f-43aa-b247-6f191aa6c910 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:53.167622 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34415a3-1958-4999-9a9a-ab6cf7fdbef9 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:53.200665 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03e205-bb0a-488f-8225-b975012ff8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:53.201265 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03e205-bb0a-488f-8225-b975012ff8dc None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:53.201539 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03e205-bb0a-488f-8225-b975012ff8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:53.201822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03e205-bb0a-488f-8225-b975012ff8dc None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:53.203126 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03e205-bb0a-488f-8225-b975012ff8dc None admin] RBAC: Adding query filter params (name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:53.203420 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03e205-bb0a-488f-8225-b975012ff8dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:53.204786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03e205-bb0a-488f-8225-b975012ff8dc None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:53.212629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 283/562] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 14 00:51:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:53.213772 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9ce4b-6f47-4823-bf1d-9dab74602309 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:53.214084 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9ce4b-6f47-4823-bf1d-9dab74602309 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:53.214359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9ce4b-6f47-4823-bf1d-9dab74602309 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:53.215812 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 284/563] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:53.216518 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9ce4b-6f47-4823-bf1d-9dab74602309 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:53.233155 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5259119-f91f-43aa-b247-6f191aa6c910 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:53.266973 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7956a6f-ad11-4882-8fac-40d3ce7d1e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:53.267560 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7956a6f-ad11-4882-8fac-40d3ce7d1e4e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:53.267833 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7956a6f-ad11-4882-8fac-40d3ce7d1e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:53.268098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7956a6f-ad11-4882-8fac-40d3ce7d1e4e None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:53.268727 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7956a6f-ad11-4882-8fac-40d3ce7d1e4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:53.269019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7956a6f-ad11-4882-8fac-40d3ce7d1e4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:53.270423 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7956a6f-ad11-4882-8fac-40d3ce7d1e4e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:53.274750 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:53.282718 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 280/564] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:53.283507 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7956a6f-ad11-4882-8fac-40d3ce7d1e4e None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:53.318417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9ce4b-6f47-4823-bf1d-9dab74602309 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:53.332222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:53.352725 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d71d9-0e00-4ad1-9f52-adb295f29a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:53.353337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d71d9-0e00-4ad1-9f52-adb295f29a7b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:53.353618 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d71d9-0e00-4ad1-9f52-adb295f29a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:53.353916 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d71d9-0e00-4ad1-9f52-adb295f29a7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:53.364217 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d71d9-0e00-4ad1-9f52-adb295f29a7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:53.368957 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-336d71d9-0e00-4ad1-9f52-adb295f29a7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:51:53.368957 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:53.368957 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:53.368957 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:53.368957 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:53.368957 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:53.368957 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:53.368957 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:53.368957 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:53.368957 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:53.368957 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:53.368957 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:53.368957 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:53.368957 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:53.368957 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:53.368957 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:53.369894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:53.369894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:53.369894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:53.369894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:53.369894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:53.369894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:53.369894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:53.369894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:53.369894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:53.369894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:53.369894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:53.369894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:53.369894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:53.369894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:53.369894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:53.369894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:53.370707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:53.370707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:53.370707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:53.370707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:53.370707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:53.370707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:53.370707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:53.370707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:53.370707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:53.370707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:53.370707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:51:53.370707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:53.370707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 285/565] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 14 00:51:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:53.372700 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d71d9-0e00-4ad1-9f52-adb295f29a7b None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:53.384231 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7956a6f-ad11-4882-8fac-40d3ce7d1e4e None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:53.417497 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db314a-2532-4671-957b-c5301d9d334b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:53.418122 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db314a-2532-4671-957b-c5301d9d334b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:53.418400 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db314a-2532-4671-957b-c5301d9d334b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:53.418673 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db314a-2532-4671-957b-c5301d9d334b None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:53.419303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db314a-2532-4671-957b-c5301d9d334b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:53.419603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db314a-2532-4671-957b-c5301d9d334b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:53.421043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db314a-2532-4671-957b-c5301d9d334b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:53.431914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 281/566] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:53.433118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3a30e-c45b-4347-a431-4be16f7507b9 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:53.433405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3a30e-c45b-4347-a431-4be16f7507b9 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:53.433682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3a30e-c45b-4347-a431-4be16f7507b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:53.450964 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-c3e3a30e-c45b-4347-a431-4be16f7507b9 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:53.452654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c3e3a30e-c45b-4347-a431-4be16f7507b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:53.470722 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d71d9-0e00-4ad1-9f52-adb295f29a7b None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:53.491137 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:53.509387 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cfc75-7b15-4bee-9138-975a82257d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:53.510050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cfc75-7b15-4bee-9138-975a82257d17 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:53.510410 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cfc75-7b15-4bee-9138-975a82257d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:53.510655 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cfc75-7b15-4bee-9138-975a82257d17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:53.520587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cfc75-7b15-4bee-9138-975a82257d17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:53.522011 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cfc75-7b15-4bee-9138-975a82257d17 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:53.522851 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 282/567] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:53.523529 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3a30e-c45b-4347-a431-4be16f7507b9 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:53.548421 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-523cfc75-7b15-4bee-9138-975a82257d17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:53.548421 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:53.548421 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:53.548421 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:53.548421 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:53.548421 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:53.548421 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:53.548421 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:53.548421 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:53.548421 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:53.548421 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:53.548421 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:53.548421 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:51:53.548421 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:51:53.548421 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:51:53.548421 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:51:53.549380 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:53.549380 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:53.549380 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:53.549380 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:53.549380 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:53.549380 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:53.549380 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:53.549380 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:53.549380 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:53.549380 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:53.549380 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:53.549380 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:53.549380 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:53.549380 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:53.549380 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:53.549380 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:53.549380 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:51:53.550305 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:51:53.550305 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:53.550305 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:53.550305 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 286/568] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:53.550305 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cfc75-7b15-4bee-9138-975a82257d17 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:53.571300 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:53.637451 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3a30e-c45b-4347-a431-4be16f7507b9 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:53.660137 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cfc75-7b15-4bee-9138-975a82257d17 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:53.675192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fffe69-acd1-4b4e-b6c7-3792ca9325e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:53.675944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fffe69-acd1-4b4e-b6c7-3792ca9325e3 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:53.676566 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fffe69-acd1-4b4e-b6c7-3792ca9325e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:53.676847 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fffe69-acd1-4b4e-b6c7-3792ca9325e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:53.683426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fffe69-acd1-4b4e-b6c7-3792ca9325e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:53.685093 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fffe69-acd1-4b4e-b6c7-3792ca9325e3 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:53.697526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-70fffe69-acd1-4b4e-b6c7-3792ca9325e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:51:53.697526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:53.697526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:53.697526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:53.697526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:53.697526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:53.697526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:53.697526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:53.697526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:53.697526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:53.697526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:53.697526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:53.697526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:51:53.697526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:51:53.697526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:51:53.698452 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:51:53.698452 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:53.698452 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:53.698452 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:53.698452 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:53.698452 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:53.698452 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:53.698452 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:53.698452 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:53.698452 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:53.698452 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:53.698452 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:53.698452 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:53.698452 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:53.698452 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:53.698452 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:53.698452 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:53.699914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:51:53.699914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:51:53.699914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:51:53.699914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:51:53.699914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:51:53.699914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:51:53.699914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:51:53.699914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:53.700344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6616ed-2a8b-4bf7-a20e-e967a85d5d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:53.700344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6616ed-2a8b-4bf7-a20e-e967a85d5d7e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:53.700512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 283/569] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:51:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:53.700512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fffe69-acd1-4b4e-b6c7-3792ca9325e3 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:53.703299 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6616ed-2a8b-4bf7-a20e-e967a85d5d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:53.703568 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6616ed-2a8b-4bf7-a20e-e967a85d5d7e None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:53.704243 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6616ed-2a8b-4bf7-a20e-e967a85d5d7e None admin] RBAC: Adding query filter params (name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:53.705228 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6616ed-2a8b-4bf7-a20e-e967a85d5d7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:53.705922 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6616ed-2a8b-4bf7-a20e-e967a85d5d7e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:53.718915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 287/570] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 14 00:51:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:53.718915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6616ed-2a8b-4bf7-a20e-e967a85d5d7e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:53.754336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:53.799917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:53.804275 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fffe69-acd1-4b4e-b6c7-3792ca9325e3 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:53.823371 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6616ed-2a8b-4bf7-a20e-e967a85d5d7e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:53.843962 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd60e3d-c9e2-46f6-b83c-0015b235980e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:53.844597 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd60e3d-c9e2-46f6-b83c-0015b235980e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:53.844872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd60e3d-c9e2-46f6-b83c-0015b235980e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:53.845139 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd60e3d-c9e2-46f6-b83c-0015b235980e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:53.852537 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd60e3d-c9e2-46f6-b83c-0015b235980e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:53.854008 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd60e3d-c9e2-46f6-b83c-0015b235980e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:53.866170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-5fd60e3d-c9e2-46f6-b83c-0015b235980e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 00:51:53.866170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:53.866170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:53.866170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:53.866170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:53.866170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:53.866170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:53.866170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:53.866170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:53.866170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:53.866170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:53.866170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:53.866170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:51:53.866170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:51:53.866170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:51:53.866170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:51:53.867129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:53.867129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:53.867129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:51:53.867129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:51:53.867129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:51:53.867129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:51:53.867129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:53.867129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:53.867129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:53.867129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:53.867129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:53.867129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:53.867129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:53.867129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:53.867129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:53.867129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:53.867129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:53.867129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:53.868635 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:53.868635 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:53.868635 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:51:53.868635 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:51:53.868635 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:51:53.868635 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:51:53.868635 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:51:53.868635 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:51:53.868635 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 00:51:53.868635 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:53.869280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975b1b9-d34e-4da5-b43b-e9fdd5262370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:53.869435 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 284/571] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Sep 14 00:51:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:53.869546 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975b1b9-d34e-4da5-b43b-e9fdd5262370 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:53.869546 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975b1b9-d34e-4da5-b43b-e9fdd5262370 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:53.869786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd60e3d-c9e2-46f6-b83c-0015b235980e None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:53.869952 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975b1b9-d34e-4da5-b43b-e9fdd5262370 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:53.869952 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975b1b9-d34e-4da5-b43b-e9fdd5262370 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:53.869952 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975b1b9-d34e-4da5-b43b-e9fdd5262370 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:53.871194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975b1b9-d34e-4da5-b43b-e9fdd5262370 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:53.883327 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 288/572] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:53.884220 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975b1b9-d34e-4da5-b43b-e9fdd5262370 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:53.972543 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd60e3d-c9e2-46f6-b83c-0015b235980e None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:53.974231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:53.982068 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975b1b9-d34e-4da5-b43b-e9fdd5262370 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:54.010449 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b22e8-58b7-4413-8dca-a41b6f661e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:54.011049 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b22e8-58b7-4413-8dca-a41b6f661e7b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:54.011326 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b22e8-58b7-4413-8dca-a41b6f661e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:54.011598 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b22e8-58b7-4413-8dca-a41b6f661e7b None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:54.012281 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b22e8-58b7-4413-8dca-a41b6f661e7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:54.012582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b22e8-58b7-4413-8dca-a41b6f661e7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:54.014026 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b22e8-58b7-4413-8dca-a41b6f661e7b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:54.016130 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd9dea-6941-49b3-87bc-affde4390f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:54.016748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd9dea-6941-49b3-87bc-affde4390f0e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:54.017029 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd9dea-6941-49b3-87bc-affde4390f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:54.017299 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd9dea-6941-49b3-87bc-affde4390f0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:54.027204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 285/573] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:51:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:54.027695 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd9dea-6941-49b3-87bc-affde4390f0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:54.027988 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b22e8-58b7-4413-8dca-a41b6f661e7b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:54.029177 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd9dea-6941-49b3-87bc-affde4390f0e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:54.044359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-a5dd9dea-6941-49b3-87bc-affde4390f0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:54.044359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:54.044359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:54.044359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:54.044359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:54.044359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:54.044359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:54.044359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:54.044359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:54.044359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:54.044359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:54.044359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:54.044359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:51:54.044359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:51:54.044359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:51:54.044359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:51:54.045349 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:54.045349 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:54.045349 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:54.045349 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:54.045349 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:54.045349 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:54.045349 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:54.045349 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:54.045349 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:54.045349 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:54.045349 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:54.045349 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:54.045349 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:54.045349 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:54.045349 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:54.045349 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:54.045349 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:51:54.046317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:51:54.046317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:54.046317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:54.046317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 289/574] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:54.046317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd9dea-6941-49b3-87bc-affde4390f0e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:54.048273 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:54.128294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b22e8-58b7-4413-8dca-a41b6f661e7b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:54.147270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd9dea-6941-49b3-87bc-affde4390f0e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:54.162305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e526b4-bd6b-4114-ad11-885a9ada9192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:54.163818 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e526b4-bd6b-4114-ad11-885a9ada9192 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:54.164105 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e526b4-bd6b-4114-ad11-885a9ada9192 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:54.164374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e526b4-bd6b-4114-ad11-885a9ada9192 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:54.178914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e526b4-bd6b-4114-ad11-885a9ada9192 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:54.184667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-05e526b4-bd6b-4114-ad11-885a9ada9192 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:51:54.184667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:54.184667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:54.184667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:54.184667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:54.184667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:54.184667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:54.184667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:54.184667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:54.184667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:54.184667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:54.184667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:54.184667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:54.184667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:54.184667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:54.184667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:54.186476 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:54.186476 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:54.186476 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:54.186476 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:54.186476 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:54.186476 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:54.186476 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:54.186476 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:54.186476 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:54.186476 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:54.186476 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:54.186476 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:54.186476 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:54.186476 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:54.186476 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:54.186476 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:54.188118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:54.188118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:54.188118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:54.188118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:54.188118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:54.188118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:54.188118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:54.188118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:54.188118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:54.188118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:54.188118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:51:54.188118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:54.188118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 286/575] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 14 00:51:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:54.188118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e526b4-bd6b-4114-ad11-885a9ada9192 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:54.196350 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f571369-61a0-4481-9bae-63468e890eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:54.197099 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f571369-61a0-4481-9bae-63468e890eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:54.197268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f571369-61a0-4481-9bae-63468e890eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:54.197473 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f571369-61a0-4481-9bae-63468e890eb2 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:54.198227 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f571369-61a0-4481-9bae-63468e890eb2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:54.198526 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f571369-61a0-4481-9bae-63468e890eb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:54.199927 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f571369-61a0-4481-9bae-63468e890eb2 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:54.216927 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 290/576] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Sep 14 00:51:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:54.218295 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f571369-61a0-4481-9bae-63468e890eb2 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:54.221471 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:54.271049 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:54.293564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e526b4-bd6b-4114-ad11-885a9ada9192 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:54.314417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f571369-61a0-4481-9bae-63468e890eb2 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:54.325556 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1e664-a318-4649-9c4e-160e8b291a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:54.326206 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1e664-a318-4649-9c4e-160e8b291a9e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:54.326507 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1e664-a318-4649-9c4e-160e8b291a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:54.326859 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1e664-a318-4649-9c4e-160e8b291a9e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:54.334071 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1e664-a318-4649-9c4e-160e8b291a9e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:54.335495 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1e664-a318-4649-9c4e-160e8b291a9e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:54.346688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-a7a1e664-a318-4649-9c4e-160e8b291a9e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 14 00:51:54.346688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:54.346688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:54.346688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:54.346688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:54.346688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:54.346688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:54.346688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:54.346688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:54.346688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:54.346688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:54.346688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:54.346688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:51:54.346688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:51:54.346688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:51:54.346688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:51:54.347659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:54.347659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:54.347659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:51:54.347659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:51:54.347659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:51:54.347659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:51:54.347659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:54.347659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:54.347659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:54.347659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:54.347659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:54.347659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:54.347659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:54.347659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:54.347659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:54.347659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:54.347659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:54.347659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:54.348590 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:54.348590 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:54.348590 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:51:54.348590 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:51:54.348590 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:51:54.348590 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:51:54.348590 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:51:54.348590 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:51:54.348590 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 14 00:51:54.348590 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:54.349113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23700fdf-6420-400d-94de-0c915b0f27eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:54.349113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23700fdf-6420-400d-94de-0c915b0f27eb None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:54.349272 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 287/577] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:54.349342 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23700fdf-6420-400d-94de-0c915b0f27eb None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:54.349342 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23700fdf-6420-400d-94de-0c915b0f27eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:54.349463 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1e664-a318-4649-9c4e-160e8b291a9e None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:54.349539 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23700fdf-6420-400d-94de-0c915b0f27eb None admin] RBAC: Adding query filter params (role.id=b9c910c1c68948858203c62521b73efc, scope.project.id=f37c835c05924364bcd1530d44f024fe, user.id=c8d05652bfe542d5a2cfa39fbf7a83c9) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:54.349539 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23700fdf-6420-400d-94de-0c915b0f27eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:54.350578 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23700fdf-6420-400d-94de-0c915b0f27eb None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:54.365867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 291/578] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:51:54 2022] GET /identity/v3/role_assignments?user.id=c8d05652bfe542d5a2cfa39fbf7a83c9&scope.project.id=f37c835c05924364bcd1530d44f024fe&role.id=b9c910c1c68948858203c62521b73efc => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:54.365867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23700fdf-6420-400d-94de-0c915b0f27eb None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:54.426621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:54.457147 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1e664-a318-4649-9c4e-160e8b291a9e None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:54.468602 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23700fdf-6420-400d-94de-0c915b0f27eb None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:54.494856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9adab-34cc-48e5-864f-b8eee7b4af56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:54.495346 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9adab-34cc-48e5-864f-b8eee7b4af56 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:54.495619 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9adab-34cc-48e5-864f-b8eee7b4af56 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:54.495882 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9adab-34cc-48e5-864f-b8eee7b4af56 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:54.496532 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9adab-34cc-48e5-864f-b8eee7b4af56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:54.496830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9adab-34cc-48e5-864f-b8eee7b4af56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:54.498264 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9adab-34cc-48e5-864f-b8eee7b4af56 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:54.507001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:54.507633 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fcef22-3403-4996-8702-65ed235ec9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:54.508270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcef22-3403-4996-8702-65ed235ec9f7 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:54.508552 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcef22-3403-4996-8702-65ed235ec9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:54.508814 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcef22-3403-4996-8702-65ed235ec9f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:54.509617 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fcef22-3403-4996-8702-65ed235ec9f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:54.509789 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fcef22-3403-4996-8702-65ed235ec9f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:54.511174 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fcef22-3403-4996-8702-65ed235ec9f7 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:54.519463 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 288/579] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:54.520557 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9adab-34cc-48e5-864f-b8eee7b4af56 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:54.525740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 292/580] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 14 00:51:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:54.526643 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fcef22-3403-4996-8702-65ed235ec9f7 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:54.627115 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9adab-34cc-48e5-864f-b8eee7b4af56 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:54.632780 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fcef22-3403-4996-8702-65ed235ec9f7 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:54.660956 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:54.664213 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5bf3c-c6ac-4bd6-91db-e9fcec16e45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:54.665233 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5bf3c-c6ac-4bd6-91db-e9fcec16e45c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:54.665718 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5bf3c-c6ac-4bd6-91db-e9fcec16e45c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:54.666255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5bf3c-c6ac-4bd6-91db-e9fcec16e45c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:54.667501 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0274f-c42f-408e-a97b-82b461098f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:54.668104 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0274f-c42f-408e-a97b-82b461098f2e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:54.668385 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0274f-c42f-408e-a97b-82b461098f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:54.668653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0274f-c42f-408e-a97b-82b461098f2e None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:54.669367 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0274f-c42f-408e-a97b-82b461098f2e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:54.669664 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0274f-c42f-408e-a97b-82b461098f2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:54.671718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0274f-c42f-408e-a97b-82b461098f2e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:54.678477 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5bf3c-c6ac-4bd6-91db-e9fcec16e45c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:54.680139 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5bf3c-c6ac-4bd6-91db-e9fcec16e45c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:54.689853 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 293/581] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Sep 14 00:51:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:54.690372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0274f-c42f-408e-a97b-82b461098f2e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:54.702195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-aea5bf3c-c6ac-4bd6-91db-e9fcec16e45c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:54.702195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:54.702195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:54.702195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:54.702195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:54.702195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:54.702195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:54.702195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:54.702195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:54.702195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:54.702195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:54.702195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:54.702195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:51:54.702195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:51:54.702195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:51:54.702195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:51:54.703196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:54.703196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:54.703196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:54.703196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:54.703196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:54.703196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:54.703196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:54.703196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:54.703196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:54.703196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:54.703196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:54.703196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:54.703196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:54.703196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:54.703196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:54.703196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:54.703196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:51:54.704059 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:51:54.704059 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:54.704059 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:54.704059 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 289/582] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:54.704059 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5bf3c-c6ac-4bd6-91db-e9fcec16e45c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:54.756586 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:54.798975 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0274f-c42f-408e-a97b-82b461098f2e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:54.810140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5bf3c-c6ac-4bd6-91db-e9fcec16e45c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:54.836777 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5a807-0b2b-47cb-be41-ca46d2b8ef6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:54.837393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5a807-0b2b-47cb-be41-ca46d2b8ef6b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:54.837670 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5a807-0b2b-47cb-be41-ca46d2b8ef6b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:54.837986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5a807-0b2b-47cb-be41-ca46d2b8ef6b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:54.845793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5a807-0b2b-47cb-be41-ca46d2b8ef6b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:54.847232 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5a807-0b2b-47cb-be41-ca46d2b8ef6b None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:54.848089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681ef54-8f52-4b2c-98fd-55143d81ad04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:54.848790 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681ef54-8f52-4b2c-98fd-55143d81ad04 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:54.848962 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681ef54-8f52-4b2c-98fd-55143d81ad04 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:54.849235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681ef54-8f52-4b2c-98fd-55143d81ad04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:54.859067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-a4a5a807-0b2b-47cb-be41-ca46d2b8ef6b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 00:51:54.859067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:54.859067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:54.859067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:54.859067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:54.859067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:54.859067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:54.859067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:54.859067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:54.859067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:54.859067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:54.859067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:54.859067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:51:54.859067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:51:54.859067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:51:54.859067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:51:54.860052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:54.860052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:54.860052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:51:54.860052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:51:54.860052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:51:54.860052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:51:54.860052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:54.860052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:54.860052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:54.860052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:54.860052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:54.860052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:54.860052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:54.860052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:54.860052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:54.860052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:54.860052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:54.860052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:54.860958 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:54.860958 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:54.860958 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:51:54.860958 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:51:54.860958 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:51:54.860958 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:51:54.860958 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:51:54.860958 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:51:54.860958 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 00:51:54.860958 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:54.860958 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 294/583] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:51:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:54.861555 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5a807-0b2b-47cb-be41-ca46d2b8ef6b None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:54.865560 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681ef54-8f52-4b2c-98fd-55143d81ad04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:54.867046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681ef54-8f52-4b2c-98fd-55143d81ad04 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:54.882701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-d681ef54-8f52-4b2c-98fd-55143d81ad04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:54.882701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:54.882701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:54.882701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:54.882701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:54.882701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:54.882701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:54.882701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:54.882701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:54.882701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:54.882701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:54.882701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:54.882701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:51:54.882701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:51:54.882701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:51:54.882701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:51:54.883742 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:54.883742 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:54.883742 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:54.883742 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:54.883742 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:54.883742 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:54.883742 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:54.883742 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:54.883742 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:54.883742 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:54.883742 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:54.883742 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:54.883742 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:54.883742 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:54.883742 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:54.883742 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:54.883742 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:51:54.884653 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:51:54.884653 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:54.884653 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:54.884653 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 290/584] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:54.884653 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681ef54-8f52-4b2c-98fd-55143d81ad04 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:54.917129 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:54.972945 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5a807-0b2b-47cb-be41-ca46d2b8ef6b None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:55.005875 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681ef54-8f52-4b2c-98fd-55143d81ad04 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:55.007575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:55.020716 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf5b94-c38a-4b8a-8936-ba1ce9bfa71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:55.021345 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf5b94-c38a-4b8a-8936-ba1ce9bfa71e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:55.021622 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf5b94-c38a-4b8a-8936-ba1ce9bfa71e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:55.021985 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf5b94-c38a-4b8a-8936-ba1ce9bfa71e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:55.033592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf5b94-c38a-4b8a-8936-ba1ce9bfa71e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:55.035134 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf5b94-c38a-4b8a-8936-ba1ce9bfa71e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:55.041257 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b3189-e9a5-424f-8e1d-f920d220f64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:55.042214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b3189-e9a5-424f-8e1d-f920d220f64e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:55.042214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b3189-e9a5-424f-8e1d-f920d220f64e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:55.042437 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b3189-e9a5-424f-8e1d-f920d220f64e None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:55.043041 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b3189-e9a5-424f-8e1d-f920d220f64e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:55.043338 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b3189-e9a5-424f-8e1d-f920d220f64e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:55.044799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b3189-e9a5-424f-8e1d-f920d220f64e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:55.051268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-51bf5b94-c38a-4b8a-8936-ba1ce9bfa71e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:55.051268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:55.051268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:55.051268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:55.051268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:55.051268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:55.051268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:55.051268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:55.051268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:55.051268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:55.051268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:55.051268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:55.051268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:51:55.051268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:51:55.051268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:51:55.051268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:51:55.052197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:55.052197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:55.052197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:55.052197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:55.052197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:55.052197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:55.052197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:55.052197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:55.052197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:55.052197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:55.052197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:55.052197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:55.052197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:55.052197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:55.052197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:55.052197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:55.052197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:51:55.058069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:51:55.058069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:55.058069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:55.058069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 295/585] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:55.058069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf5b94-c38a-4b8a-8936-ba1ce9bfa71e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:55.068859 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 291/586] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:55.068859 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b3189-e9a5-424f-8e1d-f920d220f64e None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:55.162062 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:55.165218 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf5b94-c38a-4b8a-8936-ba1ce9bfa71e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:55.168538 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b3189-e9a5-424f-8e1d-f920d220f64e None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:55.201525 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f1d02-3d2f-4e65-aa40-1407a762d506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:55.202834 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f1d02-3d2f-4e65-aa40-1407a762d506 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:55.203120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f1d02-3d2f-4e65-aa40-1407a762d506 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:55.203386 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f1d02-3d2f-4e65-aa40-1407a762d506 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:55.204103 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f1d02-3d2f-4e65-aa40-1407a762d506 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:55.204460 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f1d02-3d2f-4e65-aa40-1407a762d506 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:55.205871 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f1d02-3d2f-4e65-aa40-1407a762d506 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:55.207353 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e58938-c8b9-416d-aef7-70bd69c1c98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:55.207853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e58938-c8b9-416d-aef7-70bd69c1c98a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:55.208129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e58938-c8b9-416d-aef7-70bd69c1c98a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:55.208386 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e58938-c8b9-416d-aef7-70bd69c1c98a None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:55.209261 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e58938-c8b9-416d-aef7-70bd69c1c98a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:55.209377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e58938-c8b9-416d-aef7-70bd69c1c98a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:55.210676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e58938-c8b9-416d-aef7-70bd69c1c98a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:55.222939 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 292/587] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:55.223642 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e58938-c8b9-416d-aef7-70bd69c1c98a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:55.234443 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 296/588] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Sep 14 00:51:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:55.234443 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f1d02-3d2f-4e65-aa40-1407a762d506 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:55.252484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:55.330327 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e58938-c8b9-416d-aef7-70bd69c1c98a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:55.336453 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f1d02-3d2f-4e65-aa40-1407a762d506 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:55.363727 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60b5f1-e29f-4d6d-ac28-00f95f4cd45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:55.364315 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60b5f1-e29f-4d6d-ac28-00f95f4cd45e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:55.364593 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60b5f1-e29f-4d6d-ac28-00f95f4cd45e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:55.364857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60b5f1-e29f-4d6d-ac28-00f95f4cd45e None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:55.365486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60b5f1-e29f-4d6d-ac28-00f95f4cd45e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:55.365827 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60b5f1-e29f-4d6d-ac28-00f95f4cd45e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:55.367172 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60b5f1-e29f-4d6d-ac28-00f95f4cd45e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:55.371183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d2882-1961-4198-85f3-63664f48552b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:55.371865 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d2882-1961-4198-85f3-63664f48552b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:55.372146 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d2882-1961-4198-85f3-63664f48552b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:55.372420 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d2882-1961-4198-85f3-63664f48552b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:55.378827 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 293/589] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:55.379439 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60b5f1-e29f-4d6d-ac28-00f95f4cd45e None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:55.383400 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d2882-1961-4198-85f3-63664f48552b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:55.384850 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d2882-1961-4198-85f3-63664f48552b None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:55.396530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-537d2882-1961-4198-85f3-63664f48552b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:51:55.396530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:55.396530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:55.396530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:55.396530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:55.396530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:55.396530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:55.396530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:55.396530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:55.396530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:55.396530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:55.396530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:55.396530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:51:55.396530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:51:55.396530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:51:55.397444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:51:55.397444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:55.397444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:55.397444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:55.397444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:55.397444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:55.397444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:55.397444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:55.397444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:55.397444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:55.397444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:55.397444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:55.397444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:55.397444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:55.397444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:55.397444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:55.397444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:55.398368 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:51:55.398368 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:51:55.398368 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:51:55.398368 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:51:55.398368 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:51:55.398368 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:51:55.398368 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:51:55.398368 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:55.398368 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 297/590] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:51:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:55.398368 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d2882-1961-4198-85f3-63664f48552b None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:55.418415 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:55.469695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:55.492620 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60b5f1-e29f-4d6d-ac28-00f95f4cd45e None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:55.504360 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d2882-1961-4198-85f3-63664f48552b None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:55.526918 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae2839-83e8-498f-ac4e-cf5be3864517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:55.527532 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae2839-83e8-498f-ac4e-cf5be3864517 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:55.527813 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae2839-83e8-498f-ac4e-cf5be3864517 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:55.528067 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae2839-83e8-498f-ac4e-cf5be3864517 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:55.536412 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae2839-83e8-498f-ac4e-cf5be3864517 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:55.537778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae2839-83e8-498f-ac4e-cf5be3864517 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:55.540371 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82e6e0-2ae4-493e-a211-4e817121c9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:55.540988 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82e6e0-2ae4-493e-a211-4e817121c9ad None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:55.541261 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82e6e0-2ae4-493e-a211-4e817121c9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:55.541528 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82e6e0-2ae4-493e-a211-4e817121c9ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:55.550129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-8eae2839-83e8-498f-ac4e-cf5be3864517 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 00:51:55.550129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:55.550129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:55.550129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:55.550129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:55.550129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:55.550129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:55.550129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:55.550129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:55.550129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:55.550129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:55.550129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:55.550129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:51:55.550129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:51:55.550129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:51:55.550129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:51:55.551067 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:55.551067 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:55.551067 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:51:55.551067 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:51:55.551067 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:51:55.551067 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:51:55.551067 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:55.551067 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:55.551067 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:55.551067 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:55.551067 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:55.551067 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:55.551067 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:55.551067 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:55.551067 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:55.551067 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:55.551067 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:55.551067 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:55.552053 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:55.552053 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:55.552053 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:51:55.552053 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:51:55.552053 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:51:55.552053 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:51:55.552053 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:51:55.552053 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:51:55.552053 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 00:51:55.552053 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:55.552053 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 294/591] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 14 00:51:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:55.552053 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae2839-83e8-498f-ac4e-cf5be3864517 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:55.559809 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82e6e0-2ae4-493e-a211-4e817121c9ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:55.561363 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82e6e0-2ae4-493e-a211-4e817121c9ad None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:55.576110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-2f82e6e0-2ae4-493e-a211-4e817121c9ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:55.576110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:55.576110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:55.576110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:55.576110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:55.576110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:55.576110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:55.576110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:55.576110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:55.576110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:55.576110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:55.576110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:55.576110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:51:55.576110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:51:55.576110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:51:55.576110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:51:55.577114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:55.577114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:55.577114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:55.577114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:55.577114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:55.577114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:55.577114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:55.577114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:55.577114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:55.577114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:55.577114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:55.577114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:55.577114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:55.577114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:55.577114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:55.577114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:55.577114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:51:55.578424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:51:55.578424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:55.578424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:55.578424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 298/592] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:55.578424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82e6e0-2ae4-493e-a211-4e817121c9ad None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:55.650862 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:55.675321 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae2839-83e8-498f-ac4e-cf5be3864517 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:55.683441 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82e6e0-2ae4-493e-a211-4e817121c9ad None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:55.713840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b64ea-9452-4524-a347-592b7b7ba2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:55.714439 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b64ea-9452-4524-a347-592b7b7ba2b4 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:55.714774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b64ea-9452-4524-a347-592b7b7ba2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:55.715030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b64ea-9452-4524-a347-592b7b7ba2b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:55.718703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac919660-f52b-4500-ab47-123d00362fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:55.719298 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac919660-f52b-4500-ab47-123d00362fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:55.719574 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac919660-f52b-4500-ab47-123d00362fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:55.719842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac919660-f52b-4500-ab47-123d00362fc3 None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:55.720536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac919660-f52b-4500-ab47-123d00362fc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:55.720839 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac919660-f52b-4500-ab47-123d00362fc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:55.721907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b64ea-9452-4524-a347-592b7b7ba2b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:55.722318 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac919660-f52b-4500-ab47-123d00362fc3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:55.723316 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b64ea-9452-4524-a347-592b7b7ba2b4 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:55.735058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 299/593] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:51:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:55.735671 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac919660-f52b-4500-ab47-123d00362fc3 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:55.740115 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-fb7b64ea-9452-4524-a347-592b7b7ba2b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:51:55.740115 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:55.740115 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:55.740115 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:55.740115 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:55.740115 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:55.740115 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:55.740115 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:55.740115 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:55.740115 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:55.740115 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:55.740115 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:55.740115 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:51:55.740115 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:51:55.740115 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:51:55.741155 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:51:55.741155 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:55.741155 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:55.741155 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:55.741155 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:55.741155 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:55.741155 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:55.741155 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:55.741155 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:55.741155 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:55.741155 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:55.741155 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:55.741155 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:55.741155 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:55.741155 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:55.741155 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:55.741155 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:55.742237 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:51:55.742237 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:51:55.742237 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:51:55.742237 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:51:55.742237 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:51:55.742237 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:51:55.742237 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:51:55.742237 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:55.747634 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 295/594] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:51:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:55.747634 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b64ea-9452-4524-a347-592b7b7ba2b4 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:55.749911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:55.838336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac919660-f52b-4500-ab47-123d00362fc3 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:55.852646 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b64ea-9452-4524-a347-592b7b7ba2b4 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:55.868327 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:55.875832 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96358f1-e573-4351-9a0c-f521cdb442cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:55.876430 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96358f1-e573-4351-9a0c-f521cdb442cf None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:55.876706 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96358f1-e573-4351-9a0c-f521cdb442cf None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:55.877023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96358f1-e573-4351-9a0c-f521cdb442cf None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:55.877870 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96358f1-e573-4351-9a0c-f521cdb442cf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:55.878285 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96358f1-e573-4351-9a0c-f521cdb442cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:55.879692 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96358f1-e573-4351-9a0c-f521cdb442cf None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:55.885610 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615f704-ea88-4fe3-a758-974c7a2a68c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:55.886423 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615f704-ea88-4fe3-a758-974c7a2a68c4 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:55.886703 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615f704-ea88-4fe3-a758-974c7a2a68c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:55.887032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615f704-ea88-4fe3-a758-974c7a2a68c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:55.887703 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615f704-ea88-4fe3-a758-974c7a2a68c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:55.888006 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615f704-ea88-4fe3-a758-974c7a2a68c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:55.889389 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615f704-ea88-4fe3-a758-974c7a2a68c4 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:55.902274 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 300/595] 10.222.0.20 () {56 vars in 1139 bytes} [Wed Sep 14 00:51:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:55.902274 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96358f1-e573-4351-9a0c-f521cdb442cf None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:55.906928 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 296/596] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:55.907846 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615f704-ea88-4fe3-a758-974c7a2a68c4 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:55.969606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:56.013109 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615f704-ea88-4fe3-a758-974c7a2a68c4 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:56.016212 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96358f1-e573-4351-9a0c-f521cdb442cf None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:56.051834 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edb802-6dc0-4081-994f-685e110e43d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:56.052433 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edb802-6dc0-4081-994f-685e110e43d9 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:56.052549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5f86c-a496-48fd-8e49-4ac839ad1c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:56.052717 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edb802-6dc0-4081-994f-685e110e43d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:56.052976 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edb802-6dc0-4081-994f-685e110e43d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:56.053351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5f86c-a496-48fd-8e49-4ac839ad1c47 None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:56.053656 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edb802-6dc0-4081-994f-685e110e43d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:56.053755 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5f86c-a496-48fd-8e49-4ac839ad1c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:56.053995 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edb802-6dc0-4081-994f-685e110e43d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:56.054137 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5f86c-a496-48fd-8e49-4ac839ad1c47 None admin] PATH_INFO: `/v3/projects/f37c835c05924364bcd1530d44f024fe/users/c05caac9e8b9498583780306887734be/roles/b9c910c1c68948858203c62521b73efc` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:56.055417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edb802-6dc0-4081-994f-685e110e43d9 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:56.072210 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 297/597] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:51:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:56.072210 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edb802-6dc0-4081-994f-685e110e43d9 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:56.074954 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5f86c-a496-48fd-8e49-4ac839ad1c47 None admin] RBAC: Authorizing `identity:create_grant(project_id=f37c835c05924364bcd1530d44f024fe, user_id=c05caac9e8b9498583780306887734be, role_id=b9c910c1c68948858203c62521b73efc)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:56.076542 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5f86c-a496-48fd-8e49-4ac839ad1c47 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:56.091936 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 301/598] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 14 00:51:55 2022] PUT /identity/v3/projects/f37c835c05924364bcd1530d44f024fe/users/c05caac9e8b9498583780306887734be/roles/b9c910c1c68948858203c62521b73efc => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 00:51:56.093412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5f86c-a496-48fd-8e49-4ac839ad1c47 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:56.149477 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:56.192764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edb802-6dc0-4081-994f-685e110e43d9 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:56.219842 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:56.234210 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c738c-5389-4f86-9f3d-09f22f1d1d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:56.235068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c738c-5389-4f86-9f3d-09f22f1d1d6b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:56.235441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c738c-5389-4f86-9f3d-09f22f1d1d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:56.235805 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c738c-5389-4f86-9f3d-09f22f1d1d6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:56.236391 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5f86c-a496-48fd-8e49-4ac839ad1c47 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:56.248280 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c738c-5389-4f86-9f3d-09f22f1d1d6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:56.250044 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c738c-5389-4f86-9f3d-09f22f1d1d6b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:56.265729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-888c738c-5389-4f86-9f3d-09f22f1d1d6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:56.265729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:56.265729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:56.265729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:56.265729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:56.265729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:56.265729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:56.265729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:56.265729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:56.265729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:56.265729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:56.265729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:56.265729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:51:56.265729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:51:56.265729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:51:56.265729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:51:56.267007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:56.267007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:56.267007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:56.267007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:56.267007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:56.267007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:56.267007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:56.267007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:56.267007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:56.267007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:56.267007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:56.267007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:56.267007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:56.267007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:56.267007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:56.267007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:56.267007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:51:56.268111 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:51:56.268111 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:56.268111 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:56.269462 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 298/599] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:56.270450 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c738c-5389-4f86-9f3d-09f22f1d1d6b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:56.287219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d3bfb-dc7f-4d7c-a796-874aaca8e583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:56.287866 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d3bfb-dc7f-4d7c-a796-874aaca8e583 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:56.288148 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d3bfb-dc7f-4d7c-a796-874aaca8e583 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:56.288419 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d3bfb-dc7f-4d7c-a796-874aaca8e583 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:56.296179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d3bfb-dc7f-4d7c-a796-874aaca8e583 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:56.297636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d3bfb-dc7f-4d7c-a796-874aaca8e583 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:56.310393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-df1d3bfb-dc7f-4d7c-a796-874aaca8e583 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:51:56.310393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:56.310393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:56.310393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:56.310393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:56.310393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:56.310393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:56.310393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:56.310393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:56.310393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:56.310393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:56.310393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:56.310393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:51:56.310393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:51:56.310393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:51:56.312052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:51:56.312052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:56.312052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:56.312052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:56.312052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:56.312052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:56.312052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:56.312052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:56.312052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:56.312052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:56.312052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:56.312052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:56.312052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:56.312052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:56.312052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:56.312052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:56.312052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:56.313124 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:51:56.313124 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:51:56.313124 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:51:56.313124 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:51:56.313124 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:51:56.313124 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:51:56.313124 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:51:56.313124 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:56.313124 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 302/600] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:51:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:56.313124 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d3bfb-dc7f-4d7c-a796-874aaca8e583 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:56.395015 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c738c-5389-4f86-9f3d-09f22f1d1d6b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:56.435428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:56.438224 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b831374-9c7d-4d45-85c5-b4ebfbffb220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:56.439055 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b831374-9c7d-4d45-85c5-b4ebfbffb220 None admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:56.439516 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b831374-9c7d-4d45-85c5-b4ebfbffb220 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:56.439947 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b831374-9c7d-4d45-85c5-b4ebfbffb220 None admin] PATH_INFO: `/v3/projects/f37c835c05924364bcd1530d44f024fe/users/ee54ed3a092e4eef9082c4e86bd918a2/roles/b9c910c1c68948858203c62521b73efc` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:56.440500 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d3bfb-dc7f-4d7c-a796-874aaca8e583 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:56.457231 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b831374-9c7d-4d45-85c5-b4ebfbffb220 None admin] RBAC: Authorizing `identity:create_grant(project_id=f37c835c05924364bcd1530d44f024fe, user_id=ee54ed3a092e4eef9082c4e86bd918a2, role_id=b9c910c1c68948858203c62521b73efc)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:56.459033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b831374-9c7d-4d45-85c5-b4ebfbffb220 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:56.477951 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 299/601] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 14 00:51:56 2022] PUT /identity/v3/projects/f37c835c05924364bcd1530d44f024fe/users/ee54ed3a092e4eef9082c4e86bd918a2/roles/b9c910c1c68948858203c62521b73efc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 00:51:56.479137 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b831374-9c7d-4d45-85c5-b4ebfbffb220 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:56.486889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb7bec-4179-474b-b0df-a1d075e2d824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:56.488440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb7bec-4179-474b-b0df-a1d075e2d824 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:56.490228 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb7bec-4179-474b-b0df-a1d075e2d824 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:56.490452 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb7bec-4179-474b-b0df-a1d075e2d824 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:56.491239 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb7bec-4179-474b-b0df-a1d075e2d824 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:56.491643 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb7bec-4179-474b-b0df-a1d075e2d824 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:56.493130 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb7bec-4179-474b-b0df-a1d075e2d824 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:56.516685 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 303/602] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:56.522178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a28b16-392a-46c3-9470-70abe238f1c1 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:56.522457 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a28b16-392a-46c3-9470-70abe238f1c1 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:56.522727 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a28b16-392a-46c3-9470-70abe238f1c1 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:56.523230 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:56.525961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 304/603] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 00:51:56.527767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a28b16-392a-46c3-9470-70abe238f1c1 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:56.643533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b831374-9c7d-4d45-85c5-b4ebfbffb220 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:56.666470 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a28b16-392a-46c3-9470-70abe238f1c1 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:56.695879 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab314a-97aa-49ea-8600-8d5d4ec9f81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:56.695879 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab314a-97aa-49ea-8600-8d5d4ec9f81f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:56.695879 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab314a-97aa-49ea-8600-8d5d4ec9f81f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:56.695879 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab314a-97aa-49ea-8600-8d5d4ec9f81f None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:56.696616 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab314a-97aa-49ea-8600-8d5d4ec9f81f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:56.696924 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab314a-97aa-49ea-8600-8d5d4ec9f81f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:56.698589 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab314a-97aa-49ea-8600-8d5d4ec9f81f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:56.713999 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4d490-64e3-450f-a75b-8798d5545b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:56.714595 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 300/604] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:51:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:56.714704 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4d490-64e3-450f-a75b-8798d5545b52 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:56.714970 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4d490-64e3-450f-a75b-8798d5545b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:56.715243 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4d490-64e3-450f-a75b-8798d5545b52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:56.715756 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344e03f-7bd4-48a0-840c-c21e99649901 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:56.716039 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344e03f-7bd4-48a0-840c-c21e99649901 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:56.716305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344e03f-7bd4-48a0-840c-c21e99649901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:56.729142 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4d490-64e3-450f-a75b-8798d5545b52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:56.730742 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4d490-64e3-450f-a75b-8798d5545b52 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:56.735968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-3344e03f-7bd4-48a0-840c-c21e99649901 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:56.737153 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3344e03f-7bd4-48a0-840c-c21e99649901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:56.744078 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-cdc4d490-64e3-450f-a75b-8798d5545b52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:51:56.744078 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:56.744078 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:56.744078 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:56.744078 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:56.744078 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:56.744078 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:56.744078 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:56.744078 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:56.744078 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:56.744078 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:56.744078 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:56.744078 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:51:56.744078 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:51:56.744078 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:51:56.744961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:51:56.744961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:56.744961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:56.744961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:56.744961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:56.744961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:56.744961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:56.744961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:56.744961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:56.744961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:56.744961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:56.744961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:56.744961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:56.744961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:56.744961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:56.744961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:56.744961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:56.745874 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:51:56.745874 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:51:56.745874 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:51:56.745874 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:51:56.745874 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:51:56.745874 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:51:56.745874 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:51:56.745874 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:56.745874 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 305/605] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:51:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:56.746373 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4d490-64e3-450f-a75b-8798d5545b52 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:56.769009 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:56.829540 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 301/606] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:56.830651 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344e03f-7bd4-48a0-840c-c21e99649901 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:56.855967 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:56.887851 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4d490-64e3-450f-a75b-8798d5545b52 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:56.950419 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386f683-1d04-48f0-887d-53193430e9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:56.951323 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386f683-1d04-48f0-887d-53193430e9d8 None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:56.951713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386f683-1d04-48f0-887d-53193430e9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:56.952152 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386f683-1d04-48f0-887d-53193430e9d8 None admin] PATH_INFO: `/v3/projects/f37c835c05924364bcd1530d44f024fe/users/50394b1ba51b45a6bf833b63ff7e423b/roles/b9c910c1c68948858203c62521b73efc` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:56.981699 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386f683-1d04-48f0-887d-53193430e9d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=f37c835c05924364bcd1530d44f024fe, user_id=50394b1ba51b45a6bf833b63ff7e423b, role_id=b9c910c1c68948858203c62521b73efc)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:56.983443 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386f683-1d04-48f0-887d-53193430e9d8 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:57.004253 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 306/607] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 14 00:51:56 2022] PUT /identity/v3/projects/f37c835c05924364bcd1530d44f024fe/users/50394b1ba51b45a6bf833b63ff7e423b/roles/b9c910c1c68948858203c62521b73efc => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 00:51:57.023595 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344e03f-7bd4-48a0-840c-c21e99649901 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:57.076085 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b573f-e23c-4069-8ccd-24fccca5d73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:57.076967 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b573f-e23c-4069-8ccd-24fccca5d73d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:57.077982 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b573f-e23c-4069-8ccd-24fccca5d73d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:57.078364 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b573f-e23c-4069-8ccd-24fccca5d73d None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:57.079182 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b573f-e23c-4069-8ccd-24fccca5d73d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:57.079590 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b573f-e23c-4069-8ccd-24fccca5d73d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:57.081256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b573f-e23c-4069-8ccd-24fccca5d73d None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:57.101794 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 302/608] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:51:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:57.107774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386f683-1d04-48f0-887d-53193430e9d8 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:57.156851 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b573f-e23c-4069-8ccd-24fccca5d73d None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:57.215866 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:57.254703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386f683-1d04-48f0-887d-53193430e9d8 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:57.277228 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:57.294265 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184caa7-07c6-4f51-a299-05d74e7bd59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:57.294967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184caa7-07c6-4f51-a299-05d74e7bd59a None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:57.295363 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184caa7-07c6-4f51-a299-05d74e7bd59a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:57.296529 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184caa7-07c6-4f51-a299-05d74e7bd59a None admin] PATH_INFO: `/v3/projects/f37c835c05924364bcd1530d44f024fe/users/b4444b17075f4224a4da1ef501fd4eb5/roles/b9c910c1c68948858203c62521b73efc` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:57.314900 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184caa7-07c6-4f51-a299-05d74e7bd59a None admin] RBAC: Authorizing `identity:create_grant(project_id=f37c835c05924364bcd1530d44f024fe, user_id=b4444b17075f4224a4da1ef501fd4eb5, role_id=b9c910c1c68948858203c62521b73efc)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:57.316450 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184caa7-07c6-4f51-a299-05d74e7bd59a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:57.319998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b573f-e23c-4069-8ccd-24fccca5d73d None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:57.341826 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 307/609] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 14 00:51:57 2022] PUT /identity/v3/projects/f37c835c05924364bcd1530d44f024fe/users/b4444b17075f4224a4da1ef501fd4eb5/roles/b9c910c1c68948858203c62521b73efc => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 00:51:57.367537 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d75fa-69d6-414e-af1d-bd5d4a83d87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:57.368325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d75fa-69d6-414e-af1d-bd5d4a83d87f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:57.368766 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d75fa-69d6-414e-af1d-bd5d4a83d87f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:57.369137 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d75fa-69d6-414e-af1d-bd5d4a83d87f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:57.381478 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d75fa-69d6-414e-af1d-bd5d4a83d87f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:57.387377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-3e7d75fa-69d6-414e-af1d-bd5d4a83d87f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:51:57.387377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:57.387377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:57.387377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:57.387377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:57.387377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:57.387377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:57.387377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:57.387377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:57.387377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:57.387377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:57.387377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:57.387377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:57.387377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:57.387377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:57.387377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:57.388530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:57.388530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:57.388530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:57.388530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:57.388530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:57.388530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:57.388530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:57.388530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:57.388530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:57.388530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:57.388530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:57.388530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:57.388530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:57.388530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:57.388530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:57.388530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:57.389366 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:57.389366 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:57.389366 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:57.389366 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:57.389366 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:57.389366 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:57.389366 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:57.389366 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:57.389366 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:57.389366 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:57.389366 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:51:57.389366 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:57.390788 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 303/610] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 14 00:51:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:51:57.398158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184caa7-07c6-4f51-a299-05d74e7bd59a None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:57.512903 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184caa7-07c6-4f51-a299-05d74e7bd59a None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:57.547013 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:57.557537 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af2006-a1a5-4609-878d-8c2b42fcd07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:57.558224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af2006-a1a5-4609-878d-8c2b42fcd07c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:57.558709 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af2006-a1a5-4609-878d-8c2b42fcd07c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:57.559387 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af2006-a1a5-4609-878d-8c2b42fcd07c None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:57.560147 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af2006-a1a5-4609-878d-8c2b42fcd07c None admin] RBAC: Adding query filter params (name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:57.560634 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af2006-a1a5-4609-878d-8c2b42fcd07c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:57.562229 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af2006-a1a5-4609-878d-8c2b42fcd07c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:57.571962 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 308/611] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 14 00:51:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:57.578901 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d75fa-69d6-414e-af1d-bd5d4a83d87f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:57.724161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d75fa-69d6-414e-af1d-bd5d4a83d87f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:57.761331 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b9acf-c281-4cb7-b80e-d7a58620df48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:57.761993 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b9acf-c281-4cb7-b80e-d7a58620df48 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:57.762267 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b9acf-c281-4cb7-b80e-d7a58620df48 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:57.762531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b9acf-c281-4cb7-b80e-d7a58620df48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:57.764754 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:57.775164 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b9acf-c281-4cb7-b80e-d7a58620df48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:57.776608 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b9acf-c281-4cb7-b80e-d7a58620df48 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:57.793310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-e13b9acf-c281-4cb7-b80e-d7a58620df48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:57.793310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:57.793310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:57.793310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:57.793310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:57.793310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:57.793310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:57.793310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:57.793310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:57.793310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:57.793310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:57.793310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:57.793310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:51:57.793310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:51:57.793310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:51:57.793310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:51:57.794325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:57.794325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:57.794325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:57.794325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:57.794325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:57.794325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:57.794325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:57.794325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:57.794325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:57.794325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:57.794325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:57.794325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:57.794325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:57.794325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:57.794325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:57.794325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:57.794325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:51:57.795462 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:51:57.795462 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:57.795462 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:57.795462 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 304/612] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:57.801391 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af2006-a1a5-4609-878d-8c2b42fcd07c None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:57.918015 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af2006-a1a5-4609-878d-8c2b42fcd07c None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:57.952709 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c792ec9-fbeb-435e-acba-7d35a5641c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:57.953318 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c792ec9-fbeb-435e-acba-7d35a5641c25 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:57.953599 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c792ec9-fbeb-435e-acba-7d35a5641c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:57.953898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c792ec9-fbeb-435e-acba-7d35a5641c25 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:57.954536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c792ec9-fbeb-435e-acba-7d35a5641c25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:57.954925 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c792ec9-fbeb-435e-acba-7d35a5641c25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:57.956352 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c792ec9-fbeb-435e-acba-7d35a5641c25 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:57.968797 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 309/613] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:57.974591 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b9acf-c281-4cb7-b80e-d7a58620df48 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:58.121644 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b9acf-c281-4cb7-b80e-d7a58620df48 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:58.168741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79841057-1277-491b-94e8-5ef9fd962db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:58.169732 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79841057-1277-491b-94e8-5ef9fd962db1 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:58.170246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79841057-1277-491b-94e8-5ef9fd962db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:58.171276 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79841057-1277-491b-94e8-5ef9fd962db1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:58.183330 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79841057-1277-491b-94e8-5ef9fd962db1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:58.185046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79841057-1277-491b-94e8-5ef9fd962db1 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:58.197018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-79841057-1277-491b-94e8-5ef9fd962db1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 00:51:58.197018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:58.197018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:58.197018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:58.197018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:58.197018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:58.197018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:58.197018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:58.197018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:58.197018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:58.197018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:58.197018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:58.197018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:51:58.197018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:51:58.197018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:51:58.197018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:51:58.202977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:58.202977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:58.202977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:51:58.202977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:51:58.202977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:51:58.202977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:51:58.202977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:58.202977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:58.202977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:58.202977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:58.202977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:58.202977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:58.202977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:58.202977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:58.202977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:58.202977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:58.202977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:58.202977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:58.203947 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:58.203947 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:58.203947 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:51:58.203947 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:51:58.203947 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:51:58.203947 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:51:58.203947 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:51:58.203947 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:51:58.203947 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 00:51:58.203947 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:58.206164 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 305/614] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:51:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:58.212020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c792ec9-fbeb-435e-acba-7d35a5641c25 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:58.271671 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:58.336797 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c792ec9-fbeb-435e-acba-7d35a5641c25 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:58.376335 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72fcac-e2e9-4c74-bd55-a51b3e895e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:58.376865 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72fcac-e2e9-4c74-bd55-a51b3e895e8e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:58.377143 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72fcac-e2e9-4c74-bd55-a51b3e895e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:58.377411 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72fcac-e2e9-4c74-bd55-a51b3e895e8e None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:58.378152 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72fcac-e2e9-4c74-bd55-a51b3e895e8e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:58.378455 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72fcac-e2e9-4c74-bd55-a51b3e895e8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:58.379874 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72fcac-e2e9-4c74-bd55-a51b3e895e8e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:58.399495 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 310/615] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Sep 14 00:51:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:58.405716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79841057-1277-491b-94e8-5ef9fd962db1 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:58.480455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:58.540184 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbaacb5-6767-40f0-8f39-fb05a5748496 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:58.540519 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbaacb5-6767-40f0-8f39-fb05a5748496 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:58.540739 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbaacb5-6767-40f0-8f39-fb05a5748496 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:58.542657 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 311/616] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:58.548408 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e948c-fd90-4bfa-a285-6b9f49c0c650 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:58.548916 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e948c-fd90-4bfa-a285-6b9f49c0c650 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:58.549380 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e948c-fd90-4bfa-a285-6b9f49c0c650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:58.557824 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79841057-1277-491b-94e8-5ef9fd962db1 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:58.586750 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-640e948c-fd90-4bfa-a285-6b9f49c0c650 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:58.588135 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e7ef1-9eba-432a-b263-b7f8ddcf7ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:58.588535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-640e948c-fd90-4bfa-a285-6b9f49c0c650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:58.588754 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e7ef1-9eba-432a-b263-b7f8ddcf7ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:58.589029 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e7ef1-9eba-432a-b263-b7f8ddcf7ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:58.589299 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e7ef1-9eba-432a-b263-b7f8ddcf7ea9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:58.601827 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e7ef1-9eba-432a-b263-b7f8ddcf7ea9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:58.602375 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e7ef1-9eba-432a-b263-b7f8ddcf7ea9 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:58.620430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-162e7ef1-9eba-432a-b263-b7f8ddcf7ea9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:58.620430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:58.620430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:58.620430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:58.620430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:58.620430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:58.620430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:58.620430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:58.620430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:58.620430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:58.620430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:58.620430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:58.620430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:51:58.620430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:51:58.620430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:51:58.620430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:51:58.621370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:58.621370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:58.621370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:58.621370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:58.621370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:58.621370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:58.621370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:58.621370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:58.621370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:58.621370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:58.621370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:58.621370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:58.621370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:58.621370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:58.621370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:58.621370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:58.621370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:51:58.622266 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:51:58.622266 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:58.622266 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:58.622266 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 306/617] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:58.628329 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e7ef1-9eba-432a-b263-b7f8ddcf7ea9 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:58.739307 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 312/618] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:58.740755 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:58.744057 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e7ef1-9eba-432a-b263-b7f8ddcf7ea9 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:58.779760 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59182c2d-adc0-448c-9fd9-e9b91393f60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:58.781010 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59182c2d-adc0-448c-9fd9-e9b91393f60c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:58.781286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59182c2d-adc0-448c-9fd9-e9b91393f60c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:58.781555 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59182c2d-adc0-448c-9fd9-e9b91393f60c None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:58.782356 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59182c2d-adc0-448c-9fd9-e9b91393f60c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:58.782660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59182c2d-adc0-448c-9fd9-e9b91393f60c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:58.784080 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59182c2d-adc0-448c-9fd9-e9b91393f60c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:58.798624 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 307/619] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:51:58.804246 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e948c-fd90-4bfa-a285-6b9f49c0c650 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:58.833960 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:58.907673 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e948c-fd90-4bfa-a285-6b9f49c0c650 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:58.942966 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b856d-fb47-428f-b195-f25492da6bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:58.943648 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b856d-fb47-428f-b195-f25492da6bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:58.943932 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b856d-fb47-428f-b195-f25492da6bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:58.944206 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b856d-fb47-428f-b195-f25492da6bd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:58.951064 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b856d-fb47-428f-b195-f25492da6bd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:58.952577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b856d-fb47-428f-b195-f25492da6bd7 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:58.963842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-a25b856d-fb47-428f-b195-f25492da6bd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:51:58.963842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:58.963842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:58.963842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:58.963842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:58.963842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:58.963842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:58.963842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:58.963842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:58.963842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:58.963842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:58.963842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:58.963842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:51:58.963842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:51:58.963842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:51:58.964703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:51:58.964703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:58.964703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:58.964703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:58.964703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:58.964703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:58.964703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:58.964703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:58.964703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:58.964703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:58.964703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:58.964703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:58.964703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:58.964703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:58.964703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:58.964703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:58.964703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:58.965572 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:51:58.965572 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:51:58.965572 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:51:58.965572 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:51:58.965572 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:51:58.965572 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:51:58.965572 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:51:58.965572 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:58.965572 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 313/620] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:51:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:58.970792 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59182c2d-adc0-448c-9fd9-e9b91393f60c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:59.091478 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59182c2d-adc0-448c-9fd9-e9b91393f60c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:59.139602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea864fc-c6b2-4755-9ef8-100af841996d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:59.140527 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea864fc-c6b2-4755-9ef8-100af841996d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:59.140992 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea864fc-c6b2-4755-9ef8-100af841996d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:59.141436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea864fc-c6b2-4755-9ef8-100af841996d None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:59.142339 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea864fc-c6b2-4755-9ef8-100af841996d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:59.142818 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea864fc-c6b2-4755-9ef8-100af841996d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:59.144412 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea864fc-c6b2-4755-9ef8-100af841996d None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:59.161075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 308/621] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:51:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:59.167110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b856d-fb47-428f-b195-f25492da6bd7 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:59.282001 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:59.293959 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b856d-fb47-428f-b195-f25492da6bd7 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:59.299601 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea864fc-c6b2-4755-9ef8-100af841996d None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:59.325285 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:59.341683 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e3b5e-d92e-49c2-be25-2f35654a96b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:59.342372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e3b5e-d92e-49c2-be25-2f35654a96b5 None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:59.343176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e3b5e-d92e-49c2-be25-2f35654a96b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:59.343451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e3b5e-d92e-49c2-be25-2f35654a96b5 None admin] PATH_INFO: `/v3/projects/f37c835c05924364bcd1530d44f024fe/users/c8d05652bfe542d5a2cfa39fbf7a83c9/roles/b9c910c1c68948858203c62521b73efc` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:59.359448 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e3b5e-d92e-49c2-be25-2f35654a96b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=f37c835c05924364bcd1530d44f024fe, user_id=c8d05652bfe542d5a2cfa39fbf7a83c9, role_id=b9c910c1c68948858203c62521b73efc)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:59.361077 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e3b5e-d92e-49c2-be25-2f35654a96b5 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:59.376451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 314/622] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 14 00:51:59 2022] PUT /identity/v3/projects/f37c835c05924364bcd1530d44f024fe/users/c8d05652bfe542d5a2cfa39fbf7a83c9/roles/b9c910c1c68948858203c62521b73efc => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 00:51:59.377928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe208b9-dad8-4c99-b5cc-807271479da1 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:59.378356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe208b9-dad8-4c99-b5cc-807271479da1 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:59.378686 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe208b9-dad8-4c99-b5cc-807271479da1 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:59.384431 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 315/623] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:51:59.386147 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f0700-6337-4dae-9a2b-3a340910c477 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:59.386541 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f0700-6337-4dae-9a2b-3a340910c477 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:59.386921 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f0700-6337-4dae-9a2b-3a340910c477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:59.406948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-da7f0700-6337-4dae-9a2b-3a340910c477 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:51:59.408483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-da7f0700-6337-4dae-9a2b-3a340910c477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:51:59.422793 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea864fc-c6b2-4755-9ef8-100af841996d None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:59.461726 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7f63d-94c3-435b-946d-3fa9e33b3832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:59.462490 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7f63d-94c3-435b-946d-3fa9e33b3832 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:59.462770 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7f63d-94c3-435b-946d-3fa9e33b3832 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:59.463040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7f63d-94c3-435b-946d-3fa9e33b3832 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:59.475789 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7f63d-94c3-435b-946d-3fa9e33b3832 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:51:59.481872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-b1e7f63d-94c3-435b-946d-3fa9e33b3832 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:51:59.481872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:59.481872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:59.481872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:59.481872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:59.481872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:59.481872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:59.481872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:59.481872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:59.481872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:59.481872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:59.481872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:59.481872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:51:59.481872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:51:59.481872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:51:59.481872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:51:59.484132 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:51:59.484132 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:51:59.484132 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:51:59.484132 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:51:59.484132 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:59.484132 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:59.484132 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:59.484132 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:59.484132 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:59.484132 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:59.484132 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:59.484132 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:59.484132 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:59.484132 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:59.484132 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:59.484132 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:59.485163 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:59.485163 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:59.485163 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:59.485163 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:59.485163 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:51:59.485163 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:51:59.485163 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:51:59.485163 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:51:59.485163 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:51:59.485163 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:51:59.485163 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:51:59.485163 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:51:59.485163 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 309/624] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 14 00:51:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:59.494035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 316/625] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:51:59.502255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7f63d-94c3-435b-946d-3fa9e33b3832 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:59.606206 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:59.619044 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7f63d-94c3-435b-946d-3fa9e33b3832 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:59.655159 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98f5f8-08d7-4302-bf58-db3601c57a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:59.655763 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98f5f8-08d7-4302-bf58-db3601c57a71 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:59.656038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98f5f8-08d7-4302-bf58-db3601c57a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:59.656306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98f5f8-08d7-4302-bf58-db3601c57a71 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:59.656967 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98f5f8-08d7-4302-bf58-db3601c57a71 None admin] RBAC: Adding query filter params (name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:51:59.657271 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98f5f8-08d7-4302-bf58-db3601c57a71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:59.658664 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98f5f8-08d7-4302-bf58-db3601c57a71 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:59.667294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 310/626] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 14 00:51:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:51:59.674381 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f0700-6337-4dae-9a2b-3a340910c477 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:59.752647 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:51:59.788322 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f0700-6337-4dae-9a2b-3a340910c477 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:51:59.824165 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe51fc-3145-4179-95d8-42fe7e39ec6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:51:59.824818 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe51fc-3145-4179-95d8-42fe7e39ec6e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:51:59.825094 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe51fc-3145-4179-95d8-42fe7e39ec6e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:51:59.825364 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe51fc-3145-4179-95d8-42fe7e39ec6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:51:59.837284 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe51fc-3145-4179-95d8-42fe7e39ec6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:51:59.838880 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe51fc-3145-4179-95d8-42fe7e39ec6e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:51:59.864450 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-edbe51fc-3145-4179-95d8-42fe7e39ec6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:59.864450 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:51:59.864450 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:51:59.864450 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:51:59.864450 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:51:59.864450 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:51:59.864450 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:51:59.864450 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:51:59.864450 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:51:59.864450 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:51:59.864450 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:51:59.864450 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:51:59.864450 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:51:59.864450 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:51:59.864450 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:51:59.864450 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:51:59.865445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:51:59.865445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:51:59.865445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:51:59.865445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:51:59.865445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:51:59.865445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:51:59.865445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:51:59.865445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:51:59.865445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:51:59.865445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:51:59.865445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:51:59.865445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:51:59.865445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:51:59.865445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:51:59.865445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:51:59.865445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:51:59.865445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:51:59.866346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:51:59.866346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:51:59.866346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:51:59.866346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 317/627] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:51:59.871138 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98f5f8-08d7-4302-bf58-db3601c57a71 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:51:59.899503 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe51fc-3145-4179-95d8-42fe7e39ec6e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:00.033525 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe51fc-3145-4179-95d8-42fe7e39ec6e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:00.033923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98f5f8-08d7-4302-bf58-db3601c57a71 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:00.053662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:00.068264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b26cb2e-2866-41d0-8e7e-c37c952ea8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:00.068936 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26cb2e-2866-41d0-8e7e-c37c952ea8ef None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:00.069230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26cb2e-2866-41d0-8e7e-c37c952ea8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:00.069508 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26cb2e-2866-41d0-8e7e-c37c952ea8ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:00.071068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac28dc-4c27-4686-96b1-37f7c27919a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:00.071664 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac28dc-4c27-4686-96b1-37f7c27919a4 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:00.071936 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac28dc-4c27-4686-96b1-37f7c27919a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:00.072266 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac28dc-4c27-4686-96b1-37f7c27919a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:00.072909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac28dc-4c27-4686-96b1-37f7c27919a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:00.073207 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac28dc-4c27-4686-96b1-37f7c27919a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:00.074668 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac28dc-4c27-4686-96b1-37f7c27919a4 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:00.081869 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b26cb2e-2866-41d0-8e7e-c37c952ea8ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:52:00.084264 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:00.087666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-9b26cb2e-2866-41d0-8e7e-c37c952ea8ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:52:00.087666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:00.087666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:00.087666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:00.087666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:00.087666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:00.087666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:00.087666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:00.087666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:00.087666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:00.087666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:00.087666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:00.087666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:52:00.087666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:52:00.087666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:52:00.087666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:52:00.088680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:52:00.088680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:52:00.088680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:52:00.088680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:52:00.088680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:00.088680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:00.088680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:00.088680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:00.088680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:00.088680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:00.088680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:00.088680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:00.088680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:00.088680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:00.088680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:00.088680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:00.089510 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:00.089510 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:00.089510 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:00.089510 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:00.089510 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:52:00.089510 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:52:00.089510 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:52:00.089510 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:52:00.089510 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:52:00.089510 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:52:00.089510 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:52:00.089510 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:00.093139 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 311/629] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:00.093428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 318/629] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 14 00:51:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:52:00.094409 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf7827-46f8-4187-8cad-e55a72a4afee None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:00.094661 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b26cb2e-2866-41d0-8e7e-c37c952ea8ef None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:00.094783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf7827-46f8-4187-8cad-e55a72a4afee None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:00.094947 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf7827-46f8-4187-8cad-e55a72a4afee None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:00.096579 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 312/630] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:00.101588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf7827-46f8-4187-8cad-e55a72a4afee None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:00.211499 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b26cb2e-2866-41d0-8e7e-c37c952ea8ef None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:00.235727 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf7827-46f8-4187-8cad-e55a72a4afee None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:00.254768 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eed111-c991-4574-8fe6-cdaccf134dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:00.255641 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eed111-c991-4574-8fe6-cdaccf134dde None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:00.256087 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eed111-c991-4574-8fe6-cdaccf134dde None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:00.256523 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eed111-c991-4574-8fe6-cdaccf134dde None admin] PATH_INFO: `/v3/users/nova` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:00.268604 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eed111-c991-4574-8fe6-cdaccf134dde None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:00.270339 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eed111-c991-4574-8fe6-cdaccf134dde None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:00.278147 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77f4a4-1ea1-4922-bdb6-adabeb7bbadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:00.278759 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77f4a4-1ea1-4922-bdb6-adabeb7bbadc None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:00.279039 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77f4a4-1ea1-4922-bdb6-adabeb7bbadc None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:00.279361 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77f4a4-1ea1-4922-bdb6-adabeb7bbadc None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:00.280356 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77f4a4-1ea1-4922-bdb6-adabeb7bbadc None admin] RBAC: Adding query filter params (name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:00.280655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77f4a4-1ea1-4922-bdb6-adabeb7bbadc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:00.282146 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77f4a4-1ea1-4922-bdb6-adabeb7bbadc None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:00.287235 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-20eed111-c991-4574-8fe6-cdaccf134dde None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 00:52:00.287235 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:00.287235 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:00.287235 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:00.287235 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:00.287235 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:00.287235 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:00.287235 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:00.287235 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:00.287235 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:00.287235 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:00.287235 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:00.287235 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:52:00.287235 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:52:00.287235 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:52:00.287235 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:52:00.288507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:00.288507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:00.288507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:52:00.288507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:00.288507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:52:00.288507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:00.288507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:00.288507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:00.288507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:00.288507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:00.288507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:00.288507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:00.288507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:00.288507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:00.288507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:00.288507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:00.288507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:00.288507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:00.289662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:00.289662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:00.289662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:52:00.289662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:52:00.289662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:52:00.289662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:52:00.289662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:52:00.289662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:52:00.289662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 00:52:00.289662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:00.290271 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 319/631] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Sep 14 00:52:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:00.290986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfde33-361e-443e-ba11-db2118fac2a3 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:00.291269 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfde33-361e-443e-ba11-db2118fac2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:00.291539 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfde33-361e-443e-ba11-db2118fac2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:00.303658 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 313/632] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 14 00:52:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:00.303658 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa683a03-671d-4d53-a3c5-30d7a8b5b5e8 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:00.303658 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa683a03-671d-4d53-a3c5-30d7a8b5b5e8 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:00.303658 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa683a03-671d-4d53-a3c5-30d7a8b5b5e8 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:00.303658 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 314/633] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:00.303658 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa683a03-671d-4d53-a3c5-30d7a8b5b5e8 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:00.317405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-74cfde33-361e-443e-ba11-db2118fac2a3 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:00.318628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-74cfde33-361e-443e-ba11-db2118fac2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:00.356047 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:00.372796 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:00.401832 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 320/634] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:52:00.401832 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfde33-361e-443e-ba11-db2118fac2a3 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:00.424898 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa683a03-671d-4d53-a3c5-30d7a8b5b5e8 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:00.463231 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa9719-8fac-4917-868f-bb4b26b55029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:00.463831 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa9719-8fac-4917-868f-bb4b26b55029 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:00.464105 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa9719-8fac-4917-868f-bb4b26b55029 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:00.464374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa9719-8fac-4917-868f-bb4b26b55029 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:00.465091 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa9719-8fac-4917-868f-bb4b26b55029 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:00.465392 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa9719-8fac-4917-868f-bb4b26b55029 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:00.466898 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa9719-8fac-4917-868f-bb4b26b55029 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:00.485553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 315/635] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Sep 14 00:52:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:00.486819 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360b0cb-5d1b-4fd2-959b-0880cbcb3066 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:00.487101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360b0cb-5d1b-4fd2-959b-0880cbcb3066 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:00.487434 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360b0cb-5d1b-4fd2-959b-0880cbcb3066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:00.505582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-4360b0cb-5d1b-4fd2-959b-0880cbcb3066 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:00.506745 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4360b0cb-5d1b-4fd2-959b-0880cbcb3066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:00.518246 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfde33-361e-443e-ba11-db2118fac2a3 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:00.566826 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb349e-6846-41dc-b38d-7c52c4d927f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:00.567811 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb349e-6846-41dc-b38d-7c52c4d927f8 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:00.568163 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb349e-6846-41dc-b38d-7c52c4d927f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:00.568897 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb349e-6846-41dc-b38d-7c52c4d927f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:00.580185 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb349e-6846-41dc-b38d-7c52c4d927f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:00.581066 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 316/636] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:52:00.581633 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb349e-6846-41dc-b38d-7c52c4d927f8 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:00.582149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360b0cb-5d1b-4fd2-959b-0880cbcb3066 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:00.597915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-abdb349e-6846-41dc-b38d-7c52c4d927f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:00.597915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:00.597915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:00.597915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:00.597915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:00.597915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:00.597915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:00.597915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:00.597915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:00.597915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:00.597915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:00.597915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:00.597915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:00.597915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:00.597915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:00.597915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:00.598872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:00.598872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:00.598872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:00.598872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:00.598872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:00.598872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:00.598872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:00.598872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:00.598872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:00.598872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:00.598872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:00.598872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:00.598872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:00.598872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:00.598872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:00.598872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:00.598872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:00.599757 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:00.599757 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:00.599757 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:00.599757 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 321/637] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:00.605431 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb349e-6846-41dc-b38d-7c52c4d927f8 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:00.638860 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:00.639929 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:00.702810 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360b0cb-5d1b-4fd2-959b-0880cbcb3066 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:00.730157 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb349e-6846-41dc-b38d-7c52c4d927f8 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:00.762803 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffab97f-d9a6-4d74-8269-2bea8819996c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:00.763329 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffab97f-d9a6-4d74-8269-2bea8819996c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:00.763713 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffab97f-d9a6-4d74-8269-2bea8819996c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:00.764131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffab97f-d9a6-4d74-8269-2bea8819996c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:00.770988 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe7518-2886-463e-923f-54c12e86f0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:00.771914 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe7518-2886-463e-923f-54c12e86f0ae None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:00.774309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe7518-2886-463e-923f-54c12e86f0ae None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:00.774596 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe7518-2886-463e-923f-54c12e86f0ae None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:00.775252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe7518-2886-463e-923f-54c12e86f0ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:00.775605 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe7518-2886-463e-923f-54c12e86f0ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:00.776967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe7518-2886-463e-923f-54c12e86f0ae None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:00.791170 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 322/638] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:00.796230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe7518-2886-463e-923f-54c12e86f0ae None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:00.853719 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffab97f-d9a6-4d74-8269-2bea8819996c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:00.855656 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffab97f-d9a6-4d74-8269-2bea8819996c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:00.878849 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:00.898202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe7518-2886-463e-923f-54c12e86f0ae None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:00.912954 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:00.946458 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f806f-33d1-4a24-9df9-af8094009ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:00.948865 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f806f-33d1-4a24-9df9-af8094009ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:00.949362 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f806f-33d1-4a24-9df9-af8094009ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:00.950477 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f806f-33d1-4a24-9df9-af8094009ef5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:00.967204 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f806f-33d1-4a24-9df9-af8094009ef5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:52:00.972849 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 317/639] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:52:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:52:00.973140 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-541f806f-33d1-4a24-9df9-af8094009ef5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:52:00.973140 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:00.973140 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:00.973140 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:00.973140 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:00.973140 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:00.973140 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:00.973140 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:00.973140 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:00.973140 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:00.973140 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:00.973140 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:00.973140 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:52:00.973140 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:52:00.973140 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:52:00.973140 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:52:00.974293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:52:00.974293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:52:00.974293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:52:00.974293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:52:00.974293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:00.974293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:00.974293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:00.974293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:00.974293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:00.974293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:00.974293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:00.974293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:00.974293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:00.974293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:00.974293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:00.974293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:00.975202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:00.975202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:00.975202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:00.975202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:00.975202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:52:00.975202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:52:00.975202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:52:00.975202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:52:00.975202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:52:00.975202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:52:00.975202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:52:00.975202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:00.975831 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffab97f-d9a6-4d74-8269-2bea8819996c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:00.977435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 323/640] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 14 00:52:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:00.978436 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f806f-33d1-4a24-9df9-af8094009ef5 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:01.082185 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffab97f-d9a6-4d74-8269-2bea8819996c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:01.086374 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f806f-33d1-4a24-9df9-af8094009ef5 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:01.119491 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51258a03-5399-46f5-b9b4-5a57ce42437a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:01.120109 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51258a03-5399-46f5-b9b4-5a57ce42437a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:01.120385 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51258a03-5399-46f5-b9b4-5a57ce42437a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:01.120650 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51258a03-5399-46f5-b9b4-5a57ce42437a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:01.122499 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41456c8a-ca2d-44f4-bf1d-e4c94a4aa629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:01.124393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41456c8a-ca2d-44f4-bf1d-e4c94a4aa629 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:01.124894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41456c8a-ca2d-44f4-bf1d-e4c94a4aa629 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:01.125367 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41456c8a-ca2d-44f4-bf1d-e4c94a4aa629 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:01.128113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51258a03-5399-46f5-b9b4-5a57ce42437a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:01.129553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51258a03-5399-46f5-b9b4-5a57ce42437a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:01.137681 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41456c8a-ca2d-44f4-bf1d-e4c94a4aa629 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:52:01.140857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-51258a03-5399-46f5-b9b4-5a57ce42437a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 14 00:52:01.140857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:01.140857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:01.140857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:01.140857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:01.140857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:01.140857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:01.140857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:01.140857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:01.140857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:01.140857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:01.140857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:01.140857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:52:01.140857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:52:01.140857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:52:01.140857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:52:01.146970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:01.146970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:01.146970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:52:01.146970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:01.146970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:52:01.146970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:01.146970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:01.146970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:01.146970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:01.146970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:01.146970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:01.146970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:01.146970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:01.146970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:01.146970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:01.146970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:01.146970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:01.146970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:01.147945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:01.147945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:01.147945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:52:01.147945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:52:01.147945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:52:01.147945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:52:01.147945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:52:01.147945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:52:01.147945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 14 00:52:01.147945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:01.147945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 318/641] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:52:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:01.147945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51258a03-5399-46f5-b9b4-5a57ce42437a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:01.148595 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-41456c8a-ca2d-44f4-bf1d-e4c94a4aa629 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:52:01.148595 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:01.148595 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:01.148595 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:01.148595 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:01.148595 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:01.148595 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:01.148595 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:01.148595 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:01.148595 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:01.148595 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:01.148595 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:01.148595 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:52:01.148595 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:52:01.148595 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:52:01.148595 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:52:01.150408 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:52:01.150408 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:52:01.150408 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:52:01.150408 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:52:01.150408 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:01.150408 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:01.150408 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:01.150408 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:01.150408 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:01.150408 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:01.150408 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:01.150408 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:01.150408 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:01.150408 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:01.150408 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:01.150408 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:01.153199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:01.153199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:01.153199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:01.153199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:01.153199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:52:01.153199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:52:01.153199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:52:01.153199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:52:01.153199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:52:01.153199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:52:01.153199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:52:01.153199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:01.153199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 324/642] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 14 00:52:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:01.153199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41456c8a-ca2d-44f4-bf1d-e4c94a4aa629 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:01.156138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:01.161022 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:01.252426 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41456c8a-ca2d-44f4-bf1d-e4c94a4aa629 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:01.254385 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51258a03-5399-46f5-b9b4-5a57ce42437a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:01.289813 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203dcd3c-75d3-468e-b107-70c66c21bd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:01.290461 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dcd3c-75d3-468e-b107-70c66c21bd34 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:01.290739 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dcd3c-75d3-468e-b107-70c66c21bd34 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:01.291009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dcd3c-75d3-468e-b107-70c66c21bd34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:01.292749 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db8b26-199e-41d8-9e90-61eeea50f386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:01.293310 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db8b26-199e-41d8-9e90-61eeea50f386 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:01.293653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db8b26-199e-41d8-9e90-61eeea50f386 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:01.294018 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db8b26-199e-41d8-9e90-61eeea50f386 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:01.294745 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db8b26-199e-41d8-9e90-61eeea50f386 None admin] RBAC: Adding query filter params (name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:01.295111 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db8b26-199e-41d8-9e90-61eeea50f386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:01.296668 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db8b26-199e-41d8-9e90-61eeea50f386 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:01.302799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203dcd3c-75d3-468e-b107-70c66c21bd34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:01.304097 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203dcd3c-75d3-468e-b107-70c66c21bd34 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:01.310578 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 325/643] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 14 00:52:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:01.310578 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db8b26-199e-41d8-9e90-61eeea50f386 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:01.323561 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-203dcd3c-75d3-468e-b107-70c66c21bd34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:01.323561 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:01.323561 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:01.323561 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:01.323561 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:01.323561 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:01.323561 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:01.323561 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:01.323561 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:01.323561 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:01.323561 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:01.323561 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:01.323561 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:01.323561 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:01.323561 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:01.323561 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:01.324689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:01.324689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:01.324689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:01.324689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:01.324689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:01.324689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:01.324689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:01.324689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:01.324689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:01.324689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:01.324689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:01.324689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:01.324689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:01.324689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:01.324689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:01.324689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:01.324689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:01.325917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:01.325917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:01.325917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:01.325917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 319/644] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:01.330055 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203dcd3c-75d3-468e-b107-70c66c21bd34 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:01.378602 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:01.395279 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:01.419255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db8b26-199e-41d8-9e90-61eeea50f386 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:01.438226 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203dcd3c-75d3-468e-b107-70c66c21bd34 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:01.454713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a426b77-dbbc-4dec-b7ec-3eb937abf318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:01.455322 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a426b77-dbbc-4dec-b7ec-3eb937abf318 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:01.455610 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a426b77-dbbc-4dec-b7ec-3eb937abf318 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:01.455882 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a426b77-dbbc-4dec-b7ec-3eb937abf318 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:01.456613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a426b77-dbbc-4dec-b7ec-3eb937abf318 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:01.456915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a426b77-dbbc-4dec-b7ec-3eb937abf318 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:01.458372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a426b77-dbbc-4dec-b7ec-3eb937abf318 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:01.475455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872ff3d-148d-42b8-8a70-645cad5bfd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:01.476005 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 326/645] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Sep 14 00:52:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:01.476588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872ff3d-148d-42b8-8a70-645cad5bfd74 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:01.477086 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872ff3d-148d-42b8-8a70-645cad5bfd74 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:01.477581 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872ff3d-148d-42b8-8a70-645cad5bfd74 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:01.478476 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872ff3d-148d-42b8-8a70-645cad5bfd74 None admin] RBAC: Adding query filter params (name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:01.478996 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872ff3d-148d-42b8-8a70-645cad5bfd74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:01.480551 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872ff3d-148d-42b8-8a70-645cad5bfd74 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:01.480794 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a426b77-dbbc-4dec-b7ec-3eb937abf318 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:01.489393 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 320/646] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 14 00:52:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:01.494066 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872ff3d-148d-42b8-8a70-645cad5bfd74 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:01.591764 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a426b77-dbbc-4dec-b7ec-3eb937abf318 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:01.593772 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872ff3d-148d-42b8-8a70-645cad5bfd74 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:01.617542 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:01.620026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:01.629848 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1c2b0-e542-43d1-955d-9a74cc92ca15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:01.630406 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1c2b0-e542-43d1-955d-9a74cc92ca15 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:01.630655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1c2b0-e542-43d1-955d-9a74cc92ca15 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:01.630929 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1c2b0-e542-43d1-955d-9a74cc92ca15 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:01.631571 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1c2b0-e542-43d1-955d-9a74cc92ca15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:01.631875 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1c2b0-e542-43d1-955d-9a74cc92ca15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:01.632630 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b3fba-08f3-4a2b-8799-e0ab0d55a4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:01.633237 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1c2b0-e542-43d1-955d-9a74cc92ca15 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:01.633433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b3fba-08f3-4a2b-8799-e0ab0d55a4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:01.633830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b3fba-08f3-4a2b-8799-e0ab0d55a4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:01.634201 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b3fba-08f3-4a2b-8799-e0ab0d55a4b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:01.649449 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 321/647] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:01.649449 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1c2b0-e542-43d1-955d-9a74cc92ca15 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:01.651272 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b3fba-08f3-4a2b-8799-e0ab0d55a4b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:01.652825 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b3fba-08f3-4a2b-8799-e0ab0d55a4b4 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:01.670141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-ac0b3fba-08f3-4a2b-8799-e0ab0d55a4b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:01.670141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:01.670141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:01.670141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:01.670141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:01.670141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:01.670141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:01.670141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:01.670141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:01.670141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:01.670141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:01.670141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:01.670141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:01.670141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:01.670141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:01.670141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:01.671355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:01.671355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:01.671355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:01.671355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:01.671355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:01.671355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:01.671355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:01.671355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:01.671355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:01.671355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:01.671355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:01.671355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:01.671355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:01.671355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:01.671355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:01.671355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:01.671355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:01.677152 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:01.677152 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:01.677152 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:01.677152 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 327/648] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:01.677152 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b3fba-08f3-4a2b-8799-e0ab0d55a4b4 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:01.765205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1c2b0-e542-43d1-955d-9a74cc92ca15 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:01.790111 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b3fba-08f3-4a2b-8799-e0ab0d55a4b4 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:01.804388 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c286ec-f2de-44d8-b62c-3ea28cd8897a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:01.804995 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c286ec-f2de-44d8-b62c-3ea28cd8897a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:01.805279 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c286ec-f2de-44d8-b62c-3ea28cd8897a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:01.805534 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c286ec-f2de-44d8-b62c-3ea28cd8897a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:01.825030 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd123a40-da36-41ec-9b0d-686cce8ea210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:01.825654 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd123a40-da36-41ec-9b0d-686cce8ea210 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:01.825964 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd123a40-da36-41ec-9b0d-686cce8ea210 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:01.826237 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd123a40-da36-41ec-9b0d-686cce8ea210 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:01.837945 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd123a40-da36-41ec-9b0d-686cce8ea210 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:01.839398 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd123a40-da36-41ec-9b0d-686cce8ea210 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:01.853259 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-fd123a40-da36-41ec-9b0d-686cce8ea210 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:01.853259 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:01.853259 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:01.853259 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:01.853259 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:01.853259 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:01.853259 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:01.853259 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:01.853259 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:01.853259 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:01.853259 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:01.853259 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:01.853259 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:01.853259 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:01.853259 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:01.853259 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:01.854311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:01.854311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:01.854311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:01.854311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:01.854311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:01.854311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:01.854311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:01.854311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:01.854311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:01.854311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:01.854311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:01.854311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:01.854311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:01.854311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:01.854311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:01.854311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:01.854311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:01.855176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:01.855176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:01.855176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:01.855176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 328/649] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:01.855529 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd123a40-da36-41ec-9b0d-686cce8ea210 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:01.859758 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:01.876254 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c286ec-f2de-44d8-b62c-3ea28cd8897a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:01.877951 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c286ec-f2de-44d8-b62c-3ea28cd8897a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:01.883355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:01.955385 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd123a40-da36-41ec-9b0d-686cce8ea210 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:01.975817 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 322/650] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:52:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:52:01.976644 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c286ec-f2de-44d8-b62c-3ea28cd8897a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:01.991848 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af444f5-acac-4c59-8d67-839553cca5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:01.992475 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af444f5-acac-4c59-8d67-839553cca5f3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:01.992758 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af444f5-acac-4c59-8d67-839553cca5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:01.993030 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af444f5-acac-4c59-8d67-839553cca5f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:02.002396 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af444f5-acac-4c59-8d67-839553cca5f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:02.003894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af444f5-acac-4c59-8d67-839553cca5f3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:02.016066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-5af444f5-acac-4c59-8d67-839553cca5f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:02.016066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:02.016066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:02.016066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:02.016066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:02.016066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:02.016066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:02.016066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:02.016066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:02.016066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:02.016066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:02.016066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:02.016066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:52:02.016066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:52:02.016066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:52:02.016930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:52:02.016930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:02.016930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:02.016930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:02.016930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:02.016930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:02.016930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:02.016930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:02.016930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:02.016930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:02.016930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:02.016930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:02.016930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:02.016930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:02.016930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:02.016930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:02.016930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:02.018205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:52:02.018205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:52:02.018205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:52:02.018205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:52:02.018205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:52:02.018205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:52:02.018205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:02.018205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:02.018205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 329/651] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:52:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:02.018834 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8abf5-d117-4943-9e7e-b5f5cf64bb79 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:02.018834 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8abf5-d117-4943-9e7e-b5f5cf64bb79 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:02.018834 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8abf5-d117-4943-9e7e-b5f5cf64bb79 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:02.020114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 330/652] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:02.020677 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8abf5-d117-4943-9e7e-b5f5cf64bb79 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:02.062612 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:02.078758 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c286ec-f2de-44d8-b62c-3ea28cd8897a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:02.103575 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:02.112064 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf60342-0160-470e-8590-005e727a4e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:02.112662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf60342-0160-470e-8590-005e727a4e0b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:02.112940 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf60342-0160-470e-8590-005e727a4e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:02.113209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf60342-0160-470e-8590-005e727a4e0b None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:02.113866 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf60342-0160-470e-8590-005e727a4e0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:02.114169 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf60342-0160-470e-8590-005e727a4e0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:02.115530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf60342-0160-470e-8590-005e727a4e0b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:02.118730 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8abf5-d117-4943-9e7e-b5f5cf64bb79 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:02.131295 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 323/653] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:02.131295 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf60342-0160-470e-8590-005e727a4e0b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:02.152068 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b530ad-147d-4e7c-89cd-b17e15a57a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:02.152600 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b530ad-147d-4e7c-89cd-b17e15a57a8d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:02.152874 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b530ad-147d-4e7c-89cd-b17e15a57a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:02.153147 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b530ad-147d-4e7c-89cd-b17e15a57a8d None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:02.153770 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b530ad-147d-4e7c-89cd-b17e15a57a8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:02.154096 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b530ad-147d-4e7c-89cd-b17e15a57a8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:02.156254 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b530ad-147d-4e7c-89cd-b17e15a57a8d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:02.167017 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 331/654] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:02.167783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b530ad-147d-4e7c-89cd-b17e15a57a8d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:02.230824 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf60342-0160-470e-8590-005e727a4e0b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:02.264077 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77b3f7-1058-46ab-a04c-6a01172cfa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:02.264714 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77b3f7-1058-46ab-a04c-6a01172cfa4e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:02.265027 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77b3f7-1058-46ab-a04c-6a01172cfa4e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:02.265323 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77b3f7-1058-46ab-a04c-6a01172cfa4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:02.266445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b530ad-147d-4e7c-89cd-b17e15a57a8d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:02.275572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77b3f7-1058-46ab-a04c-6a01172cfa4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:02.277035 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77b3f7-1058-46ab-a04c-6a01172cfa4e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:02.279480 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:02.292588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-fb77b3f7-1058-46ab-a04c-6a01172cfa4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:02.292588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:02.292588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:02.292588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:02.292588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:02.292588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:02.292588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:02.292588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:02.292588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:02.292588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:02.292588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:02.292588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:02.292588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:02.292588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:02.292588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:02.292588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:02.293557 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:02.293557 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:02.293557 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:02.293557 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:02.293557 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:02.293557 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:02.293557 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:02.293557 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:02.293557 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:02.293557 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:02.293557 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:02.293557 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:02.293557 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:02.293557 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:02.293557 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:02.293557 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:02.293557 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:02.295149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:02.295149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:02.295149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:02.295149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 324/655] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:02.295149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a69bc1-314a-4dbe-b757-8062cf55a45e None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:02.295149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a69bc1-314a-4dbe-b757-8062cf55a45e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:02.295519 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a69bc1-314a-4dbe-b757-8062cf55a45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:02.303030 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d21ef9-56ff-427c-90ab-587c5f1424f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:02.303629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d21ef9-56ff-427c-90ab-587c5f1424f9 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:02.303907 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d21ef9-56ff-427c-90ab-587c5f1424f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:02.304175 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d21ef9-56ff-427c-90ab-587c5f1424f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:02.304853 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d21ef9-56ff-427c-90ab-587c5f1424f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:02.305153 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d21ef9-56ff-427c-90ab-587c5f1424f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:02.306580 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d21ef9-56ff-427c-90ab-587c5f1424f9 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:02.313400 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-b6a69bc1-314a-4dbe-b757-8062cf55a45e None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:02.314605 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b6a69bc1-314a-4dbe-b757-8062cf55a45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:02.319153 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 332/656] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:52:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:02.319792 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d21ef9-56ff-427c-90ab-587c5f1424f9 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:02.327785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:02.381435 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 325/657] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:52:02.382301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a69bc1-314a-4dbe-b757-8062cf55a45e None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:02.418143 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d21ef9-56ff-427c-90ab-587c5f1424f9 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:02.454690 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5044b45-576b-4405-9a41-ce3777ccea36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:02.455311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5044b45-576b-4405-9a41-ce3777ccea36 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:02.455592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5044b45-576b-4405-9a41-ce3777ccea36 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:02.455862 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5044b45-576b-4405-9a41-ce3777ccea36 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:02.463581 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5044b45-576b-4405-9a41-ce3777ccea36 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:02.464994 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5044b45-576b-4405-9a41-ce3777ccea36 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:02.476752 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-b5044b45-576b-4405-9a41-ce3777ccea36 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 00:52:02.476752 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:02.476752 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:02.476752 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:02.476752 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:02.476752 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:02.476752 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:02.476752 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:02.476752 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:02.476752 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:02.476752 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:02.476752 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:02.476752 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:52:02.476752 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:52:02.476752 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:52:02.476752 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:52:02.477910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:02.477910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:02.477910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:52:02.477910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:02.477910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:52:02.477910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:02.477910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:02.477910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:02.477910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:02.477910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:02.477910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:02.477910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:02.477910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:02.477910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:02.477910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:02.477910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:02.477910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:02.477910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:02.479139 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:02.479139 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:02.479139 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:52:02.479139 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:52:02.479139 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:52:02.479139 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:52:02.479139 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:52:02.479139 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:52:02.479139 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 00:52:02.479139 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:02.482436 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 333/658] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:52:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:02.483147 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5044b45-576b-4405-9a41-ce3777ccea36 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:02.489666 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a69bc1-314a-4dbe-b757-8062cf55a45e None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:02.516685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:02.525744 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e02792-715f-483f-99ca-bca4d680961b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:02.526429 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e02792-715f-483f-99ca-bca4d680961b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:02.526691 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e02792-715f-483f-99ca-bca4d680961b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:02.526956 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e02792-715f-483f-99ca-bca4d680961b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:02.536745 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e02792-715f-483f-99ca-bca4d680961b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:02.538618 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e02792-715f-483f-99ca-bca4d680961b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:02.550404 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-b8e02792-715f-483f-99ca-bca4d680961b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 00:52:02.550404 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:02.550404 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:02.550404 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:02.550404 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:02.550404 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:02.550404 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:02.550404 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:02.550404 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:02.550404 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:02.550404 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:02.550404 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:02.550404 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:52:02.550404 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:52:02.550404 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:52:02.550404 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:52:02.551310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:02.551310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:02.551310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:52:02.551310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:02.551310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:52:02.551310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:02.551310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:02.551310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:02.551310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:02.551310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:02.551310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:02.551310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:02.551310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:02.551310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:02.551310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:02.551310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:02.551310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:02.551310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:02.552799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:02.552799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:02.552799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:52:02.552799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:52:02.552799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:52:02.552799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:52:02.552799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:52:02.552799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:52:02.552799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 00:52:02.552799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:02.553354 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:02.553427 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 326/659] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 14 00:52:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:02.553427 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e02792-715f-483f-99ca-bca4d680961b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:02.591479 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5044b45-576b-4405-9a41-ce3777ccea36 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:02.626884 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14229d1-4c0a-4f6c-af59-d019573210db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:02.627478 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14229d1-4c0a-4f6c-af59-d019573210db None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:02.627755 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14229d1-4c0a-4f6c-af59-d019573210db None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:02.628020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14229d1-4c0a-4f6c-af59-d019573210db None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:02.628644 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14229d1-4c0a-4f6c-af59-d019573210db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:02.628938 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14229d1-4c0a-4f6c-af59-d019573210db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:02.630323 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14229d1-4c0a-4f6c-af59-d019573210db None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:02.647968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 334/660] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:02.647968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14229d1-4c0a-4f6c-af59-d019573210db None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:02.660091 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e02792-715f-483f-99ca-bca4d680961b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:02.692979 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0734f3-f365-4199-9755-e8022c051350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:02.693503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0734f3-f365-4199-9755-e8022c051350 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:02.693813 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0734f3-f365-4199-9755-e8022c051350 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:02.694101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0734f3-f365-4199-9755-e8022c051350 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:02.694805 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0734f3-f365-4199-9755-e8022c051350 None admin] RBAC: Adding query filter params (role.id=b9c910c1c68948858203c62521b73efc, scope.project.id=f37c835c05924364bcd1530d44f024fe, user.id=c05caac9e8b9498583780306887734be) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:02.695102 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0734f3-f365-4199-9755-e8022c051350 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:02.696512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0734f3-f365-4199-9755-e8022c051350 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:02.702569 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 327/661] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:52:02 2022] GET /identity/v3/role_assignments?user.id=c05caac9e8b9498583780306887734be&scope.project.id=f37c835c05924364bcd1530d44f024fe&role.id=b9c910c1c68948858203c62521b73efc => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:02.703443 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0734f3-f365-4199-9755-e8022c051350 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:02.758075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:02.765073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14229d1-4c0a-4f6c-af59-d019573210db None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:02.794820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:02.804572 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d17666-4585-472c-96a5-50eb4a372a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:02.805195 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d17666-4585-472c-96a5-50eb4a372a4d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:02.805473 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d17666-4585-472c-96a5-50eb4a372a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:02.805741 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d17666-4585-472c-96a5-50eb4a372a4d None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:02.806679 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d17666-4585-472c-96a5-50eb4a372a4d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:02.806980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d17666-4585-472c-96a5-50eb4a372a4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:02.808421 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d17666-4585-472c-96a5-50eb4a372a4d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:02.819633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0734f3-f365-4199-9755-e8022c051350 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:02.828328 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 335/662] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Sep 14 00:52:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:02.829104 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d17666-4585-472c-96a5-50eb4a372a4d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:02.862012 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89584fc7-ec27-4e5b-9428-a3206ca0ad17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:02.862941 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89584fc7-ec27-4e5b-9428-a3206ca0ad17 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:02.863405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89584fc7-ec27-4e5b-9428-a3206ca0ad17 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:02.863670 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89584fc7-ec27-4e5b-9428-a3206ca0ad17 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:02.864398 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89584fc7-ec27-4e5b-9428-a3206ca0ad17 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:02.864701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89584fc7-ec27-4e5b-9428-a3206ca0ad17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:02.866143 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89584fc7-ec27-4e5b-9428-a3206ca0ad17 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:02.884637 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 328/663] 10.222.0.20 () {56 vars in 1139 bytes} [Wed Sep 14 00:52:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:02.886581 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89584fc7-ec27-4e5b-9428-a3206ca0ad17 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:02.950276 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d17666-4585-472c-96a5-50eb4a372a4d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:02.988297 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abc088-1a4a-4f12-9072-1c4ab4dd8ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:02.988926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abc088-1a4a-4f12-9072-1c4ab4dd8ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:02.989220 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abc088-1a4a-4f12-9072-1c4ab4dd8ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:02.989462 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abc088-1a4a-4f12-9072-1c4ab4dd8ec0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:02.998571 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abc088-1a4a-4f12-9072-1c4ab4dd8ec0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:02.999318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89584fc7-ec27-4e5b-9428-a3206ca0ad17 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:02.999974 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abc088-1a4a-4f12-9072-1c4ab4dd8ec0 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:03.010958 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:03.020289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-a5abc088-1a4a-4f12-9072-1c4ab4dd8ec0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:03.020289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:03.020289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:03.020289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:03.020289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:03.020289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:03.020289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:03.020289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:03.020289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:03.020289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:03.020289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:03.020289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:03.020289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:52:03.020289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:52:03.020289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:52:03.021312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:52:03.021312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:03.021312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:03.021312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:03.021312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:03.021312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:03.021312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:03.021312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:03.021312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:03.021312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:03.021312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:03.021312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:03.021312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:03.021312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:03.021312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:03.021312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:03.021312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:03.022230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:52:03.022230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:52:03.022230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:52:03.022230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:52:03.022230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:52:03.022230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:52:03.022230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:03.022230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:03.022230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 336/664] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:52:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:03.023436 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abc088-1a4a-4f12-9072-1c4ab4dd8ec0 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:03.042001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c39450-f52f-487a-9b09-cdeac4ec9c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:03.042720 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c39450-f52f-487a-9b09-cdeac4ec9c5b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:03.043008 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c39450-f52f-487a-9b09-cdeac4ec9c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:03.043280 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c39450-f52f-487a-9b09-cdeac4ec9c5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:03.056565 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c39450-f52f-487a-9b09-cdeac4ec9c5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:52:03.061609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-75c39450-f52f-487a-9b09-cdeac4ec9c5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:52:03.061609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:03.061609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:03.061609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:03.061609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:03.061609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:03.061609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:03.061609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:03.061609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:03.061609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:03.061609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:03.061609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:03.061609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:52:03.061609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:52:03.061609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:52:03.061609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:52:03.062633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:52:03.062633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:52:03.062633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:52:03.062633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:52:03.062633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:03.062633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:03.062633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:03.062633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:03.062633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:03.062633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:03.062633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:03.062633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:03.062633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:03.062633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:03.062633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:03.062633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:03.063486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:03.063486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:03.063486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:03.063486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:03.063486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:52:03.063486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:52:03.063486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:52:03.063486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:52:03.063486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:52:03.063486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:52:03.063486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:52:03.063486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:03.063486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 329/665] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 14 00:52:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:03.064163 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c39450-f52f-487a-9b09-cdeac4ec9c5b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:03.084943 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:03.148069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abc088-1a4a-4f12-9072-1c4ab4dd8ec0 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:03.174444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c39450-f52f-487a-9b09-cdeac4ec9c5b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:03.184651 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1231c18-2ab4-48f9-acf6-33359957f280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:03.185466 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1231c18-2ab4-48f9-acf6-33359957f280 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:03.185681 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1231c18-2ab4-48f9-acf6-33359957f280 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:03.185987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1231c18-2ab4-48f9-acf6-33359957f280 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:03.210879 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31505162-e76f-461b-8281-58f85202a759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:03.211455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31505162-e76f-461b-8281-58f85202a759 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:03.211784 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31505162-e76f-461b-8281-58f85202a759 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:03.212054 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31505162-e76f-461b-8281-58f85202a759 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:03.249582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:03.258949 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1231c18-2ab4-48f9-acf6-33359957f280 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:03.260532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1231c18-2ab4-48f9-acf6-33359957f280 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:03.286585 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31505162-e76f-461b-8281-58f85202a759 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:03.288029 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31505162-e76f-461b-8281-58f85202a759 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:03.309948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:03.373949 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 337/666] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:52:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:52:03.373949 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1231c18-2ab4-48f9-acf6-33359957f280 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:03.396836 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 330/667] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:52:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:52:03.396836 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31505162-e76f-461b-8281-58f85202a759 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:03.461028 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:03.484221 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1231c18-2ab4-48f9-acf6-33359957f280 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:03.497034 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31505162-e76f-461b-8281-58f85202a759 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:03.524652 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906df0f0-4d40-43d3-a06b-c3ba2e14ab20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:03.525332 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906df0f0-4d40-43d3-a06b-c3ba2e14ab20 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:03.525671 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906df0f0-4d40-43d3-a06b-c3ba2e14ab20 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:03.526025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906df0f0-4d40-43d3-a06b-c3ba2e14ab20 None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:03.526831 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906df0f0-4d40-43d3-a06b-c3ba2e14ab20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:03.527289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906df0f0-4d40-43d3-a06b-c3ba2e14ab20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:03.528759 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906df0f0-4d40-43d3-a06b-c3ba2e14ab20 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:03.532424 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e005a-88b7-4658-a29f-a7a441688645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:03.533090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e005a-88b7-4658-a29f-a7a441688645 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:03.533434 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e005a-88b7-4658-a29f-a7a441688645 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:03.533767 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e005a-88b7-4658-a29f-a7a441688645 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:03.534511 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e005a-88b7-4658-a29f-a7a441688645 None admin] RBAC: Adding query filter params (name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:03.534879 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e005a-88b7-4658-a29f-a7a441688645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:03.536739 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e005a-88b7-4658-a29f-a7a441688645 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:03.546354 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 338/668] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:52:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:03.546354 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906df0f0-4d40-43d3-a06b-c3ba2e14ab20 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:03.549700 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:03.554471 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 331/669] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 14 00:52:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:03.554471 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e005a-88b7-4658-a29f-a7a441688645 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:03.653748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e005a-88b7-4658-a29f-a7a441688645 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:03.654111 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906df0f0-4d40-43d3-a06b-c3ba2e14ab20 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:03.685487 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:03.692071 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14db9a-4fda-40de-9c3c-2678b8e4cc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:03.692770 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14db9a-4fda-40de-9c3c-2678b8e4cc15 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:03.693032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e188270-e0d7-4c62-b9c1-29f955e89400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:03.693148 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14db9a-4fda-40de-9c3c-2678b8e4cc15 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:03.693495 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14db9a-4fda-40de-9c3c-2678b8e4cc15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:03.694282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e188270-e0d7-4c62-b9c1-29f955e89400 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:03.694657 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e188270-e0d7-4c62-b9c1-29f955e89400 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:03.695211 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e188270-e0d7-4c62-b9c1-29f955e89400 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:03.704835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14db9a-4fda-40de-9c3c-2678b8e4cc15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:03.706400 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14db9a-4fda-40de-9c3c-2678b8e4cc15 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:03.708158 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e188270-e0d7-4c62-b9c1-29f955e89400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:03.710233 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e188270-e0d7-4c62-b9c1-29f955e89400 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:03.722308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-7c14db9a-4fda-40de-9c3c-2678b8e4cc15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:03.722308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:03.722308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:03.722308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:03.722308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:03.722308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:03.722308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:03.722308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:03.722308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:03.722308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:03.722308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:03.722308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:03.722308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:03.722308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:03.722308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:03.722308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:03.723377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:03.723377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:03.723377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:03.723377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:03.723377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:03.723377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:03.723377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:03.723377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:03.723377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:03.723377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:03.723377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:03.723377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:03.723377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:03.723377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:03.723377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:03.723377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:03.723377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:03.724490 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:03.724490 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:03.724490 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:03.731084 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 339/670] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:03.731084 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14db9a-4fda-40de-9c3c-2678b8e4cc15 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:03.731298 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-2e188270-e0d7-4c62-b9c1-29f955e89400 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:03.731298 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:03.731298 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:03.731298 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:03.731298 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:03.731298 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:03.731298 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:03.731298 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:03.731298 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:03.731298 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:03.731298 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:03.731298 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:03.731298 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:03.731298 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:03.731298 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:03.731298 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:03.732308 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:03.732308 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:03.732308 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:03.732308 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:03.732308 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:03.732308 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:03.732308 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:03.732308 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:03.732308 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:03.732308 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:03.732308 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:03.732308 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:03.732308 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:03.732308 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:03.732308 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:03.732308 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:03.732308 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:03.733987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:03.733987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:03.733987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:03.733987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 332/671] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:03.733987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e188270-e0d7-4c62-b9c1-29f955e89400 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:03.791733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:03.835837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e188270-e0d7-4c62-b9c1-29f955e89400 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:03.841460 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14db9a-4fda-40de-9c3c-2678b8e4cc15 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:03.869532 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3408423c-4e88-4407-a4f2-fd3180f11653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:03.870171 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408423c-4e88-4407-a4f2-fd3180f11653 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:03.870445 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408423c-4e88-4407-a4f2-fd3180f11653 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:03.870716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408423c-4e88-4407-a4f2-fd3180f11653 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:03.880461 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b844c-e44c-41be-87c0-a16d89c2eb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:03.881503 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b844c-e44c-41be-87c0-a16d89c2eb2c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:03.881628 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3408423c-4e88-4407-a4f2-fd3180f11653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:03.882121 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b844c-e44c-41be-87c0-a16d89c2eb2c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:03.882586 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b844c-e44c-41be-87c0-a16d89c2eb2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:03.883202 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3408423c-4e88-4407-a4f2-fd3180f11653 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:03.883835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b844c-e44c-41be-87c0-a16d89c2eb2c None admin] RBAC: Adding query filter params (role.id=b9c910c1c68948858203c62521b73efc, scope.project.id=f37c835c05924364bcd1530d44f024fe, user.id=ee54ed3a092e4eef9082c4e86bd918a2) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:03.884333 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b844c-e44c-41be-87c0-a16d89c2eb2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:03.885932 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b844c-e44c-41be-87c0-a16d89c2eb2c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:03.892594 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 340/672] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:52:03 2022] GET /identity/v3/role_assignments?user.id=ee54ed3a092e4eef9082c4e86bd918a2&scope.project.id=f37c835c05924364bcd1530d44f024fe&role.id=b9c910c1c68948858203c62521b73efc => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:03.893584 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b844c-e44c-41be-87c0-a16d89c2eb2c None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:03.908222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-3408423c-4e88-4407-a4f2-fd3180f11653 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:03.908222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:03.908222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:03.908222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:03.908222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:03.908222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:03.908222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:03.908222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:03.908222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:03.908222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:03.908222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:03.908222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:03.908222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:03.908222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:03.908222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:03.908222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:03.909250 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:03.909250 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:03.909250 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:03.909250 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:03.909250 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:03.909250 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:03.909250 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:03.909250 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:03.909250 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:03.909250 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:03.909250 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:03.909250 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:03.909250 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:03.909250 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:03.909250 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:03.909250 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:03.909250 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:03.910213 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:03.910213 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:03.910213 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:03.911666 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 333/673] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:03.912592 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3408423c-4e88-4407-a4f2-fd3180f11653 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:03.951972 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:04.048599 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3408423c-4e88-4407-a4f2-fd3180f11653 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:04.053286 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b844c-e44c-41be-87c0-a16d89c2eb2c None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:04.082015 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:04.087094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63a571-ebeb-4404-9002-9493677b21ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:04.087800 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63a571-ebeb-4404-9002-9493677b21ac None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:04.088114 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63a571-ebeb-4404-9002-9493677b21ac None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:04.088445 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63a571-ebeb-4404-9002-9493677b21ac None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:04.089158 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63a571-ebeb-4404-9002-9493677b21ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:04.089523 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63a571-ebeb-4404-9002-9493677b21ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:04.091120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63a571-ebeb-4404-9002-9493677b21ac None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:04.113321 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab027bf-bb3f-45d3-a452-e8476e82a974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:04.113321 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab027bf-bb3f-45d3-a452-e8476e82a974 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:04.113321 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab027bf-bb3f-45d3-a452-e8476e82a974 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:04.113321 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab027bf-bb3f-45d3-a452-e8476e82a974 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:04.113746 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab027bf-bb3f-45d3-a452-e8476e82a974 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:04.113746 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab027bf-bb3f-45d3-a452-e8476e82a974 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:04.113746 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab027bf-bb3f-45d3-a452-e8476e82a974 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:04.114239 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 334/674] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:04.114239 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63a571-ebeb-4404-9002-9493677b21ac None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:04.130998 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 341/675] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:04.131853 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab027bf-bb3f-45d3-a452-e8476e82a974 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:04.231812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:04.241187 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63a571-ebeb-4404-9002-9493677b21ac None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:04.258180 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab027bf-bb3f-45d3-a452-e8476e82a974 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:04.282784 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6dad0-e8c6-4c33-934e-e403c00457ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:04.283433 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6dad0-e8c6-4c33-934e-e403c00457ad None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:04.283710 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6dad0-e8c6-4c33-934e-e403c00457ad None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:04.284032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6dad0-e8c6-4c33-934e-e403c00457ad None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:04.284976 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6dad0-e8c6-4c33-934e-e403c00457ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:04.285100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6dad0-e8c6-4c33-934e-e403c00457ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:04.286594 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6dad0-e8c6-4c33-934e-e403c00457ad None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:04.301916 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 335/676] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:04.301916 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6dad0-e8c6-4c33-934e-e403c00457ad None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:04.304508 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795bbc5-a865-4fd4-8e7a-bf0c7a9829e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:04.309908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795bbc5-a865-4fd4-8e7a-bf0c7a9829e2 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:04.309908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795bbc5-a865-4fd4-8e7a-bf0c7a9829e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:04.309908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795bbc5-a865-4fd4-8e7a-bf0c7a9829e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:04.322799 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795bbc5-a865-4fd4-8e7a-bf0c7a9829e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:04.325273 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795bbc5-a865-4fd4-8e7a-bf0c7a9829e2 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:04.341369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-1795bbc5-a865-4fd4-8e7a-bf0c7a9829e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:04.341369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:04.341369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:04.341369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:04.341369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:04.341369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:04.341369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:04.341369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:04.341369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:04.341369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:04.341369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:04.341369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:04.341369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:52:04.341369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:52:04.341369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:52:04.342850 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:52:04.342850 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:04.342850 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:04.342850 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:04.342850 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:04.342850 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:04.342850 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:04.342850 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:04.342850 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:04.342850 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:04.342850 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:04.342850 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:04.342850 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:04.342850 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:04.342850 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:04.342850 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:04.342850 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:04.343757 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:52:04.343757 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:52:04.343757 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:52:04.343757 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:52:04.343757 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:52:04.343757 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:52:04.343757 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:04.343757 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:04.350884 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 342/677] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:52:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:04.350884 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795bbc5-a865-4fd4-8e7a-bf0c7a9829e2 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:04.400810 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:04.427357 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6dad0-e8c6-4c33-934e-e403c00457ad None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:04.464085 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adaf74a-2d93-4d96-9662-402a8bc5ff9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:04.464711 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adaf74a-2d93-4d96-9662-402a8bc5ff9f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:04.465011 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adaf74a-2d93-4d96-9662-402a8bc5ff9f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:04.465252 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adaf74a-2d93-4d96-9662-402a8bc5ff9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:04.471192 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795bbc5-a865-4fd4-8e7a-bf0c7a9829e2 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:04.473101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adaf74a-2d93-4d96-9662-402a8bc5ff9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:04.474679 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adaf74a-2d93-4d96-9662-402a8bc5ff9f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:04.487444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-4adaf74a-2d93-4d96-9662-402a8bc5ff9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:04.487444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:04.487444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:04.487444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:04.487444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:04.487444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:04.487444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:04.487444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:04.487444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:04.487444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:04.487444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:04.487444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:04.487444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:52:04.487444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:52:04.487444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:52:04.488374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:52:04.488374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:04.488374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:04.488374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:04.488374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:04.488374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:04.488374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:04.488374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:04.488374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:04.488374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:04.488374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:04.488374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:04.488374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:04.488374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:04.488374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:04.488374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:04.488374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:04.489841 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:52:04.489841 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:52:04.489841 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:52:04.489841 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:52:04.489841 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:52:04.489841 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:52:04.489841 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:04.489841 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:04.489841 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 336/678] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:52:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:04.489841 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adaf74a-2d93-4d96-9662-402a8bc5ff9f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:04.508002 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:04.516412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e7001-5126-4668-8c97-923252f18345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:04.517385 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e7001-5126-4668-8c97-923252f18345 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:04.517911 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e7001-5126-4668-8c97-923252f18345 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:04.518377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e7001-5126-4668-8c97-923252f18345 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:04.528047 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e7001-5126-4668-8c97-923252f18345 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:04.530561 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e7001-5126-4668-8c97-923252f18345 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:04.542658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-e20e7001-5126-4668-8c97-923252f18345 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 00:52:04.542658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:04.542658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:04.542658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:04.542658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:04.542658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:04.542658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:04.542658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:04.542658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:04.542658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:04.542658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:04.542658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:04.542658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:52:04.542658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:52:04.542658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:52:04.542658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:52:04.543619 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:04.543619 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:04.543619 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:52:04.543619 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:04.543619 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:52:04.543619 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:04.543619 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:04.543619 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:04.543619 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:04.543619 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:04.543619 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:04.543619 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:04.543619 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:04.543619 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:04.543619 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:04.543619 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:04.543619 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:04.543619 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:04.544555 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:04.544555 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:04.544555 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:52:04.544555 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:52:04.544555 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:52:04.544555 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:52:04.544555 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:52:04.544555 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:52:04.544555 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 00:52:04.544555 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:04.544555 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 343/679] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:52:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:04.544555 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e7001-5126-4668-8c97-923252f18345 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:04.609194 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adaf74a-2d93-4d96-9662-402a8bc5ff9f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:04.658698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecc009-ce43-4e34-a2a3-11bd6d69d608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:04.660157 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecc009-ce43-4e34-a2a3-11bd6d69d608 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:04.660954 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecc009-ce43-4e34-a2a3-11bd6d69d608 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:04.661457 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecc009-ce43-4e34-a2a3-11bd6d69d608 None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:04.662382 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ecc009-ce43-4e34-a2a3-11bd6d69d608 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:04.663019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ecc009-ce43-4e34-a2a3-11bd6d69d608 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:04.664822 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ecc009-ce43-4e34-a2a3-11bd6d69d608 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:04.666622 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:04.669871 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e7001-5126-4668-8c97-923252f18345 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:04.684960 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 337/680] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:52:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:04.687213 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecc009-ce43-4e34-a2a3-11bd6d69d608 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:04.722131 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d824004-1deb-4316-9c35-f78378918d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:04.723261 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d824004-1deb-4316-9c35-f78378918d1e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:04.723808 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d824004-1deb-4316-9c35-f78378918d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:04.724594 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d824004-1deb-4316-9c35-f78378918d1e None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:04.725783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d824004-1deb-4316-9c35-f78378918d1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:04.726510 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d824004-1deb-4316-9c35-f78378918d1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:04.728710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d824004-1deb-4316-9c35-f78378918d1e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:04.744670 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 344/681] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:52:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:04.746219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d824004-1deb-4316-9c35-f78378918d1e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:04.779148 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:04.809558 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecc009-ce43-4e34-a2a3-11bd6d69d608 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:04.847642 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b26ea6-fde5-4762-8178-00e73d77a884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:04.848325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b26ea6-fde5-4762-8178-00e73d77a884 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:04.848601 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b26ea6-fde5-4762-8178-00e73d77a884 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:04.848872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b26ea6-fde5-4762-8178-00e73d77a884 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:04.849672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b26ea6-fde5-4762-8178-00e73d77a884 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:04.850012 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b26ea6-fde5-4762-8178-00e73d77a884 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:04.852019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b26ea6-fde5-4762-8178-00e73d77a884 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:04.866594 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d824004-1deb-4316-9c35-f78378918d1e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:04.874469 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 338/682] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Sep 14 00:52:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:04.875438 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b26ea6-fde5-4762-8178-00e73d77a884 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:04.906240 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30369b3-b881-4d05-a5e6-9644469f9179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:04.907308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30369b3-b881-4d05-a5e6-9644469f9179 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:04.907832 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30369b3-b881-4d05-a5e6-9644469f9179 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:04.908312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30369b3-b881-4d05-a5e6-9644469f9179 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:04.909232 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30369b3-b881-4d05-a5e6-9644469f9179 None admin] RBAC: Adding query filter params (role.id=b9c910c1c68948858203c62521b73efc, scope.project.id=f37c835c05924364bcd1530d44f024fe, user.id=b4444b17075f4224a4da1ef501fd4eb5) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:04.909873 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30369b3-b881-4d05-a5e6-9644469f9179 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:04.911574 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30369b3-b881-4d05-a5e6-9644469f9179 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:04.925427 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 345/683] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:52:04 2022] GET /identity/v3/role_assignments?user.id=b4444b17075f4224a4da1ef501fd4eb5&scope.project.id=f37c835c05924364bcd1530d44f024fe&role.id=b9c910c1c68948858203c62521b73efc => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:04.926867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30369b3-b881-4d05-a5e6-9644469f9179 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:04.964996 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:05.001223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b26ea6-fde5-4762-8178-00e73d77a884 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:05.039604 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:05.046425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd5bb8-c4bc-4672-ade3-71ed229f092b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:05.047439 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd5bb8-c4bc-4672-ade3-71ed229f092b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:05.047439 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd5bb8-c4bc-4672-ade3-71ed229f092b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:05.047698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd5bb8-c4bc-4672-ade3-71ed229f092b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:05.048399 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd5bb8-c4bc-4672-ade3-71ed229f092b None admin] RBAC: Adding query filter params (role.id=b9c910c1c68948858203c62521b73efc, scope.project.id=f37c835c05924364bcd1530d44f024fe, user.id=50394b1ba51b45a6bf833b63ff7e423b) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:05.048705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd5bb8-c4bc-4672-ade3-71ed229f092b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:05.050192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd5bb8-c4bc-4672-ade3-71ed229f092b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:05.057338 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 339/684] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:52:04 2022] GET /identity/v3/role_assignments?user.id=50394b1ba51b45a6bf833b63ff7e423b&scope.project.id=f37c835c05924364bcd1530d44f024fe&role.id=b9c910c1c68948858203c62521b73efc => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:05.058719 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee83a03-3e50-44a6-bd1c-5f377580dfec None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:05.058999 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee83a03-3e50-44a6-bd1c-5f377580dfec None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:05.059270 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee83a03-3e50-44a6-bd1c-5f377580dfec None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:05.061008 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 340/685] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:05.069095 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3b79a-ceec-4d92-9ef8-20c4682450ab None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:05.069374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3b79a-ceec-4d92-9ef8-20c4682450ab None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:05.069723 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3b79a-ceec-4d92-9ef8-20c4682450ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:05.071705 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30369b3-b881-4d05-a5e6-9644469f9179 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:05.112424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52fa28-bb18-468b-a3cb-4090d412b9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:05.113481 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52fa28-bb18-468b-a3cb-4090d412b9c1 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:05.114002 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52fa28-bb18-468b-a3cb-4090d412b9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:05.114491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52fa28-bb18-468b-a3cb-4090d412b9c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:05.123035 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-fbb3b79a-ceec-4d92-9ef8-20c4682450ab None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:05.124327 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fbb3b79a-ceec-4d92-9ef8-20c4682450ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:05.193579 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52fa28-bb18-468b-a3cb-4090d412b9c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:05.195754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52fa28-bb18-468b-a3cb-4090d412b9c1 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:05.232708 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:05.266418 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 341/686] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 00:52:05.327883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 346/687] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:52:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:52:05.334988 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3b79a-ceec-4d92-9ef8-20c4682450ab None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:05.443861 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3b79a-ceec-4d92-9ef8-20c4682450ab None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:05.470485 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:05.480214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8cf3f-515d-4fc9-88f4-5d96097a3e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:05.481149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8cf3f-515d-4fc9-88f4-5d96097a3e70 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:05.481689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8cf3f-515d-4fc9-88f4-5d96097a3e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:05.482325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8cf3f-515d-4fc9-88f4-5d96097a3e70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:05.493531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8cf3f-515d-4fc9-88f4-5d96097a3e70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:05.495312 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8cf3f-515d-4fc9-88f4-5d96097a3e70 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:05.510828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-1ef8cf3f-515d-4fc9-88f4-5d96097a3e70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:05.510828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:05.510828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:05.510828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:05.510828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:05.510828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:05.510828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:05.510828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:05.510828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:05.510828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:05.510828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:05.510828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:05.510828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:05.510828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:05.510828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:05.510828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:05.511784 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:05.511784 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:05.511784 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:05.511784 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:05.511784 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:05.511784 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:05.511784 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:05.511784 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:05.511784 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:05.511784 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:05.511784 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:05.511784 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:05.511784 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:05.511784 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:05.511784 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:05.511784 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:05.511784 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:05.512699 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:05.512699 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:05.512699 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:05.518552 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 342/688] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:05.521200 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52fa28-bb18-468b-a3cb-4090d412b9c1 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:05.568873 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8cf3f-515d-4fc9-88f4-5d96097a3e70 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:05.672356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52fa28-bb18-468b-a3cb-4090d412b9c1 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:05.705225 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8cf3f-515d-4fc9-88f4-5d96097a3e70 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:05.724469 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:05.743712 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0309d-b47f-4718-be96-c929bed6a03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:05.745259 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0309d-b47f-4718-be96-c929bed6a03a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:05.745769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0309d-b47f-4718-be96-c929bed6a03a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:05.749015 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0309d-b47f-4718-be96-c929bed6a03a None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:05.749885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0309d-b47f-4718-be96-c929bed6a03a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:05.750366 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0309d-b47f-4718-be96-c929bed6a03a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:05.751900 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0309d-b47f-4718-be96-c929bed6a03a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:05.773780 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 347/689] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:05.778185 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10164193-d76a-47df-aaf3-70391a1f9134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:05.779950 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0309d-b47f-4718-be96-c929bed6a03a None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:05.781311 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10164193-d76a-47df-aaf3-70391a1f9134 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:05.783478 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10164193-d76a-47df-aaf3-70391a1f9134 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:05.783927 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10164193-d76a-47df-aaf3-70391a1f9134 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:05.804348 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10164193-d76a-47df-aaf3-70391a1f9134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:52:05.809662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-10164193-d76a-47df-aaf3-70391a1f9134 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:52:05.809662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:05.809662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:05.809662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:05.809662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:05.809662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:05.809662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:05.809662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:05.809662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:05.809662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:05.809662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:05.809662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:05.809662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:52:05.809662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:52:05.809662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:52:05.809662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:52:05.810606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:52:05.810606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:52:05.810606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:52:05.810606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:52:05.810606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:05.810606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:05.810606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:05.810606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:05.810606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:05.810606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:05.810606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:05.810606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:05.810606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:05.810606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:05.810606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:05.810606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:05.812089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:05.812089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:05.812089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:05.812089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:05.812089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:52:05.812089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:52:05.812089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:52:05.812089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:52:05.812089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:52:05.812089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:52:05.812089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:52:05.812089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:05.822975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 343/690] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:52:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:52:05.828775 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10164193-d76a-47df-aaf3-70391a1f9134 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:05.896621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0309d-b47f-4718-be96-c929bed6a03a None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:05.910202 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:05.952048 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe032d-1325-462b-b69c-0cc07df55ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:05.952972 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe032d-1325-462b-b69c-0cc07df55ffb None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:05.953441 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe032d-1325-462b-b69c-0cc07df55ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:05.953713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe032d-1325-462b-b69c-0cc07df55ffb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:05.970949 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe032d-1325-462b-b69c-0cc07df55ffb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:05.972395 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe032d-1325-462b-b69c-0cc07df55ffb None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:05.981470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10164193-d76a-47df-aaf3-70391a1f9134 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:06.007161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-bdbe032d-1325-462b-b69c-0cc07df55ffb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:06.007161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:06.007161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:06.007161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:06.007161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:06.007161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:06.007161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:06.007161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:06.007161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:06.007161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:06.007161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:06.007161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:06.007161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:52:06.007161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:52:06.007161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:52:06.008051 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:52:06.008051 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:06.008051 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:06.008051 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:06.008051 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:06.008051 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:06.008051 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:06.008051 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:06.008051 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:06.008051 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:06.008051 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:06.008051 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:06.008051 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:06.008051 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:06.008051 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:06.008051 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:06.008051 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:06.009050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:52:06.009050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:52:06.009050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:52:06.009050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:52:06.009050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:52:06.009050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:52:06.009050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:06.009050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:06.013939 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 348/691] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:52:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:06.023926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe032d-1325-462b-b69c-0cc07df55ffb None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:06.082684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:06.095106 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a624d9-c281-4c05-9e32-7c1577d7c4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:06.095733 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a624d9-c281-4c05-9e32-7c1577d7c4ae None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:06.096010 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a624d9-c281-4c05-9e32-7c1577d7c4ae None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:06.096275 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a624d9-c281-4c05-9e32-7c1577d7c4ae None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:06.096948 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a624d9-c281-4c05-9e32-7c1577d7c4ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:06.097247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a624d9-c281-4c05-9e32-7c1577d7c4ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:06.098672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a624d9-c281-4c05-9e32-7c1577d7c4ae None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:06.128013 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 344/692] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:52:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:06.138790 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a624d9-c281-4c05-9e32-7c1577d7c4ae None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:06.145633 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe032d-1325-462b-b69c-0cc07df55ffb None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:06.185001 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8f65e-af2a-42fd-b703-6c11895ad68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:06.185986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8f65e-af2a-42fd-b703-6c11895ad68e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:06.186424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8f65e-af2a-42fd-b703-6c11895ad68e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:06.186792 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8f65e-af2a-42fd-b703-6c11895ad68e None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:06.187577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8f65e-af2a-42fd-b703-6c11895ad68e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:06.187976 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8f65e-af2a-42fd-b703-6c11895ad68e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:06.189537 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8f65e-af2a-42fd-b703-6c11895ad68e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:06.204707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 349/693] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:52:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:06.210428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8f65e-af2a-42fd-b703-6c11895ad68e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:06.362488 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:06.367924 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a624d9-c281-4c05-9e32-7c1577d7c4ae None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:06.391673 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8f65e-af2a-42fd-b703-6c11895ad68e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:06.402174 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:06.433772 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5d53a-1762-4ee8-b8c1-9748e0f9c6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:06.434423 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5d53a-1762-4ee8-b8c1-9748e0f9c6d1 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:06.434699 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5d53a-1762-4ee8-b8c1-9748e0f9c6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:06.435116 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5d53a-1762-4ee8-b8c1-9748e0f9c6d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:06.444765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28b423-5865-4591-a3f0-62473fa542ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:06.445636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28b423-5865-4591-a3f0-62473fa542ae None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:06.446635 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28b423-5865-4591-a3f0-62473fa542ae None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:06.447227 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28b423-5865-4591-a3f0-62473fa542ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:06.448140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5d53a-1762-4ee8-b8c1-9748e0f9c6d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:06.448402 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28b423-5865-4591-a3f0-62473fa542ae None admin] RBAC: Adding query filter params (role.id=b9c910c1c68948858203c62521b73efc, scope.project.id=f37c835c05924364bcd1530d44f024fe, user.id=c8d05652bfe542d5a2cfa39fbf7a83c9) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:06.448895 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28b423-5865-4591-a3f0-62473fa542ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:06.449772 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5d53a-1762-4ee8-b8c1-9748e0f9c6d1 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:06.450670 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28b423-5865-4591-a3f0-62473fa542ae None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:06.460114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 350/694] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:52:06 2022] GET /identity/v3/role_assignments?user.id=c8d05652bfe542d5a2cfa39fbf7a83c9&scope.project.id=f37c835c05924364bcd1530d44f024fe&role.id=b9c910c1c68948858203c62521b73efc => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:06.460973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3111f12-0cd4-4779-9107-119855f2ca1a None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:06.461256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3111f12-0cd4-4779-9107-119855f2ca1a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:06.461532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3111f12-0cd4-4779-9107-119855f2ca1a None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:06.463931 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 351/695] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:06.469960 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927a3f1-c5af-4f1e-997c-95fc9374e57f None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:06.470242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927a3f1-c5af-4f1e-997c-95fc9374e57f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:06.470516 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927a3f1-c5af-4f1e-997c-95fc9374e57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:06.475776 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-11d5d53a-1762-4ee8-b8c1-9748e0f9c6d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:06.475776 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:06.475776 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:06.475776 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:06.475776 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:06.475776 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:06.475776 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:06.475776 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:06.475776 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:06.475776 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:06.475776 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:06.475776 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:06.475776 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:06.475776 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:06.475776 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:06.475776 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:06.476929 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:06.476929 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:06.476929 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:06.476929 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:06.476929 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:06.476929 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:06.476929 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:06.476929 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:06.476929 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:06.476929 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:06.476929 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:06.476929 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:06.476929 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:06.476929 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:06.476929 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:06.476929 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:06.476929 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:06.477854 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:06.477854 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:06.477854 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:06.479815 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 345/696] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:06.486162 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5d53a-1762-4ee8-b8c1-9748e0f9c6d1 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:06.515551 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-c927a3f1-c5af-4f1e-997c-95fc9374e57f None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:06.516707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c927a3f1-c5af-4f1e-997c-95fc9374e57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:06.597725 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5d53a-1762-4ee8-b8c1-9748e0f9c6d1 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:06.636546 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ea335-b8eb-4044-9395-f9e8df5ea584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:06.637433 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ea335-b8eb-4044-9395-f9e8df5ea584 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:06.637880 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ea335-b8eb-4044-9395-f9e8df5ea584 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:06.638280 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ea335-b8eb-4044-9395-f9e8df5ea584 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:06.639054 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ea335-b8eb-4044-9395-f9e8df5ea584 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:06.639582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ea335-b8eb-4044-9395-f9e8df5ea584 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:06.641139 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ea335-b8eb-4044-9395-f9e8df5ea584 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:06.657282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 346/697] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:52:06.663753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ea335-b8eb-4044-9395-f9e8df5ea584 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:06.681418 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:06.688768 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 352/698] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:52:06.777136 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ea335-b8eb-4044-9395-f9e8df5ea584 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:06.813862 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32288ab8-51c0-466e-9e25-4fb6cd4d7f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:06.814639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32288ab8-51c0-466e-9e25-4fb6cd4d7f11 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:06.815012 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32288ab8-51c0-466e-9e25-4fb6cd4d7f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:06.815387 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32288ab8-51c0-466e-9e25-4fb6cd4d7f11 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:06.822871 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32288ab8-51c0-466e-9e25-4fb6cd4d7f11 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:06.824417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32288ab8-51c0-466e-9e25-4fb6cd4d7f11 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:06.836518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-32288ab8-51c0-466e-9e25-4fb6cd4d7f11 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 00:52:06.836518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:06.836518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:06.836518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:06.836518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:06.836518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:06.836518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:06.836518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:06.836518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:06.836518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:06.836518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:06.836518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:06.836518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:52:06.836518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:52:06.836518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:52:06.836518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:52:06.837705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:06.837705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:06.837705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:52:06.837705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:06.837705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:52:06.837705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:06.837705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:06.837705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:06.837705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:06.837705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:06.837705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:06.837705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:06.837705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:06.837705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:06.837705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:06.837705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:06.837705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:06.837705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:06.838919 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:06.838919 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:06.838919 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:52:06.838919 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:52:06.838919 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:52:06.838919 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:52:06.838919 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:52:06.838919 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:52:06.838919 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 00:52:06.838919 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:06.840533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 347/699] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Sep 14 00:52:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:52:06.846737 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927a3f1-c5af-4f1e-997c-95fc9374e57f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:06.947303 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927a3f1-c5af-4f1e-997c-95fc9374e57f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:06.948952 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:06.988309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db70a56-9a0f-4dcc-9b46-ed16da8e6911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:06.988922 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db70a56-9a0f-4dcc-9b46-ed16da8e6911 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:06.989192 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db70a56-9a0f-4dcc-9b46-ed16da8e6911 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:06.989456 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db70a56-9a0f-4dcc-9b46-ed16da8e6911 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:06.990209 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db70a56-9a0f-4dcc-9b46-ed16da8e6911 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:06.990508 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db70a56-9a0f-4dcc-9b46-ed16da8e6911 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:06.992975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32288ab8-51c0-466e-9e25-4fb6cd4d7f11 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:06.993270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db70a56-9a0f-4dcc-9b46-ed16da8e6911 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:07.021830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 353/700] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Sep 14 00:52:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:07.026223 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db70a56-9a0f-4dcc-9b46-ed16da8e6911 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:07.103766 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:07.141390 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32288ab8-51c0-466e-9e25-4fb6cd4d7f11 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:07.151701 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db70a56-9a0f-4dcc-9b46-ed16da8e6911 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:07.184256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fca65-b560-4e1d-8514-5cfc659add79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:07.184898 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fca65-b560-4e1d-8514-5cfc659add79 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:07.185181 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fca65-b560-4e1d-8514-5cfc659add79 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:07.185451 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fca65-b560-4e1d-8514-5cfc659add79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:07.192155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed489c2-aee2-4c5c-bb53-20c4397c1531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:07.193026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed489c2-aee2-4c5c-bb53-20c4397c1531 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:07.193749 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed489c2-aee2-4c5c-bb53-20c4397c1531 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:07.194262 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed489c2-aee2-4c5c-bb53-20c4397c1531 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:07.216195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fca65-b560-4e1d-8514-5cfc659add79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:07.217729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fca65-b560-4e1d-8514-5cfc659add79 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:07.226247 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:07.241533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-9a0fca65-b560-4e1d-8514-5cfc659add79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:07.241533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:07.241533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:07.241533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:07.241533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:07.241533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:07.241533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:07.241533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:07.241533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:07.241533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:07.241533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:07.241533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:07.241533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:07.241533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:07.241533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:07.241533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:07.244098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:07.244098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:07.244098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:07.244098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:07.244098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:07.244098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:07.244098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:07.244098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:07.244098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:07.244098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:07.244098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:07.244098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:07.244098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:07.244098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:07.244098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:07.244098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:07.244098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:07.245064 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:07.245064 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:07.245064 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:07.251172 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 348/701] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:52:07.257103 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fca65-b560-4e1d-8514-5cfc659add79 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:07.272339 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed489c2-aee2-4c5c-bb53-20c4397c1531 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:07.274530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed489c2-aee2-4c5c-bb53-20c4397c1531 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:07.385184 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 354/702] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:52:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:52:07.390950 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed489c2-aee2-4c5c-bb53-20c4397c1531 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:07.462219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:07.501063 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed489c2-aee2-4c5c-bb53-20c4397c1531 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:07.531705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fca65-b560-4e1d-8514-5cfc659add79 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:07.543674 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688e060-fcc5-482d-9bc4-2a0cc5412901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:07.544602 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688e060-fcc5-482d-9bc4-2a0cc5412901 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:07.545103 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688e060-fcc5-482d-9bc4-2a0cc5412901 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:07.545658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688e060-fcc5-482d-9bc4-2a0cc5412901 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:07.558575 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688e060-fcc5-482d-9bc4-2a0cc5412901 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:07.560635 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688e060-fcc5-482d-9bc4-2a0cc5412901 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:07.569267 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:07.579681 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef20188-7d01-453a-bb58-5c1e1dbc5d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:07.580282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef20188-7d01-453a-bb58-5c1e1dbc5d63 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:07.580556 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef20188-7d01-453a-bb58-5c1e1dbc5d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:07.580822 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef20188-7d01-453a-bb58-5c1e1dbc5d63 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:07.581138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-6688e060-fcc5-482d-9bc4-2a0cc5412901 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:07.581138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:07.581138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:07.581138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:07.581138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:07.581138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:07.581138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:07.581138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:07.581138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:07.581138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:07.581138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:07.581138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:07.581138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:07.581138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:07.581138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:07.581138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:07.582270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:07.582270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:07.582270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:07.582270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:07.582270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:07.582270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:07.582270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:07.582270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:07.582270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:07.582270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:07.582270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:07.582270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:07.582270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:07.582270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:07.582270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:07.582270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:07.582270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:07.583147 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:07.583147 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:07.583147 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:07.583322 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef20188-7d01-453a-bb58-5c1e1dbc5d63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:07.583322 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef20188-7d01-453a-bb58-5c1e1dbc5d63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:07.583322 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef20188-7d01-453a-bb58-5c1e1dbc5d63 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:07.585388 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 355/703] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:07.591053 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688e060-fcc5-482d-9bc4-2a0cc5412901 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:07.596210 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 349/704] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:52:07.607059 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef20188-7d01-453a-bb58-5c1e1dbc5d63 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:07.722883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688e060-fcc5-482d-9bc4-2a0cc5412901 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:07.744088 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef20188-7d01-453a-bb58-5c1e1dbc5d63 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:07.764945 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:07.771972 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d44b9-294f-4c3c-953c-c759f67988da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:07.772613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d44b9-294f-4c3c-953c-c759f67988da None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:07.772973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d44b9-294f-4c3c-953c-c759f67988da None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:07.773498 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d44b9-294f-4c3c-953c-c759f67988da None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:07.774175 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d44b9-294f-4c3c-953c-c759f67988da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:07.774482 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d44b9-294f-4c3c-953c-c759f67988da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:07.776173 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d44b9-294f-4c3c-953c-c759f67988da None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:07.784420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb35cd6-3940-4cfd-9a57-f99f3cca2767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:07.785303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb35cd6-3940-4cfd-9a57-f99f3cca2767 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:07.785825 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb35cd6-3940-4cfd-9a57-f99f3cca2767 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:07.786467 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb35cd6-3940-4cfd-9a57-f99f3cca2767 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:07.787304 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb35cd6-3940-4cfd-9a57-f99f3cca2767 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:07.788906 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb35cd6-3940-4cfd-9a57-f99f3cca2767 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:07.794832 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 356/705] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:07.794832 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506a8e0-6b53-4eb5-b771-7e3f97d76bd5 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:07.794832 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506a8e0-6b53-4eb5-b771-7e3f97d76bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:07.794832 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506a8e0-6b53-4eb5-b771-7e3f97d76bd5 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:07.794832 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 357/706] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:07.798672 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506a8e0-6b53-4eb5-b771-7e3f97d76bd5 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:07.817161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 350/707] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 14 00:52:07 2022] POST /identity/v3/users => generated 254 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:52:07.818741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d49d09-9b16-4e13-a422-b02a897c7f61 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:07.819023 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d49d09-9b16-4e13-a422-b02a897c7f61 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:07.819292 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d49d09-9b16-4e13-a422-b02a897c7f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:07.839565 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-31d49d09-9b16-4e13-a422-b02a897c7f61 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:07.840581 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-31d49d09-9b16-4e13-a422-b02a897c7f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:07.883387 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:07.923988 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 351/708] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:52:07.925468 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99327d7-31b3-4224-83b3-dd98e722b7a2 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:07.925671 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99327d7-31b3-4224-83b3-dd98e722b7a2 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:07.925977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99327d7-31b3-4224-83b3-dd98e722b7a2 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:07.931461 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 352/709] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:07.933236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b0a02-7527-445e-89b3-6b12d2812ea1 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:07.933514 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b0a02-7527-445e-89b3-6b12d2812ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:07.933778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b0a02-7527-445e-89b3-6b12d2812ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:07.954984 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-8c2b0a02-7527-445e-89b3-6b12d2812ea1 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:07.956381 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8c2b0a02-7527-445e-89b3-6b12d2812ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:07.963745 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506a8e0-6b53-4eb5-b771-7e3f97d76bd5 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:08.010424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ef6de-fe28-42c5-9bbb-76245ccfa853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:08.011941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ef6de-fe28-42c5-9bbb-76245ccfa853 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:08.012419 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ef6de-fe28-42c5-9bbb-76245ccfa853 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:08.012864 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ef6de-fe28-42c5-9bbb-76245ccfa853 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:08.025052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ef6de-fe28-42c5-9bbb-76245ccfa853 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:08.026907 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ef6de-fe28-42c5-9bbb-76245ccfa853 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:08.047990 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 353/710] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:52:08.048205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-d49ef6de-fe28-42c5-9bbb-76245ccfa853 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:08.048205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:08.048205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:08.048205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:08.048205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:08.048205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:08.048205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:08.048205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:08.048205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:08.048205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:08.048205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:08.048205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:08.048205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:52:08.048205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:52:08.048205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:52:08.049337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:52:08.049337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:08.049337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:08.049337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:08.049337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:08.049337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:08.049337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:08.049337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:08.049337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:08.049337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:08.049337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:08.049337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:08.049337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:08.049337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:08.049337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:08.049337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:08.049337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:08.050256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:52:08.050256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:52:08.050256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:52:08.050256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:52:08.050256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:52:08.050256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:52:08.050256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:08.050256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:08.050256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 358/711] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:52:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:08.055474 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b0a02-7527-445e-89b3-6b12d2812ea1 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:08.165859 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:08.170269 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b0a02-7527-445e-89b3-6b12d2812ea1 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:08.205703 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61c174-d1a8-460d-be86-f8a7a720c4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:08.206325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61c174-d1a8-460d-be86-f8a7a720c4da None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:08.206597 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61c174-d1a8-460d-be86-f8a7a720c4da None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:08.206860 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61c174-d1a8-460d-be86-f8a7a720c4da None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:08.207530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61c174-d1a8-460d-be86-f8a7a720c4da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:08.207829 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61c174-d1a8-460d-be86-f8a7a720c4da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:08.209242 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61c174-d1a8-460d-be86-f8a7a720c4da None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:08.222515 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 354/712] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:52:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:08.228716 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ef6de-fe28-42c5-9bbb-76245ccfa853 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:08.259396 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:08.265138 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61c174-d1a8-460d-be86-f8a7a720c4da None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:08.350353 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ef6de-fe28-42c5-9bbb-76245ccfa853 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:08.393427 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61c174-d1a8-460d-be86-f8a7a720c4da None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:08.396689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d98387-c4de-4cea-9e57-864359f10fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:08.397301 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d98387-c4de-4cea-9e57-864359f10fee None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:08.397577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d98387-c4de-4cea-9e57-864359f10fee None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:08.397946 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d98387-c4de-4cea-9e57-864359f10fee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:08.398594 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d98387-c4de-4cea-9e57-864359f10fee None admin] RBAC: Adding query filter params (role.id=0d7a36bda723430eae02f10f4c775c96, scope.project.id=f37c835c05924364bcd1530d44f024fe, user.id=c05caac9e8b9498583780306887734be) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:08.398897 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d98387-c4de-4cea-9e57-864359f10fee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:08.400316 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d98387-c4de-4cea-9e57-864359f10fee None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:08.407128 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 359/713] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:52:08 2022] GET /identity/v3/role_assignments?user.id=c05caac9e8b9498583780306887734be&scope.project.id=f37c835c05924364bcd1530d44f024fe&role.id=0d7a36bda723430eae02f10f4c775c96 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:08.428119 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d98387-c4de-4cea-9e57-864359f10fee None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:08.435456 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8e5fc-0e6a-4423-9504-5149ebb5ae5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:08.435899 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8e5fc-0e6a-4423-9504-5149ebb5ae5d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:08.436227 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8e5fc-0e6a-4423-9504-5149ebb5ae5d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:08.436470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8e5fc-0e6a-4423-9504-5149ebb5ae5d None admin] PATH_INFO: `/v3/services/network` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:08.437071 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8e5fc-0e6a-4423-9504-5149ebb5ae5d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:08.438521 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8e5fc-0e6a-4423-9504-5149ebb5ae5d None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:08.454340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-68b8e5fc-0e6a-4423-9504-5149ebb5ae5d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 00:52:08.454340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:08.454340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 00:52:08.454340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 00:52:08.454340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 00:52:08.454340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 00:52:08.454340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 00:52:08.454340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:08.454340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 00:52:08.454340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:08.454340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:52:08.454340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:08.454340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:08.454340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:08.454340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:08.454340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:08.454340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:08.455522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:08.455522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:08.455522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:08.455522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:08.455522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:08.455522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:08.455522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 00:52:08.455522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 00:52:08.455522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 00:52:08.455522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 00:52:08.455522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:08.455522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:08.455522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:08.455522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:08.455522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:08.455522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:08.456907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:08.456907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:08.456907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:08.456907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:08.456907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:08.456907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:08.456907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:08.456907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:08.456907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:08.456907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:08.456907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 00:52:08.456907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:08.456907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 00:52:08.456907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:08.456907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 355/714] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:52:08 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:52:08.461755 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8e5fc-0e6a-4423-9504-5149ebb5ae5d None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:08.499157 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:08.546485 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:08.555613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d98387-c4de-4cea-9e57-864359f10fee None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:08.626026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178f36d-8ede-498b-83d2-90504b92bbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:08.627653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178f36d-8ede-498b-83d2-90504b92bbb8 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:08.627653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178f36d-8ede-498b-83d2-90504b92bbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:08.627653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178f36d-8ede-498b-83d2-90504b92bbb8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:08.627909 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178f36d-8ede-498b-83d2-90504b92bbb8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:08.629079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178f36d-8ede-498b-83d2-90504b92bbb8 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:08.634789 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8e5fc-0e6a-4423-9504-5149ebb5ae5d None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:08.644786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-0178f36d-8ede-498b-83d2-90504b92bbb8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 00:52:08.644786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:08.644786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 00:52:08.644786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 00:52:08.644786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 00:52:08.644786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 00:52:08.644786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 00:52:08.644786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:08.644786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 00:52:08.644786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:08.644786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:52:08.644786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:08.644786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:08.644786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:08.644786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:08.644786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:08.644786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:08.645783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:08.645783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:08.645783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:08.645783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:08.645783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:08.645783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:08.645783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 00:52:08.645783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 00:52:08.645783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 00:52:08.645783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 00:52:08.645783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:08.645783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:08.645783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:08.645783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:08.645783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:08.645783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:08.646669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:08.646669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:08.646669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:08.646669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:08.646669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:08.646669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:08.646669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:08.646669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:08.646669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:08.646669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:08.646669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 00:52:08.646669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:08.646669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 00:52:08.646669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:08.647397 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 360/715] 10.222.0.20 () {56 vars in 1129 bytes} [Wed Sep 14 00:52:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:52:08.655283 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178f36d-8ede-498b-83d2-90504b92bbb8 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:08.723509 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed63186-5b3c-4b24-ae3e-99c645c9d3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:08.724105 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed63186-5b3c-4b24-ae3e-99c645c9d3d1 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:08.724377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed63186-5b3c-4b24-ae3e-99c645c9d3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:08.724642 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed63186-5b3c-4b24-ae3e-99c645c9d3d1 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:08.725264 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed63186-5b3c-4b24-ae3e-99c645c9d3d1 None admin] RBAC: Adding query filter params (name=network) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:08.725561 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed63186-5b3c-4b24-ae3e-99c645c9d3d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:08.726953 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed63186-5b3c-4b24-ae3e-99c645c9d3d1 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:08.735185 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 356/716] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Sep 14 00:52:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:08.740152 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed63186-5b3c-4b24-ae3e-99c645c9d3d1 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:08.836215 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178f36d-8ede-498b-83d2-90504b92bbb8 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:08.843979 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:08.859348 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed63186-5b3c-4b24-ae3e-99c645c9d3d1 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:08.900156 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875e4e5-639f-4038-8d83-2be831a02448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:08.901102 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875e4e5-639f-4038-8d83-2be831a02448 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:08.901602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875e4e5-639f-4038-8d83-2be831a02448 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:08.902141 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875e4e5-639f-4038-8d83-2be831a02448 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:08.903158 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875e4e5-639f-4038-8d83-2be831a02448 None admin] RBAC: Adding query filter params (type=network) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:08.903668 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875e4e5-639f-4038-8d83-2be831a02448 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:08.906109 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875e4e5-639f-4038-8d83-2be831a02448 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:08.912647 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 357/717] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Sep 14 00:52:08 2022] GET /identity/v3/services?type=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:08.916449 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13d57a-e355-43b9-a8d1-e7c6b0a86b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:08.916449 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13d57a-e355-43b9-a8d1-e7c6b0a86b47 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:08.916449 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13d57a-e355-43b9-a8d1-e7c6b0a86b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:08.916449 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13d57a-e355-43b9-a8d1-e7c6b0a86b47 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:08.916812 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13d57a-e355-43b9-a8d1-e7c6b0a86b47 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:08.916812 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13d57a-e355-43b9-a8d1-e7c6b0a86b47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:08.917920 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13d57a-e355-43b9-a8d1-e7c6b0a86b47 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:08.932225 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 361/718] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Sep 14 00:52:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:52:08.938515 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875e4e5-639f-4038-8d83-2be831a02448 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:09.077538 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875e4e5-639f-4038-8d83-2be831a02448 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:09.121284 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc9d94-b548-40c2-96ef-2526e8424958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:09.121835 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc9d94-b548-40c2-96ef-2526e8424958 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:09.122118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc9d94-b548-40c2-96ef-2526e8424958 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:09.122386 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc9d94-b548-40c2-96ef-2526e8424958 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:09.123020 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc9d94-b548-40c2-96ef-2526e8424958 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:09.123320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc9d94-b548-40c2-96ef-2526e8424958 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:09.125237 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc9d94-b548-40c2-96ef-2526e8424958 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:09.130800 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 358/719] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Sep 14 00:52:08 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:09.589862 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f56b0-de1f-40f0-8754-0d63258f1265 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:09.590367 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f56b0-de1f-40f0-8754-0d63258f1265 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:09.590476 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f56b0-de1f-40f0-8754-0d63258f1265 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:09.592034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 362/720] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:09.598033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf4011-905d-4ba5-a8cc-35c1530f7729 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:09.598552 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf4011-905d-4ba5-a8cc-35c1530f7729 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:09.598712 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf4011-905d-4ba5-a8cc-35c1530f7729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:09.617325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-e0cf4011-905d-4ba5-a8cc-35c1530f7729 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:09.618539 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e0cf4011-905d-4ba5-a8cc-35c1530f7729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:09.630358 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:09.700487 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 359/721] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:52:10.138617 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f56b0-de1f-40f0-8754-0d63258f1265 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:10.162637 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:10.271503 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f56b0-de1f-40f0-8754-0d63258f1265 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:10.305655 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c0a49-c598-4d31-845f-8ec3526537a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:10.306700 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c0a49-c598-4d31-845f-8ec3526537a8 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:10.307176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c0a49-c598-4d31-845f-8ec3526537a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:10.307653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c0a49-c598-4d31-845f-8ec3526537a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:10.319403 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c0a49-c598-4d31-845f-8ec3526537a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:52:10.324810 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-e35c0a49-c598-4d31-845f-8ec3526537a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:52:10.324810 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:10.324810 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:10.324810 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:10.324810 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:10.324810 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:10.324810 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:10.324810 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:10.324810 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:10.324810 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:10.324810 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:10.324810 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:10.324810 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:52:10.324810 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:52:10.324810 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:52:10.324810 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:52:10.325854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:52:10.325854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:52:10.325854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:52:10.325854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:52:10.325854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:10.325854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:10.325854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:10.325854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:10.325854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:10.325854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:10.325854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:10.325854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:10.325854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:10.325854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:10.325854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:10.325854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:10.326795 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:10.326795 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:10.326795 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:10.326795 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:10.326795 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:52:10.326795 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:52:10.326795 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:52:10.326795 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:52:10.326795 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:52:10.326795 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:52:10.326795 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:52:10.326795 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:10.329734 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 363/722] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:52:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:10.337853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf4011-905d-4ba5-a8cc-35c1530f7729 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:10.491726 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf4011-905d-4ba5-a8cc-35c1530f7729 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:10.538458 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba959c2-883f-4bca-9853-ce8322dd11d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:10.538995 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba959c2-883f-4bca-9853-ce8322dd11d5 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:10.539307 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba959c2-883f-4bca-9853-ce8322dd11d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:10.539605 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba959c2-883f-4bca-9853-ce8322dd11d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:10.540272 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba959c2-883f-4bca-9853-ce8322dd11d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:10.540569 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba959c2-883f-4bca-9853-ce8322dd11d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:10.541975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba959c2-883f-4bca-9853-ce8322dd11d5 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:10.551615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 360/723] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:52:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:10.556933 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c0a49-c598-4d31-845f-8ec3526537a8 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:10.676388 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:10.702779 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c0a49-c598-4d31-845f-8ec3526537a8 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:10.754708 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310a92f-4db4-49a7-bf55-04b564281793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:10.755362 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310a92f-4db4-49a7-bf55-04b564281793 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:10.755638 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310a92f-4db4-49a7-bf55-04b564281793 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:10.755904 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310a92f-4db4-49a7-bf55-04b564281793 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:10.770420 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310a92f-4db4-49a7-bf55-04b564281793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:10.771898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310a92f-4db4-49a7-bf55-04b564281793 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:10.790341 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-7310a92f-4db4-49a7-bf55-04b564281793 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:10.790341 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:10.790341 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:10.790341 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:10.790341 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:10.790341 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:10.790341 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:10.790341 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:10.790341 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:10.790341 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:10.790341 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:10.790341 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:10.790341 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:10.790341 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:10.790341 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:10.790341 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:10.791401 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:10.791401 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:10.791401 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:10.791401 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:10.791401 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:10.791401 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:10.791401 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:10.791401 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:10.791401 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:10.791401 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:10.791401 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:10.791401 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:10.791401 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:10.791401 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:10.791401 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:10.791401 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:10.791401 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:10.792898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:10.792898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:10.792898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:10.792898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 364/724] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:10.797618 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba959c2-883f-4bca-9853-ce8322dd11d5 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:10.820866 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:10.906647 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d34e5-0324-4c7a-99ca-12f8555e73b6 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:10.907318 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d34e5-0324-4c7a-99ca-12f8555e73b6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:10.907789 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d34e5-0324-4c7a-99ca-12f8555e73b6 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:10.910618 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 365/725] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 00:52:10.915423 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e94a7d-8117-47d0-b0f7-cb13cc28a2f5 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:10.916048 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e94a7d-8117-47d0-b0f7-cb13cc28a2f5 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:10.916621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e94a7d-8117-47d0-b0f7-cb13cc28a2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:10.941268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-80e94a7d-8117-47d0-b0f7-cb13cc28a2f5 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:10.943596 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-80e94a7d-8117-47d0-b0f7-cb13cc28a2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:10.976766 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba959c2-883f-4bca-9853-ce8322dd11d5 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:11.047028 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bda177-d5f1-4671-98d4-e0aee148c810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:11.047553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bda177-d5f1-4671-98d4-e0aee148c810 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:11.047824 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bda177-d5f1-4671-98d4-e0aee148c810 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:11.048086 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bda177-d5f1-4671-98d4-e0aee148c810 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:11.048719 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bda177-d5f1-4671-98d4-e0aee148c810 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:11.049012 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bda177-d5f1-4671-98d4-e0aee148c810 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:11.050389 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bda177-d5f1-4671-98d4-e0aee148c810 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:11.071053 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 361/726] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:11.078154 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bda177-d5f1-4671-98d4-e0aee148c810 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:11.092771 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 366/727] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:52:11.100932 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848d3c1-3be6-4334-8ea9-c0e02587c53a None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:11.101495 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848d3c1-3be6-4334-8ea9-c0e02587c53a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:11.102028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848d3c1-3be6-4334-8ea9-c0e02587c53a None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:11.103561 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 367/728] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:11.112367 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a23ce2-d8a1-4b98-a817-9119ed55256e None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:11.112905 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a23ce2-d8a1-4b98-a817-9119ed55256e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:11.113396 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a23ce2-d8a1-4b98-a817-9119ed55256e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:11.142077 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-05a23ce2-d8a1-4b98-a817-9119ed55256e None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:11.144115 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-05a23ce2-d8a1-4b98-a817-9119ed55256e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:11.203159 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:11.247146 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:11.260251 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bda177-d5f1-4671-98d4-e0aee148c810 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:11.266772 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 368/729] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 14 00:52:11.298602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68167f-2778-4171-b8fd-67229bfa1b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:11.299147 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68167f-2778-4171-b8fd-67229bfa1b71 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:11.299422 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68167f-2778-4171-b8fd-67229bfa1b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:11.299687 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68167f-2778-4171-b8fd-67229bfa1b71 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:11.306963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b68167f-2778-4171-b8fd-67229bfa1b71 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:11.308447 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b68167f-2778-4171-b8fd-67229bfa1b71 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:11.321040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-9b68167f-2778-4171-b8fd-67229bfa1b71 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 00:52:11.321040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:11.321040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:11.321040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:11.321040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:11.321040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:11.321040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:11.321040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:11.321040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:11.321040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:11.321040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:11.321040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:11.321040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:52:11.321040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:52:11.321040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:52:11.321040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:52:11.322024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:11.322024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:11.322024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:52:11.322024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:11.322024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:52:11.322024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:11.322024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:11.322024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:11.322024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:11.322024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:11.322024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:11.322024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:11.322024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:11.322024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:11.322024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:11.322024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:11.322024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:11.322024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:11.323222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:11.323222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:11.323222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:52:11.323222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:52:11.323222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:52:11.323222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:52:11.323222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:52:11.323222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:52:11.323222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 00:52:11.323222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:11.323222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 362/730] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:52:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:52:11.327927 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a23ce2-d8a1-4b98-a817-9119ed55256e None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:11.391201 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68167f-2778-4171-b8fd-67229bfa1b71 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:11.577279 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a23ce2-d8a1-4b98-a817-9119ed55256e None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:11.595323 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68167f-2778-4171-b8fd-67229bfa1b71 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:11.643507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07b69c-a2d1-46d2-a136-20194d5676c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:11.644496 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07b69c-a2d1-46d2-a136-20194d5676c7 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:11.644981 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07b69c-a2d1-46d2-a136-20194d5676c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:11.645464 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07b69c-a2d1-46d2-a136-20194d5676c7 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:11.646401 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07b69c-a2d1-46d2-a136-20194d5676c7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:11.646909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:11.647101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07b69c-a2d1-46d2-a136-20194d5676c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:11.649302 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07b69c-a2d1-46d2-a136-20194d5676c7 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:11.661452 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487a31f-c88f-4766-b977-7e4c31a51357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:11.662149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487a31f-c88f-4766-b977-7e4c31a51357 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:11.662427 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487a31f-c88f-4766-b977-7e4c31a51357 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:11.662692 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487a31f-c88f-4766-b977-7e4c31a51357 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:11.674342 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 369/731] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Sep 14 00:52:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:11.675971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487a31f-c88f-4766-b977-7e4c31a51357 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:52:11.676226 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07b69c-a2d1-46d2-a136-20194d5676c7 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:11.682305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-d487a31f-c88f-4766-b977-7e4c31a51357 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:52:11.682305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:11.682305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:11.682305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:11.682305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:11.682305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:11.682305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:11.682305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:11.682305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:11.682305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:11.682305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:11.682305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:11.682305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:52:11.682305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:52:11.682305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:52:11.682305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:52:11.683334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:52:11.683334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:52:11.683334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:52:11.683334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:52:11.683334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:11.683334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:11.683334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:11.683334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:11.683334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:11.683334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:11.683334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:11.683334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:11.683334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:11.683334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:11.683334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:11.683334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:11.684586 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:11.684586 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:11.684586 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:11.684586 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:11.684586 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:52:11.684586 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:52:11.684586 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:52:11.684586 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:52:11.684586 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:52:11.684586 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:52:11.684586 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:52:11.684586 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:11.688924 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 363/732] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 14 00:52:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:52:11.689980 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487a31f-c88f-4766-b977-7e4c31a51357 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:11.746050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:11.809912 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487a31f-c88f-4766-b977-7e4c31a51357 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:11.812210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07b69c-a2d1-46d2-a136-20194d5676c7 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:11.847017 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b92e3-b759-47d1-8076-e043b71f5691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:11.847560 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b92e3-b759-47d1-8076-e043b71f5691 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:11.847835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b92e3-b759-47d1-8076-e043b71f5691 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:11.848103 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b92e3-b759-47d1-8076-e043b71f5691 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:11.848930 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c005b1-4489-4b74-bf7f-e3217660ed0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:11.849531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c005b1-4489-4b74-bf7f-e3217660ed0c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:11.849818 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c005b1-4489-4b74-bf7f-e3217660ed0c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:11.850099 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c005b1-4489-4b74-bf7f-e3217660ed0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:11.859305 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b92e3-b759-47d1-8076-e043b71f5691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:52:11.864074 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-720b92e3-b759-47d1-8076-e043b71f5691 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:52:11.864074 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:11.864074 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:11.864074 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:11.864074 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:11.864074 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:11.864074 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:11.864074 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:11.864074 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:11.864074 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:11.864074 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:11.864074 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:11.864074 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:52:11.864074 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:52:11.864074 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:52:11.864074 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:52:11.865176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:52:11.865176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:52:11.865176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:52:11.865176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:52:11.865176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:11.865176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:11.865176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:11.865176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:11.865176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:11.865176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:11.865176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:11.865176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:11.865176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:11.865176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:11.865176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:11.865176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:11.866080 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:11.866080 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:11.866080 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:11.866080 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:11.866080 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:52:11.866080 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:52:11.866080 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:52:11.866080 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:52:11.866080 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:52:11.866080 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:52:11.866080 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:52:11.866080 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:11.869973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 370/733] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:52:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:11.871310 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b92e3-b759-47d1-8076-e043b71f5691 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:11.909329 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:11.921934 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c005b1-4489-4b74-bf7f-e3217660ed0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:11.923390 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c005b1-4489-4b74-bf7f-e3217660ed0c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:11.973455 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b92e3-b759-47d1-8076-e043b71f5691 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:11.986754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:12.011135 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e280cb2-31d0-4d94-b296-0e91b3beb3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:12.011815 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e280cb2-31d0-4d94-b296-0e91b3beb3cf None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:12.012098 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e280cb2-31d0-4d94-b296-0e91b3beb3cf None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:12.012373 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e280cb2-31d0-4d94-b296-0e91b3beb3cf None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:12.013032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e280cb2-31d0-4d94-b296-0e91b3beb3cf None admin] RBAC: Adding query filter params (name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:12.013337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e280cb2-31d0-4d94-b296-0e91b3beb3cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:12.014730 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e280cb2-31d0-4d94-b296-0e91b3beb3cf None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:12.018992 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 364/734] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:52:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 00:52:12.020295 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417c914-7d83-49d3-8532-5f15971d3530 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:12.020579 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417c914-7d83-49d3-8532-5f15971d3530 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:12.020842 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417c914-7d83-49d3-8532-5f15971d3530 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:12.022085 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 365/735] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:12.023075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb02c55-27a0-47ae-a5ed-5f013a184cfa None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:12.023438 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb02c55-27a0-47ae-a5ed-5f013a184cfa None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:12.023763 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb02c55-27a0-47ae-a5ed-5f013a184cfa None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:12.024969 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 366/736] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:12.025931 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb02c55-27a0-47ae-a5ed-5f013a184cfa None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:12.035943 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 371/737] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 14 00:52:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:12.035943 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e280cb2-31d0-4d94-b296-0e91b3beb3cf None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:12.112252 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:12.125521 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb02c55-27a0-47ae-a5ed-5f013a184cfa None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:12.132437 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e280cb2-31d0-4d94-b296-0e91b3beb3cf None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:12.157966 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ae253-e2ee-4b1d-a96c-45e62f063b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:12.158558 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ae253-e2ee-4b1d-a96c-45e62f063b9f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:12.158832 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ae253-e2ee-4b1d-a96c-45e62f063b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:12.159099 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ae253-e2ee-4b1d-a96c-45e62f063b9f None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:12.159754 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ae253-e2ee-4b1d-a96c-45e62f063b9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:12.160055 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ae253-e2ee-4b1d-a96c-45e62f063b9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:12.161411 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ae253-e2ee-4b1d-a96c-45e62f063b9f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:12.165197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4f3f1-4b69-4b6c-bae3-43b3576cce5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:12.165822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4f3f1-4b69-4b6c-bae3-43b3576cce5c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:12.166114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4f3f1-4b69-4b6c-bae3-43b3576cce5c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:12.166380 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4f3f1-4b69-4b6c-bae3-43b3576cce5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:12.169220 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 367/738] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:52:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:12.170437 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b1189-3ccf-4e1b-98d5-90d60780674f None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:12.170717 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b1189-3ccf-4e1b-98d5-90d60780674f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:12.170985 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b1189-3ccf-4e1b-98d5-90d60780674f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:12.177767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4f3f1-4b69-4b6c-bae3-43b3576cce5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:12.179252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4f3f1-4b69-4b6c-bae3-43b3576cce5c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:12.188501 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-5b1b1189-3ccf-4e1b-98d5-90d60780674f None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:12.189681 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5b1b1189-3ccf-4e1b-98d5-90d60780674f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:12.193592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-76c4f3f1-4b69-4b6c-bae3-43b3576cce5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:12.193592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:12.193592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:12.193592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:12.193592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:12.193592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:12.193592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:12.193592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:12.193592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:12.193592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:12.193592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:12.193592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:12.193592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:12.193592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:12.193592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:12.193592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:12.194717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:12.194717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:12.194717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:12.194717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:12.194717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:12.194717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:12.194717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:12.194717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:12.194717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:12.194717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:12.194717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:12.194717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:12.194717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:12.194717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:12.194717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:12.194717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:12.194717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:12.195625 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:12.195625 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:12.195625 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:12.197971 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 372/739] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:12.199713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf7c88-664c-4147-a6f7-540bd78a2637 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:12.199991 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf7c88-664c-4147-a6f7-540bd78a2637 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:12.200256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf7c88-664c-4147-a6f7-540bd78a2637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:12.220195 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-eaaf7c88-664c-4147-a6f7-540bd78a2637 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:12.221578 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-eaaf7c88-664c-4147-a6f7-540bd78a2637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:12.239621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:12.261348 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 368/740] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:52:12.262230 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b1189-3ccf-4e1b-98d5-90d60780674f None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:12.314859 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 373/741] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 00:52:12.314859 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf7c88-664c-4147-a6f7-540bd78a2637 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:12.343848 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:12.364945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b1189-3ccf-4e1b-98d5-90d60780674f None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:12.399819 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e5b6b-41cf-4343-b589-49c9877e186e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:12.400590 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e5b6b-41cf-4343-b589-49c9877e186e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:12.400935 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e5b6b-41cf-4343-b589-49c9877e186e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:12.401318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e5b6b-41cf-4343-b589-49c9877e186e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:12.412492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e5b6b-41cf-4343-b589-49c9877e186e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:12.414096 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e5b6b-41cf-4343-b589-49c9877e186e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:12.422025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf7c88-664c-4147-a6f7-540bd78a2637 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:12.431486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-f23e5b6b-41cf-4343-b589-49c9877e186e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:12.431486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:12.431486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:12.431486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:12.431486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:12.431486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:12.431486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:12.431486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:12.431486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:12.431486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:12.431486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:12.431486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:12.431486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:12.431486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:12.431486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:12.431486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:12.432396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:12.432396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:12.432396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:12.432396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:12.432396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:12.432396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:12.432396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:12.432396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:12.432396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:12.432396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:12.432396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:12.432396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:12.432396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:12.432396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:12.432396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:12.432396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:12.432396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:12.433289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:12.433289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:12.433289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:12.437490 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 369/742] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:12.438509 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e5b6b-41cf-4343-b589-49c9877e186e None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:12.462890 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466dd6f-d1d6-4aa6-80aa-8e42947b62be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:12.463895 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466dd6f-d1d6-4aa6-80aa-8e42947b62be None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:12.464480 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466dd6f-d1d6-4aa6-80aa-8e42947b62be None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:12.464996 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466dd6f-d1d6-4aa6-80aa-8e42947b62be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:12.475892 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466dd6f-d1d6-4aa6-80aa-8e42947b62be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:12.477536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466dd6f-d1d6-4aa6-80aa-8e42947b62be None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:12.493549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-3466dd6f-d1d6-4aa6-80aa-8e42947b62be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:12.493549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:12.493549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:12.493549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:12.493549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:12.493549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:12.493549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:12.493549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:12.493549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:12.493549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:12.493549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:12.493549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:12.493549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:12.493549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:12.493549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:12.493549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:12.494504 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:12.494504 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:12.494504 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:12.494504 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:12.494504 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:12.494504 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:12.494504 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:12.494504 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:12.494504 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:12.494504 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:12.494504 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:12.494504 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:12.494504 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:12.494504 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:12.494504 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:12.494504 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:12.494504 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:12.495356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:12.495356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:12.495356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:12.497092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 374/743] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:12.498077 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466dd6f-d1d6-4aa6-80aa-8e42947b62be None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:12.507615 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:12.543654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e5b6b-41cf-4343-b589-49c9877e186e None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:12.573440 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:12.580147 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740d498-7659-44ae-83d2-7d134753dfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:12.580752 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740d498-7659-44ae-83d2-7d134753dfb4 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:12.581028 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740d498-7659-44ae-83d2-7d134753dfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:12.581657 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740d498-7659-44ae-83d2-7d134753dfb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:12.582329 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740d498-7659-44ae-83d2-7d134753dfb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:12.582949 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740d498-7659-44ae-83d2-7d134753dfb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:12.584321 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740d498-7659-44ae-83d2-7d134753dfb4 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:12.601209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 370/744] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:12.601209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740d498-7659-44ae-83d2-7d134753dfb4 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:12.608974 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466dd6f-d1d6-4aa6-80aa-8e42947b62be None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:12.647383 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80ac1e-d69f-4459-8a53-fb7f2b609249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:12.647904 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80ac1e-d69f-4459-8a53-fb7f2b609249 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:12.648178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80ac1e-d69f-4459-8a53-fb7f2b609249 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:12.648444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80ac1e-d69f-4459-8a53-fb7f2b609249 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:12.649109 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80ac1e-d69f-4459-8a53-fb7f2b609249 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:12.649404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80ac1e-d69f-4459-8a53-fb7f2b609249 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:12.650776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80ac1e-d69f-4459-8a53-fb7f2b609249 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:12.662823 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 375/745] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:12.663755 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80ac1e-d69f-4459-8a53-fb7f2b609249 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:12.700449 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740d498-7659-44ae-83d2-7d134753dfb4 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:12.726821 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:12.733005 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1093ede-aa5e-47d7-9f05-594b7b109b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:12.733592 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1093ede-aa5e-47d7-9f05-594b7b109b48 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:12.733888 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1093ede-aa5e-47d7-9f05-594b7b109b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:12.734156 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1093ede-aa5e-47d7-9f05-594b7b109b48 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:12.734779 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1093ede-aa5e-47d7-9f05-594b7b109b48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:12.735069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1093ede-aa5e-47d7-9f05-594b7b109b48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:12.736423 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1093ede-aa5e-47d7-9f05-594b7b109b48 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:12.747354 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 371/746] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:12.748143 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1093ede-aa5e-47d7-9f05-594b7b109b48 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:12.762925 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80ac1e-d69f-4459-8a53-fb7f2b609249 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:12.795457 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7686e4-5f18-4758-a186-e2e4dc4f2e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:12.796145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7686e4-5f18-4758-a186-e2e4dc4f2e8c None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:12.796418 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7686e4-5f18-4758-a186-e2e4dc4f2e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:12.796682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7686e4-5f18-4758-a186-e2e4dc4f2e8c None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:12.797314 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7686e4-5f18-4758-a186-e2e4dc4f2e8c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:12.798673 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7686e4-5f18-4758-a186-e2e4dc4f2e8c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:12.799456 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:12.814540 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 376/747] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Sep 14 00:52:12 2022] POST /identity/v3/services => generated 251 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:52:12.818017 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7686e4-5f18-4758-a186-e2e4dc4f2e8c None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:12.856741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1093ede-aa5e-47d7-9f05-594b7b109b48 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:12.901753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fe760-1405-485d-9a6c-25de73ec3c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:12.902337 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fe760-1405-485d-9a6c-25de73ec3c12 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:12.902614 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fe760-1405-485d-9a6c-25de73ec3c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:12.902883 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fe760-1405-485d-9a6c-25de73ec3c12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:12.912433 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994fe760-1405-485d-9a6c-25de73ec3c12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:12.914034 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994fe760-1405-485d-9a6c-25de73ec3c12 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:12.926138 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-994fe760-1405-485d-9a6c-25de73ec3c12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:12.926138 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:12.926138 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:12.926138 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:12.926138 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:12.926138 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:12.926138 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:12.926138 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:12.926138 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:12.926138 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:12.926138 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:12.926138 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:12.926138 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:52:12.926138 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:52:12.926138 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:52:12.927098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:52:12.927098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:12.927098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:12.927098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:12.927098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:12.927098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:12.927098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:12.927098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:12.927098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:12.927098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:12.927098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:12.927098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:12.927098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:12.927098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:12.927098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:12.927098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:12.927098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:12.927994 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:52:12.927994 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:52:12.927994 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:52:12.927994 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:52:12.927994 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:52:12.927994 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:52:12.927994 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:12.927994 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:12.927994 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 372/748] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:52:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:12.928477 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fe760-1405-485d-9a6c-25de73ec3c12 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:12.935811 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7686e4-5f18-4758-a186-e2e4dc4f2e8c None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:12.964716 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:12.974920 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9970a-61ec-4a54-8e52-ab96fc5759e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:12.975829 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9970a-61ec-4a54-8e52-ab96fc5759e2 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:12.976253 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9970a-61ec-4a54-8e52-ab96fc5759e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:12.976676 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9970a-61ec-4a54-8e52-ab96fc5759e2 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:12.977479 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9970a-61ec-4a54-8e52-ab96fc5759e2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:12.978916 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9970a-61ec-4a54-8e52-ab96fc5759e2 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:12.996222 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 377/749] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Sep 14 00:52:12 2022] POST /identity/v3/services => generated 240 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:52:12.997386 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9970a-61ec-4a54-8e52-ab96fc5759e2 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:13.072730 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fe760-1405-485d-9a6c-25de73ec3c12 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:13.084715 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:13.125666 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df294b05-bd52-4e1e-af2d-ac5e733ba925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:13.126407 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df294b05-bd52-4e1e-af2d-ac5e733ba925 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:13.126754 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df294b05-bd52-4e1e-af2d-ac5e733ba925 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:13.127085 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df294b05-bd52-4e1e-af2d-ac5e733ba925 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:13.136742 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df294b05-bd52-4e1e-af2d-ac5e733ba925 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:13.138244 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df294b05-bd52-4e1e-af2d-ac5e733ba925 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:13.138742 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9970a-61ec-4a54-8e52-ab96fc5759e2 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:13.151991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-df294b05-bd52-4e1e-af2d-ac5e733ba925 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 00:52:13.151991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:13.151991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:13.151991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:13.151991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:13.151991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:13.151991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:13.151991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:13.151991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:13.151991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:13.151991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:13.151991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:13.151991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:52:13.151991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:52:13.151991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:52:13.151991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:52:13.152968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:13.152968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:13.152968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:52:13.152968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:13.152968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:52:13.152968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:13.152968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:13.152968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:13.152968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:13.152968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:13.152968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:13.152968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:13.152968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:13.152968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:13.152968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:13.152968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:13.152968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:13.152968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:13.153949 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:13.153949 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:13.153949 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:52:13.153949 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:52:13.153949 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:52:13.153949 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:52:13.153949 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:52:13.153949 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:52:13.153949 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 00:52:13.153949 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:13.153949 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 373/750] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Sep 14 00:52:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:13.155458 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df294b05-bd52-4e1e-af2d-ac5e733ba925 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:13.190521 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92888f39-1a5d-4488-8210-0178e078c50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:13.191151 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92888f39-1a5d-4488-8210-0178e078c50d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:13.191431 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92888f39-1a5d-4488-8210-0178e078c50d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:13.191696 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92888f39-1a5d-4488-8210-0178e078c50d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:13.199862 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92888f39-1a5d-4488-8210-0178e078c50d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:13.201285 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92888f39-1a5d-4488-8210-0178e078c50d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:13.213833 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-92888f39-1a5d-4488-8210-0178e078c50d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 00:52:13.213833 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:13.213833 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:13.213833 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:13.213833 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:13.213833 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:13.213833 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:13.213833 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:13.213833 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:13.213833 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:13.213833 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:13.213833 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:13.213833 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:52:13.213833 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:52:13.213833 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:52:13.213833 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:52:13.214984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:13.214984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:13.214984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:52:13.214984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:13.214984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:52:13.214984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:13.214984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:13.214984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:13.214984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:13.214984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:13.214984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:13.214984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:13.214984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:13.214984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:13.214984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:13.214984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:13.214984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:13.214984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:13.216130 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:13.216130 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:13.216130 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:52:13.216130 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:52:13.216130 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:52:13.216130 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:52:13.216130 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:52:13.216130 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:52:13.216130 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 00:52:13.216130 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:13.219550 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 378/751] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Sep 14 00:52:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:13.220543 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92888f39-1a5d-4488-8210-0178e078c50d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:13.270727 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:13.283695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df294b05-bd52-4e1e-af2d-ac5e733ba925 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:13.330317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fb05f-0f5e-490b-a47e-be30acfb56f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:13.331377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fb05f-0f5e-490b-a47e-be30acfb56f6 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:13.331755 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fb05f-0f5e-490b-a47e-be30acfb56f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:13.332119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fb05f-0f5e-490b-a47e-be30acfb56f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:13.333117 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03fb05f-0f5e-490b-a47e-be30acfb56f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:13.333503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03fb05f-0f5e-490b-a47e-be30acfb56f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:13.334748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92888f39-1a5d-4488-8210-0178e078c50d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:13.335098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03fb05f-0f5e-490b-a47e-be30acfb56f6 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:13.350923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 374/752] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:52:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:13.352021 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fb05f-0f5e-490b-a47e-be30acfb56f6 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:13.379875 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:13.380892 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e6879-bd35-4523-979a-35642b50a2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:13.381976 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e6879-bd35-4523-979a-35642b50a2ed None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:13.382806 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e6879-bd35-4523-979a-35642b50a2ed None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:13.382806 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e6879-bd35-4523-979a-35642b50a2ed None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:13.383727 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e6879-bd35-4523-979a-35642b50a2ed None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:13.384099 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e6879-bd35-4523-979a-35642b50a2ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:13.386729 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e6879-bd35-4523-979a-35642b50a2ed None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:13.411064 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 379/753] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Sep 14 00:52:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:13.412260 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e6879-bd35-4523-979a-35642b50a2ed None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:13.471735 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fb05f-0f5e-490b-a47e-be30acfb56f6 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:13.507289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57514531-e324-47a3-b39e-c6f4e4417d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:13.507775 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57514531-e324-47a3-b39e-c6f4e4417d19 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:13.508142 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57514531-e324-47a3-b39e-c6f4e4417d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:13.508473 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57514531-e324-47a3-b39e-c6f4e4417d19 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:13.509248 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57514531-e324-47a3-b39e-c6f4e4417d19 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:13.509626 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57514531-e324-47a3-b39e-c6f4e4417d19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:13.511118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57514531-e324-47a3-b39e-c6f4e4417d19 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:13.521078 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e6879-bd35-4523-979a-35642b50a2ed None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:13.523662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:13.533975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 375/754] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Sep 14 00:52:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:13.533975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57514531-e324-47a3-b39e-c6f4e4417d19 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:13.566194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4fff5-f678-4011-8193-41f2dc45af55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:13.567133 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4fff5-f678-4011-8193-41f2dc45af55 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:13.567617 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4fff5-f678-4011-8193-41f2dc45af55 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:13.568063 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4fff5-f678-4011-8193-41f2dc45af55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:13.568959 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4fff5-f678-4011-8193-41f2dc45af55 None admin] RBAC: Adding query filter params (role.id=0d7a36bda723430eae02f10f4c775c96, scope.project.id=f37c835c05924364bcd1530d44f024fe, user.id=c8d05652bfe542d5a2cfa39fbf7a83c9) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:13.569442 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4fff5-f678-4011-8193-41f2dc45af55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:13.571114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4fff5-f678-4011-8193-41f2dc45af55 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:13.577579 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 380/755] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:52:13 2022] GET /identity/v3/role_assignments?user.id=c8d05652bfe542d5a2cfa39fbf7a83c9&scope.project.id=f37c835c05924364bcd1530d44f024fe&role.id=0d7a36bda723430eae02f10f4c775c96 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:13.578687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4fff5-f678-4011-8193-41f2dc45af55 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:13.619173 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:13.640599 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57514531-e324-47a3-b39e-c6f4e4417d19 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:13.677386 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e45cf4-4497-4660-81d7-e011d2840545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:13.678042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e45cf4-4497-4660-81d7-e011d2840545 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:13.678373 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e45cf4-4497-4660-81d7-e011d2840545 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:13.678710 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e45cf4-4497-4660-81d7-e011d2840545 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:13.694062 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4fff5-f678-4011-8193-41f2dc45af55 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:13.731400 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8342a1-7b7a-4480-844e-f3a8d697a6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:13.732390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8342a1-7b7a-4480-844e-f3a8d697a6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:13.733393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8342a1-7b7a-4480-844e-f3a8d697a6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:13.733955 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8342a1-7b7a-4480-844e-f3a8d697a6f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:13.746378 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8342a1-7b7a-4480-844e-f3a8d697a6f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:13.748219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8342a1-7b7a-4480-844e-f3a8d697a6f1 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:13.755943 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e45cf4-4497-4660-81d7-e011d2840545 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:13.757288 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e45cf4-4497-4660-81d7-e011d2840545 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:13.765416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-4c8342a1-7b7a-4480-844e-f3a8d697a6f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:13.765416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:13.765416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:13.765416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:13.765416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:13.765416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:13.765416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:13.765416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:13.765416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:13.765416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:13.765416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:13.765416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:13.765416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:13.765416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:13.765416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:13.765416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:13.766767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:13.766767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:13.766767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:13.766767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:13.766767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:13.766767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:13.766767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:13.766767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:13.766767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:13.766767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:13.766767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:13.766767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:13.766767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:13.766767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:13.766767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:13.766767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:13.766767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:13.767631 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:13.767631 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:13.767631 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:13.773924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 381/756] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:13.775571 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8342a1-7b7a-4480-844e-f3a8d697a6f1 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:13.800577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:13.848622 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:13.870914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 376/757] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:52:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 00:52:13.876937 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e45cf4-4497-4660-81d7-e011d2840545 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:13.895209 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8342a1-7b7a-4480-844e-f3a8d697a6f1 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:13.942607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a634e8d-cf45-4dac-8b32-2b36233c6b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:13.943153 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a634e8d-cf45-4dac-8b32-2b36233c6b20 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:13.943432 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a634e8d-cf45-4dac-8b32-2b36233c6b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:13.943700 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a634e8d-cf45-4dac-8b32-2b36233c6b20 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:13.944336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a634e8d-cf45-4dac-8b32-2b36233c6b20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:13.944630 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a634e8d-cf45-4dac-8b32-2b36233c6b20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:13.947656 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a634e8d-cf45-4dac-8b32-2b36233c6b20 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:13.960571 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 382/758] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:52:13.967385 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a634e8d-cf45-4dac-8b32-2b36233c6b20 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:13.999548 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e45cf4-4497-4660-81d7-e011d2840545 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:14.067145 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478d5c8-d017-4cb7-9dae-c389d59f95c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:14.068179 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478d5c8-d017-4cb7-9dae-c389d59f95c8 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:14.068524 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478d5c8-d017-4cb7-9dae-c389d59f95c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:14.068862 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478d5c8-d017-4cb7-9dae-c389d59f95c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:14.081133 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478d5c8-d017-4cb7-9dae-c389d59f95c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:14.083156 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478d5c8-d017-4cb7-9dae-c389d59f95c8 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:14.100465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-5478d5c8-d017-4cb7-9dae-c389d59f95c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:14.100465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:14.100465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:14.100465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:14.100465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:14.100465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:14.100465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:14.100465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:14.100465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:14.100465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:14.100465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:14.100465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:14.100465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:14.100465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:14.100465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:14.100465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:14.101417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:14.101417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:14.101417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:14.101417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:14.101417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:14.101417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:14.101417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:14.101417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:14.101417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:14.101417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:14.101417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:14.101417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:14.101417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:14.101417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:14.101417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:14.101417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:14.101417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:14.102629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:14.102629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:14.102629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:14.102629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 377/759] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:14.108279 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478d5c8-d017-4cb7-9dae-c389d59f95c8 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:14.138769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:14.160584 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:14.163642 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a634e8d-cf45-4dac-8b32-2b36233c6b20 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:14.214756 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd240f-01c0-41ae-8f04-afee05b758f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:14.215300 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd240f-01c0-41ae-8f04-afee05b758f2 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:14.215579 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd240f-01c0-41ae-8f04-afee05b758f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:14.215845 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd240f-01c0-41ae-8f04-afee05b758f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:14.230095 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd240f-01c0-41ae-8f04-afee05b758f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:14.231535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd240f-01c0-41ae-8f04-afee05b758f2 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:14.249076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-04cd240f-01c0-41ae-8f04-afee05b758f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:14.249076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:14.249076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:14.249076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:14.249076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:14.249076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:14.249076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:14.249076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:14.249076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:14.249076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:14.249076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:14.249076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:14.249076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:52:14.249076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:52:14.249076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:52:14.250073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:52:14.250073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:14.250073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:14.250073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:14.250073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:14.250073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:14.250073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:14.250073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:14.250073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:14.250073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:14.250073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:14.250073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:14.250073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:14.250073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:14.250073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:14.250073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:14.250073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:14.250955 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:52:14.250955 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:52:14.250955 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:52:14.250955 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:52:14.250955 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:52:14.250955 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:52:14.250955 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:14.250955 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:14.250955 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 383/760] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:52:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:52:14.257462 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd240f-01c0-41ae-8f04-afee05b758f2 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:14.289211 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478d5c8-d017-4cb7-9dae-c389d59f95c8 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:14.355518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976cf79-e459-46bd-b5bf-762dc7be5d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:14.356119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976cf79-e459-46bd-b5bf-762dc7be5d95 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:14.356394 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976cf79-e459-46bd-b5bf-762dc7be5d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:14.356659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976cf79-e459-46bd-b5bf-762dc7be5d95 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:14.357298 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976cf79-e459-46bd-b5bf-762dc7be5d95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:14.357594 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976cf79-e459-46bd-b5bf-762dc7be5d95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:14.359097 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976cf79-e459-46bd-b5bf-762dc7be5d95 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:14.386879 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 378/761] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:52:14.392373 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976cf79-e459-46bd-b5bf-762dc7be5d95 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:14.447910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd240f-01c0-41ae-8f04-afee05b758f2 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:14.498186 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:14.506326 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976cf79-e459-46bd-b5bf-762dc7be5d95 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:14.527570 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313881a7-5d18-47c1-996a-5695bcda818b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:14.528555 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313881a7-5d18-47c1-996a-5695bcda818b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:14.529976 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313881a7-5d18-47c1-996a-5695bcda818b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:14.530562 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313881a7-5d18-47c1-996a-5695bcda818b None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:14.532663 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313881a7-5d18-47c1-996a-5695bcda818b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:14.534120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313881a7-5d18-47c1-996a-5695bcda818b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:14.537048 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313881a7-5d18-47c1-996a-5695bcda818b None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:14.553212 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:14.562370 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 384/762] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:52:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:14.567538 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313881a7-5d18-47c1-996a-5695bcda818b None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:14.584027 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74b823-d68e-4d21-a27d-8c96ed7c6699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:14.584667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74b823-d68e-4d21-a27d-8c96ed7c6699 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:14.584944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74b823-d68e-4d21-a27d-8c96ed7c6699 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:14.585216 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74b823-d68e-4d21-a27d-8c96ed7c6699 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:14.596534 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74b823-d68e-4d21-a27d-8c96ed7c6699 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:14.606034 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74b823-d68e-4d21-a27d-8c96ed7c6699 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:14.628175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-2a74b823-d68e-4d21-a27d-8c96ed7c6699 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:14.628175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:14.628175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:14.628175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:14.628175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:14.628175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:14.628175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:14.628175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:14.628175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:14.628175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:14.628175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:14.628175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:14.628175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:52:14.628175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:52:14.628175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:52:14.629303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:52:14.629303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:14.629303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:14.629303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:14.629303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:14.629303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:14.629303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:14.629303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:14.629303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:14.629303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:14.629303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:14.629303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:14.629303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:14.629303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:14.629303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:14.629303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:14.629303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:14.630450 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:52:14.630450 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:52:14.630450 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:52:14.630450 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:52:14.630450 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:52:14.630450 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:52:14.630450 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:14.630450 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:14.638410 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 379/763] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:52:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:52:14.643689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74b823-d68e-4d21-a27d-8c96ed7c6699 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:14.685079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313881a7-5d18-47c1-996a-5695bcda818b None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:14.725687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf5be6-d0fd-4cda-9933-1be33c428c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:14.726694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf5be6-d0fd-4cda-9933-1be33c428c8b None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:14.727123 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf5be6-d0fd-4cda-9933-1be33c428c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:14.727552 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf5be6-d0fd-4cda-9933-1be33c428c8b None admin] PATH_INFO: `/v3/projects/f37c835c05924364bcd1530d44f024fe/users/c05caac9e8b9498583780306887734be/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:14.730202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf5be6-d0fd-4cda-9933-1be33c428c8b None admin] RBAC: Authorizing `identity:create_grant(project_id=f37c835c05924364bcd1530d44f024fe, user_id=c05caac9e8b9498583780306887734be, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:14.731862 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf5be6-d0fd-4cda-9933-1be33c428c8b None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:14.749271 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 385/764] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 14 00:52:14 2022] PUT /identity/v3/projects/f37c835c05924364bcd1530d44f024fe/users/c05caac9e8b9498583780306887734be/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 00:52:14.852053 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74b823-d68e-4d21-a27d-8c96ed7c6699 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:14.893205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771c28e-a9e7-4c17-b68c-99438b7383cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:14.893876 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771c28e-a9e7-4c17-b68c-99438b7383cd None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:14.894103 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771c28e-a9e7-4c17-b68c-99438b7383cd None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:14.894368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771c28e-a9e7-4c17-b68c-99438b7383cd None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:14.895125 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771c28e-a9e7-4c17-b68c-99438b7383cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:14.895431 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771c28e-a9e7-4c17-b68c-99438b7383cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:14.896950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771c28e-a9e7-4c17-b68c-99438b7383cd None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:14.915773 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 380/765] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:52:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:52:14.921619 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf5be6-d0fd-4cda-9933-1be33c428c8b None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:15.016163 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:15.059777 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf5be6-d0fd-4cda-9933-1be33c428c8b None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:15.096584 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e39c2c-99e2-4723-b903-8bc05dbeb479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:15.097184 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e39c2c-99e2-4723-b903-8bc05dbeb479 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:15.097457 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e39c2c-99e2-4723-b903-8bc05dbeb479 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:15.097725 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e39c2c-99e2-4723-b903-8bc05dbeb479 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:15.098472 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e39c2c-99e2-4723-b903-8bc05dbeb479 None admin] RBAC: Adding query filter params (role.id=b9c910c1c68948858203c62521b73efc, scope.project.id=f37c835c05924364bcd1530d44f024fe, user.id=eb9d1149a417436bbf1577d61407c0a9) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:15.098773 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e39c2c-99e2-4723-b903-8bc05dbeb479 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:15.100255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e39c2c-99e2-4723-b903-8bc05dbeb479 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:15.109880 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 386/766] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:52:14 2022] GET /identity/v3/role_assignments?user.id=eb9d1149a417436bbf1577d61407c0a9&scope.project.id=f37c835c05924364bcd1530d44f024fe&role.id=b9c910c1c68948858203c62521b73efc => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:15.512511 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e68a5-ca6a-44b3-a16f-73b24602331e None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:15.512511 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e68a5-ca6a-44b3-a16f-73b24602331e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:15.512511 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e68a5-ca6a-44b3-a16f-73b24602331e None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:15.513214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 381/767] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:15.519353 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab523d-8750-4d3b-a432-50195abdba0e None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:15.519932 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab523d-8750-4d3b-a432-50195abdba0e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:15.520405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab523d-8750-4d3b-a432-50195abdba0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:15.540534 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-3cab523d-8750-4d3b-a432-50195abdba0e None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:15.542206 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3cab523d-8750-4d3b-a432-50195abdba0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:15.628323 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 387/768] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:52:15.656640 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d3cc0-91a0-4d11-b1d9-b61b41ff064c None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:15.657248 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d3cc0-91a0-4d11-b1d9-b61b41ff064c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:15.657748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d3cc0-91a0-4d11-b1d9-b61b41ff064c None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:15.659537 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 382/769] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:15.664772 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8000f64-4463-46cd-a341-292768277c96 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:15.665059 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8000f64-4463-46cd-a341-292768277c96 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:15.665393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8000f64-4463-46cd-a341-292768277c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:15.691071 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-a8000f64-4463-46cd-a341-292768277c96 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:15.692250 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a8000f64-4463-46cd-a341-292768277c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:15.755778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:15.776324 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 388/770] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:52:15.935067 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d3cc0-91a0-4d11-b1d9-b61b41ff064c None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:15.969920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:16.096686 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9030b-b65c-4bd1-ad68-500cc8396e76 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:16.097216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9030b-b65c-4bd1-ad68-500cc8396e76 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:16.097216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9030b-b65c-4bd1-ad68-500cc8396e76 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:16.098052 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d3cc0-91a0-4d11-b1d9-b61b41ff064c None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:16.098733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 389/771] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 00:52:16.103685 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11cee6-4c7e-4d59-8cc1-5c3e2e828a09 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:16.103969 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11cee6-4c7e-4d59-8cc1-5c3e2e828a09 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:16.104240 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11cee6-4c7e-4d59-8cc1-5c3e2e828a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:16.122762 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ad11cee6-4c7e-4d59-8cc1-5c3e2e828a09 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:16.124511 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ad11cee6-4c7e-4d59-8cc1-5c3e2e828a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:16.142706 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6d541-ca99-4d0a-a617-c13d401f8259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:16.143719 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6d541-ca99-4d0a-a617-c13d401f8259 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:16.144199 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6d541-ca99-4d0a-a617-c13d401f8259 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:16.144666 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6d541-ca99-4d0a-a617-c13d401f8259 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:16.145919 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6d541-ca99-4d0a-a617-c13d401f8259 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:16.147807 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6d541-ca99-4d0a-a617-c13d401f8259 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:16.159570 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-8bc6d541-ca99-4d0a-a617-c13d401f8259 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 00:52:16.159570 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:16.159570 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 00:52:16.159570 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 00:52:16.159570 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 00:52:16.159570 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 00:52:16.159570 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 00:52:16.159570 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:16.159570 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 00:52:16.159570 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:16.159570 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:52:16.159570 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:16.159570 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:16.159570 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:16.159570 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:16.159570 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:16.159570 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:16.160553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:16.160553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:16.160553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:16.160553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:16.160553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:16.160553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:16.160553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 00:52:16.160553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 00:52:16.160553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 00:52:16.160553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 00:52:16.160553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:16.160553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:16.160553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:16.160553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:16.160553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:16.160553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:16.161395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:16.161395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:16.161395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:16.161395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:16.161395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:16.161395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:16.161395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:16.161395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:16.161395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:16.161395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:16.161395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 00:52:16.161395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:16.161395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 00:52:16.161395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:16.163277 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 383/772] 10.222.0.20 () {56 vars in 1129 bytes} [Wed Sep 14 00:52:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:16.169058 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6d541-ca99-4d0a-a617-c13d401f8259 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:16.219410 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 390/773] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:52:16.220650 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11cee6-4c7e-4d59-8cc1-5c3e2e828a09 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:16.290161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:16.335129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6d541-ca99-4d0a-a617-c13d401f8259 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:16.360253 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11cee6-4c7e-4d59-8cc1-5c3e2e828a09 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:16.375181 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:16.397757 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e64168-9692-41df-9404-e003bff237e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:16.398781 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e64168-9692-41df-9404-e003bff237e3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:16.399263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e64168-9692-41df-9404-e003bff237e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:16.399731 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e64168-9692-41df-9404-e003bff237e3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:16.400563 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e64168-9692-41df-9404-e003bff237e3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:16.402232 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e64168-9692-41df-9404-e003bff237e3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:16.412023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-c6e64168-9692-41df-9404-e003bff237e3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 00:52:16.412023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:16.412023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 00:52:16.412023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 00:52:16.412023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 00:52:16.412023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 00:52:16.412023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 00:52:16.412023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:16.412023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 00:52:16.412023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:16.412023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:52:16.412023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:16.412023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:16.412023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:16.412023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:16.412023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:16.412023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:16.413014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:16.413014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:16.413014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:16.413014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:16.413014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:16.413014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:16.413014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 00:52:16.413014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 00:52:16.413014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 00:52:16.413014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 00:52:16.413014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:16.413014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:16.413014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:16.413014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:16.413014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:16.413014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:16.413880 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:16.413880 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:16.413880 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:16.413880 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:16.413880 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:16.413880 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:16.413880 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:16.413880 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:16.413880 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:16.413880 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:16.413880 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 00:52:16.413880 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:16.413880 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 00:52:16.413880 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:16.415693 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444bde42-6ce2-4845-ba7e-a97f55ff2fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:16.416304 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bde42-6ce2-4845-ba7e-a97f55ff2fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:16.416578 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bde42-6ce2-4845-ba7e-a97f55ff2fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:16.416850 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bde42-6ce2-4845-ba7e-a97f55ff2fd5 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:16.417408 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 391/774] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:52:16 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:16.417510 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444bde42-6ce2-4845-ba7e-a97f55ff2fd5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:16.421987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444bde42-6ce2-4845-ba7e-a97f55ff2fd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:16.421987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444bde42-6ce2-4845-ba7e-a97f55ff2fd5 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:16.426568 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e64168-9692-41df-9404-e003bff237e3 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:16.437677 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 384/775] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Sep 14 00:52:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:16.450719 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444bde42-6ce2-4845-ba7e-a97f55ff2fd5 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:16.534532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e64168-9692-41df-9404-e003bff237e3 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:16.568838 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c83cc3-7448-4ffc-a975-7591957e061f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:16.569555 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c83cc3-7448-4ffc-a975-7591957e061f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:16.569922 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c83cc3-7448-4ffc-a975-7591957e061f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:16.570282 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c83cc3-7448-4ffc-a975-7591957e061f None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:16.570972 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c83cc3-7448-4ffc-a975-7591957e061f None admin] RBAC: Adding query filter params (name=network) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:16.571339 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c83cc3-7448-4ffc-a975-7591957e061f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:16.572767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c83cc3-7448-4ffc-a975-7591957e061f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:16.578722 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 392/776] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Sep 14 00:52:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:16.587446 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c83cc3-7448-4ffc-a975-7591957e061f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:16.638420 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:16.685578 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444bde42-6ce2-4845-ba7e-a97f55ff2fd5 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:16.700965 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c83cc3-7448-4ffc-a975-7591957e061f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:16.729944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097937f-db3e-4788-8815-f4be1c142a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:16.730576 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097937f-db3e-4788-8815-f4be1c142a64 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:16.730854 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097937f-db3e-4788-8815-f4be1c142a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:16.731123 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097937f-db3e-4788-8815-f4be1c142a64 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:16.731746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097937f-db3e-4788-8815-f4be1c142a64 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:16.732044 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097937f-db3e-4788-8815-f4be1c142a64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:16.733980 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097937f-db3e-4788-8815-f4be1c142a64 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:16.743835 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 385/777] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Sep 14 00:52:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:16.743835 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097937f-db3e-4788-8815-f4be1c142a64 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:16.747036 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcf010-b921-4786-b9bb-48247607b01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:16.747890 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcf010-b921-4786-b9bb-48247607b01d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:16.748979 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcf010-b921-4786-b9bb-48247607b01d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:16.749446 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcf010-b921-4786-b9bb-48247607b01d None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:16.749991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:16.751371 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcf010-b921-4786-b9bb-48247607b01d None admin] RBAC: Adding query filter params (type=network) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:16.751874 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcf010-b921-4786-b9bb-48247607b01d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:16.753666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcf010-b921-4786-b9bb-48247607b01d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:16.762208 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 393/778] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Sep 14 00:52:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:52:16.763206 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcf010-b921-4786-b9bb-48247607b01d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:16.851119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097937f-db3e-4788-8815-f4be1c142a64 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:16.884580 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcf010-b921-4786-b9bb-48247607b01d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:16.886037 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5d4c4-5bd1-4ea0-9ffd-a88e626c1d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:16.886734 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5d4c4-5bd1-4ea0-9ffd-a88e626c1d0e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:16.886917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5d4c4-5bd1-4ea0-9ffd-a88e626c1d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:16.887182 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5d4c4-5bd1-4ea0-9ffd-a88e626c1d0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:16.897706 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5d4c4-5bd1-4ea0-9ffd-a88e626c1d0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:52:16.902133 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:16.902915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-8bc5d4c4-5bd1-4ea0-9ffd-a88e626c1d0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:52:16.902915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:16.902915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:16.902915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:16.902915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:16.902915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:16.902915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:16.902915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:16.902915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:16.902915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:16.902915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:16.902915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:16.902915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:52:16.902915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:52:16.902915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:52:16.902915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:52:16.903813 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:52:16.903813 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:52:16.903813 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:52:16.903813 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:52:16.903813 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:16.903813 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:16.903813 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:16.903813 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:16.903813 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:16.903813 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:16.903813 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:16.903813 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:16.903813 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:16.903813 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:16.903813 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:16.903813 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:16.904924 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:16.904924 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:16.904924 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:16.904924 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:16.904924 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:52:16.904924 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:52:16.904924 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:52:16.904924 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:52:16.904924 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:52:16.904924 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:52:16.904924 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:52:16.904924 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:16.909221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 386/779] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:52:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:16.910047 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5d4c4-5bd1-4ea0-9ffd-a88e626c1d0e None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:16.930188 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9c156-314f-4755-b592-caabd2437adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:16.931531 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9c156-314f-4755-b592-caabd2437adc None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:16.932070 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9c156-314f-4755-b592-caabd2437adc None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:16.932560 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9c156-314f-4755-b592-caabd2437adc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:16.934054 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9c156-314f-4755-b592-caabd2437adc None admin] RBAC: Adding query filter params (interface=public, service_id=fabf2eafdce64338bc40ddb7b801bf3a, region_id=RegionOne) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:16.934576 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9c156-314f-4755-b592-caabd2437adc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:16.937111 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9c156-314f-4755-b592-caabd2437adc None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:16.954930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 394/780] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Sep 14 00:52:16 2022] GET /identity/v3/endpoints?service_id=fabf2eafdce64338bc40ddb7b801bf3a&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:16.954930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9c156-314f-4755-b592-caabd2437adc None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:16.984188 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:17.021479 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5d4c4-5bd1-4ea0-9ffd-a88e626c1d0e None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:17.058042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fd18e-e9e7-4311-b9da-eb0af47c84f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:17.058646 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fd18e-e9e7-4311-b9da-eb0af47c84f6 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:17.058922 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fd18e-e9e7-4311-b9da-eb0af47c84f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:17.059291 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fd18e-e9e7-4311-b9da-eb0af47c84f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:17.059988 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47fd18e-e9e7-4311-b9da-eb0af47c84f6 None admin] RBAC: Adding query filter params (interface=public, service_id=733a9b5ca6dc40b99fa8de2961329636, region_id=RegionOne) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:17.060399 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47fd18e-e9e7-4311-b9da-eb0af47c84f6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:17.061865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47fd18e-e9e7-4311-b9da-eb0af47c84f6 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:17.074603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 387/781] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Sep 14 00:52:16 2022] GET /identity/v3/endpoints?service_id=733a9b5ca6dc40b99fa8de2961329636&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:17.075504 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fd18e-e9e7-4311-b9da-eb0af47c84f6 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:17.076608 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9c156-314f-4755-b592-caabd2437adc None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:17.127251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2310b-cf8a-4274-9041-5fae5625e149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:17.128397 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2310b-cf8a-4274-9041-5fae5625e149 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:17.128685 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2310b-cf8a-4274-9041-5fae5625e149 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:17.128960 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2310b-cf8a-4274-9041-5fae5625e149 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:17.129942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2310b-cf8a-4274-9041-5fae5625e149 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:17.130253 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2310b-cf8a-4274-9041-5fae5625e149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:17.132312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2310b-cf8a-4274-9041-5fae5625e149 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:17.145194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 395/782] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:52:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:17.146170 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2310b-cf8a-4274-9041-5fae5625e149 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:17.190005 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:17.192649 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fd18e-e9e7-4311-b9da-eb0af47c84f6 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:17.225195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:17.232805 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129468f-6635-4c22-840c-16027e1ed6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:17.233530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129468f-6635-4c22-840c-16027e1ed6ee None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:17.233914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129468f-6635-4c22-840c-16027e1ed6ee None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:17.234253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129468f-6635-4c22-840c-16027e1ed6ee None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:17.234938 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129468f-6635-4c22-840c-16027e1ed6ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:17.236502 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129468f-6635-4c22-840c-16027e1ed6ee None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:17.242562 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 388/783] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Sep 14 00:52:17 2022] GET /identity/v3/services => generated 772 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:17.243282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129468f-6635-4c22-840c-16027e1ed6ee None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:17.284960 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2310b-cf8a-4274-9041-5fae5625e149 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:17.367219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540e7de-944c-4e1a-b835-7bcc4d209076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:17.367845 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540e7de-944c-4e1a-b835-7bcc4d209076 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:17.368119 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540e7de-944c-4e1a-b835-7bcc4d209076 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:17.368387 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540e7de-944c-4e1a-b835-7bcc4d209076 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:17.369000 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540e7de-944c-4e1a-b835-7bcc4d209076 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:17.370416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540e7de-944c-4e1a-b835-7bcc4d209076 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:17.388974 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 396/784] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Sep 14 00:52:17 2022] GET /identity/v3/services => generated 772 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:17.398161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129468f-6635-4c22-840c-16027e1ed6ee None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:17.452999 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc43cd-3830-438c-8515-c6e1e246730a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:17.453625 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc43cd-3830-438c-8515-c6e1e246730a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:17.453931 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc43cd-3830-438c-8515-c6e1e246730a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:17.454202 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc43cd-3830-438c-8515-c6e1e246730a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:17.472556 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc43cd-3830-438c-8515-c6e1e246730a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:17.474092 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc43cd-3830-438c-8515-c6e1e246730a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:17.491126 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-4afc43cd-3830-438c-8515-c6e1e246730a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:17.491126 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:17.491126 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:17.491126 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:17.491126 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:17.491126 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:17.491126 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:17.491126 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:17.491126 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:17.491126 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:17.491126 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:17.491126 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:17.491126 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:17.491126 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:17.491126 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:17.491126 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:17.493374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:17.493374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:17.493374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:17.493374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:17.493374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:17.493374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:17.493374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:17.493374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:17.493374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:17.493374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:17.493374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:17.493374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:17.493374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:17.493374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:17.493374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:17.493374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:17.493374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:17.495564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:17.495564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:17.495564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:17.495564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 389/785] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:17.503034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540e7de-944c-4e1a-b835-7bcc4d209076 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:17.627951 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:17.635077 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540e7de-944c-4e1a-b835-7bcc4d209076 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:17.649757 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96432dfa-0697-45dc-8109-aaf9fe24393a None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:17.650131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96432dfa-0697-45dc-8109-aaf9fe24393a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:17.650388 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96432dfa-0697-45dc-8109-aaf9fe24393a None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:17.651873 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 390/786] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:17.653083 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637349a-35c7-4f0e-9c98-e4826ce3eb4d None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:17.653573 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637349a-35c7-4f0e-9c98-e4826ce3eb4d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:17.654227 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637349a-35c7-4f0e-9c98-e4826ce3eb4d None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:17.656871 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 391/787] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:17.658405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63d37e-895e-4ff1-9c22-84287514e46f None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:17.658919 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63d37e-895e-4ff1-9c22-84287514e46f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:17.659694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63d37e-895e-4ff1-9c22-84287514e46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:17.678047 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907640e-1805-4f64-a13c-da74c22de08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:17.678634 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907640e-1805-4f64-a13c-da74c22de08d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:17.679843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907640e-1805-4f64-a13c-da74c22de08d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:17.679843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907640e-1805-4f64-a13c-da74c22de08d None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:17.679843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907640e-1805-4f64-a13c-da74c22de08d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:17.680102 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907640e-1805-4f64-a13c-da74c22de08d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:17.681413 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907640e-1805-4f64-a13c-da74c22de08d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:17.683203 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-ed63d37e-895e-4ff1-9c22-84287514e46f None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:17.684652 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ed63d37e-895e-4ff1-9c22-84287514e46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:17.700344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 397/788] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:17.700344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2107ec-a7b8-47f5-8993-81c04ed08fb8 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:17.700344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2107ec-a7b8-47f5-8993-81c04ed08fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:17.700344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2107ec-a7b8-47f5-8993-81c04ed08fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:17.718321 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-aa2107ec-a7b8-47f5-8993-81c04ed08fb8 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:17.720056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-aa2107ec-a7b8-47f5-8993-81c04ed08fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:17.731772 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:17.762967 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 392/789] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:52:17.770562 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63d37e-895e-4ff1-9c22-84287514e46f None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:17.831057 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 398/790] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:52:17.904863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63d37e-895e-4ff1-9c22-84287514e46f None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:17.945164 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81ea5d-310c-4529-9a09-d6b0e4487354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:17.945822 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81ea5d-310c-4529-9a09-d6b0e4487354 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:17.946101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81ea5d-310c-4529-9a09-d6b0e4487354 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:17.946371 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81ea5d-310c-4529-9a09-d6b0e4487354 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:17.955594 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c81ea5d-310c-4529-9a09-d6b0e4487354 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:17.957224 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c81ea5d-310c-4529-9a09-d6b0e4487354 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:17.969075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-8c81ea5d-310c-4529-9a09-d6b0e4487354 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 00:52:17.969075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:17.969075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:17.969075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:17.969075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:17.969075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:17.969075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:17.969075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:17.969075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:17.969075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:17.969075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:17.969075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:17.969075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:52:17.969075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:52:17.969075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:52:17.969075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:52:17.970221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:17.970221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:17.970221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:52:17.970221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:17.970221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:52:17.970221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:17.970221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:17.970221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:17.970221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:17.970221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:17.970221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:17.970221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:17.970221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:17.970221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:17.970221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:17.970221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:17.970221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:17.970221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:17.971359 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:17.971359 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:17.971359 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:52:17.971359 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:52:17.971359 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:52:17.971359 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:52:17.971359 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:52:17.971359 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:52:17.971359 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 00:52:17.971359 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:17.973544 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 393/791] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:52:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:17.979305 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2107ec-a7b8-47f5-8993-81c04ed08fb8 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:18.122976 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:18.139211 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2107ec-a7b8-47f5-8993-81c04ed08fb8 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:18.155482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81ea5d-310c-4529-9a09-d6b0e4487354 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:18.175680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b41788-096f-436c-9617-e60ef4490f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:18.176299 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b41788-096f-436c-9617-e60ef4490f97 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:18.176575 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b41788-096f-436c-9617-e60ef4490f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:18.176845 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b41788-096f-436c-9617-e60ef4490f97 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:18.177572 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b41788-096f-436c-9617-e60ef4490f97 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:18.177907 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b41788-096f-436c-9617-e60ef4490f97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:18.179327 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b41788-096f-436c-9617-e60ef4490f97 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:18.197764 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 399/792] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Sep 14 00:52:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:18.203569 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b41788-096f-436c-9617-e60ef4490f97 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:18.226223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:18.307415 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81ea5d-310c-4529-9a09-d6b0e4487354 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:18.317252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b41788-096f-436c-9617-e60ef4490f97 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:18.351355 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5773910-4c24-4388-a9e8-0928c64f853c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:18.352608 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5773910-4c24-4388-a9e8-0928c64f853c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:18.353292 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5773910-4c24-4388-a9e8-0928c64f853c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:18.353697 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb70fc0-3387-4bc9-a4e1-76cd1e3b1709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:18.353887 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5773910-4c24-4388-a9e8-0928c64f853c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:18.354696 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb70fc0-3387-4bc9-a4e1-76cd1e3b1709 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:18.355119 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb70fc0-3387-4bc9-a4e1-76cd1e3b1709 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:18.355646 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb70fc0-3387-4bc9-a4e1-76cd1e3b1709 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:18.366439 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5773910-4c24-4388-a9e8-0928c64f853c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:52:18.367039 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb70fc0-3387-4bc9-a4e1-76cd1e3b1709 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:18.368619 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb70fc0-3387-4bc9-a4e1-76cd1e3b1709 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:18.371861 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-a5773910-4c24-4388-a9e8-0928c64f853c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:52:18.371861 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:18.371861 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:18.371861 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:18.371861 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:18.371861 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:18.371861 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:18.371861 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:18.371861 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:18.371861 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:18.371861 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:18.371861 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:18.371861 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:52:18.371861 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:52:18.371861 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:52:18.371861 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:52:18.372998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:52:18.372998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:52:18.372998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:52:18.372998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:52:18.372998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:18.372998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:18.372998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:18.372998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:18.372998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:18.372998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:18.372998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:18.372998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:18.372998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:18.372998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:18.372998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:18.372998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:18.374068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:18.374068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:18.374068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:18.374068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:18.374068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:52:18.374068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:52:18.374068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:52:18.374068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:52:18.374068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:52:18.374068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:52:18.374068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:52:18.374068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:18.374068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 394/793] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 14 00:52:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:18.374835 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5773910-4c24-4388-a9e8-0928c64f853c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:18.388070 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-bdb70fc0-3387-4bc9-a4e1-76cd1e3b1709 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:18.388070 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:18.388070 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:18.388070 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:18.388070 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:18.388070 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:18.388070 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:18.388070 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:18.388070 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:18.388070 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:18.388070 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:18.388070 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:18.388070 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:18.388070 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:18.388070 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:18.388070 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:18.389835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:18.389835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:18.389835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:18.389835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:18.389835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:18.389835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:18.389835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:18.389835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:18.389835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:18.389835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:18.389835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:18.389835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:18.389835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:18.389835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:18.389835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:18.389835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:18.389835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:18.390772 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:18.390772 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:18.390772 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:18.392694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 400/794] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:52:18.397852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:18.398289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb70fc0-3387-4bc9-a4e1-76cd1e3b1709 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:18.495737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:18.501896 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5773910-4c24-4388-a9e8-0928c64f853c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:18.524537 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb70fc0-3387-4bc9-a4e1-76cd1e3b1709 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:18.538524 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46243e49-3242-4a0a-ae23-e7468b7ea298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:18.539153 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46243e49-3242-4a0a-ae23-e7468b7ea298 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:18.539423 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46243e49-3242-4a0a-ae23-e7468b7ea298 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:18.539706 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46243e49-3242-4a0a-ae23-e7468b7ea298 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:18.550825 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46243e49-3242-4a0a-ae23-e7468b7ea298 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:52:18.556402 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-46243e49-3242-4a0a-ae23-e7468b7ea298 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:52:18.556402 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:18.556402 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:18.556402 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:18.556402 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:18.556402 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:18.556402 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:18.556402 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:18.556402 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:18.556402 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:18.556402 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:18.556402 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:18.556402 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:52:18.556402 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:52:18.556402 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:52:18.556402 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:52:18.557514 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:52:18.557514 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:52:18.557514 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:52:18.557514 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:52:18.557514 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:18.557514 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:18.557514 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:18.557514 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:18.557514 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:18.557514 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:18.557514 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:18.557514 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:18.557514 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:18.557514 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:18.557514 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:18.557514 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:18.558564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:18.558564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:18.558564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:18.558564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:18.558564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:52:18.558564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:52:18.558564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:52:18.558564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:52:18.558564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:52:18.558564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:52:18.558564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:52:18.558564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:18.561948 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 395/795] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:52:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:18.563078 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46243e49-3242-4a0a-ae23-e7468b7ea298 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:18.568609 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4520d-2c14-4b05-a6e2-b900dc34fb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:18.569600 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4520d-2c14-4b05-a6e2-b900dc34fb77 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:18.570052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4520d-2c14-4b05-a6e2-b900dc34fb77 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:18.570519 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4520d-2c14-4b05-a6e2-b900dc34fb77 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:18.571368 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4520d-2c14-4b05-a6e2-b900dc34fb77 None admin] RBAC: Adding query filter params (name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:18.571824 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4520d-2c14-4b05-a6e2-b900dc34fb77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:18.573822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4520d-2c14-4b05-a6e2-b900dc34fb77 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:18.586174 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 401/796] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 14 00:52:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:18.591836 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4520d-2c14-4b05-a6e2-b900dc34fb77 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:18.662001 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:18.681727 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46243e49-3242-4a0a-ae23-e7468b7ea298 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:18.715593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4520d-2c14-4b05-a6e2-b900dc34fb77 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:18.727448 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a31134-4c35-4787-848a-4f0acb6ddf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:18.728709 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a31134-4c35-4787-848a-4f0acb6ddf26 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:18.729168 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a31134-4c35-4787-848a-4f0acb6ddf26 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:18.729887 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a31134-4c35-4787-848a-4f0acb6ddf26 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:18.730697 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a31134-4c35-4787-848a-4f0acb6ddf26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:18.731386 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a31134-4c35-4787-848a-4f0acb6ddf26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:18.734332 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a31134-4c35-4787-848a-4f0acb6ddf26 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:18.756686 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 396/797] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:18.758123 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a31134-4c35-4787-848a-4f0acb6ddf26 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:18.760052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60586c-2168-4b31-a45f-f2746b662599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:18.760730 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60586c-2168-4b31-a45f-f2746b662599 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:18.761071 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60586c-2168-4b31-a45f-f2746b662599 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:18.761407 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60586c-2168-4b31-a45f-f2746b662599 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:18.762458 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60586c-2168-4b31-a45f-f2746b662599 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:18.762841 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60586c-2168-4b31-a45f-f2746b662599 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:18.765503 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60586c-2168-4b31-a45f-f2746b662599 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:18.777894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 402/798] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:52:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:18.779015 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60586c-2168-4b31-a45f-f2746b662599 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:18.784701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:18.890023 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a31134-4c35-4787-848a-4f0acb6ddf26 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:18.902293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60586c-2168-4b31-a45f-f2746b662599 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:18.930184 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:18.935366 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c310eb-eab8-47c2-ad1b-98a8a7458f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:18.936160 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c310eb-eab8-47c2-ad1b-98a8a7458f48 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:18.936462 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c310eb-eab8-47c2-ad1b-98a8a7458f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:18.936755 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c310eb-eab8-47c2-ad1b-98a8a7458f48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:18.947691 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29992857-dfb9-44ae-a690-1db3f2138398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:18.947870 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c310eb-eab8-47c2-ad1b-98a8a7458f48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:18.948715 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29992857-dfb9-44ae-a690-1db3f2138398 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:18.949172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29992857-dfb9-44ae-a690-1db3f2138398 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:18.949511 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c310eb-eab8-47c2-ad1b-98a8a7458f48 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:18.949866 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29992857-dfb9-44ae-a690-1db3f2138398 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:18.958087 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29992857-dfb9-44ae-a690-1db3f2138398 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:18.959848 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29992857-dfb9-44ae-a690-1db3f2138398 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:18.965200 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-47c310eb-eab8-47c2-ad1b-98a8a7458f48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:18.965200 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:18.965200 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:18.965200 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:18.965200 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:18.965200 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:18.965200 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:18.965200 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:18.965200 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:18.965200 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:18.965200 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:18.965200 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:18.965200 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:18.965200 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:18.965200 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:18.965200 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:18.966174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:18.966174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:18.966174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:18.966174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:18.966174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:18.966174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:18.966174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:18.966174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:18.966174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:18.966174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:18.966174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:18.966174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:18.966174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:18.966174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:18.966174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:18.966174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:18.966174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:18.967731 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:18.967731 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:18.967731 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:18.967731 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 397/799] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:18.973058 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c310eb-eab8-47c2-ad1b-98a8a7458f48 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:18.989216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-29992857-dfb9-44ae-a690-1db3f2138398 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:18.989216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:18.989216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:18.989216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:18.989216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:18.989216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:18.989216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:18.989216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:18.989216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:18.989216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:18.989216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:18.989216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:18.989216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:52:18.989216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:52:18.989216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:52:18.990179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:52:18.990179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:18.990179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:18.990179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:18.990179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:18.990179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:18.990179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:18.990179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:18.990179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:18.990179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:18.990179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:18.990179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:18.990179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:18.990179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:18.990179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:18.990179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:18.990179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:18.991054 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:52:18.991054 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:52:18.991054 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:52:18.991054 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:52:18.991054 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:52:18.991054 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:52:18.991054 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:18.991054 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:18.991054 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 403/800] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:52:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:18.991054 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29992857-dfb9-44ae-a690-1db3f2138398 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:19.073312 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:19.110470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c310eb-eab8-47c2-ad1b-98a8a7458f48 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:19.116402 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29992857-dfb9-44ae-a690-1db3f2138398 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:19.146411 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07765d-cb85-4888-b67d-5fb54262cca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:19.147147 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07765d-cb85-4888-b67d-5fb54262cca4 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:19.147421 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07765d-cb85-4888-b67d-5fb54262cca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:19.147686 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07765d-cb85-4888-b67d-5fb54262cca4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:19.157226 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391db203-b76c-4386-bc9d-fe1e04b469cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:19.158447 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391db203-b76c-4386-bc9d-fe1e04b469cd None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:19.158931 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391db203-b76c-4386-bc9d-fe1e04b469cd None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:19.159275 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07765d-cb85-4888-b67d-5fb54262cca4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:19.159938 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391db203-b76c-4386-bc9d-fe1e04b469cd None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:19.160716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07765d-cb85-4888-b67d-5fb54262cca4 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:19.160992 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391db203-b76c-4386-bc9d-fe1e04b469cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:19.161655 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391db203-b76c-4386-bc9d-fe1e04b469cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:19.163905 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391db203-b76c-4386-bc9d-fe1e04b469cd None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:19.175799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-ae07765d-cb85-4888-b67d-5fb54262cca4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:19.175799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:19.175799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:19.175799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:19.175799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:19.175799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:19.175799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:19.175799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:19.175799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:19.175799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:19.175799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:19.175799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:19.175799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:19.175799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:19.175799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:19.175799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:19.176737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:19.176737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:19.176737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:19.176737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:19.176737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:19.176737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:19.176737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:19.176737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:19.176737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:19.176737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:19.176737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:19.176737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:19.176737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:19.176737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:19.176737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:19.176737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:19.176737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:19.177612 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:19.177612 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:19.177612 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:19.184090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 398/801] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:19.184090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07765d-cb85-4888-b67d-5fb54262cca4 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:19.184701 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 404/802] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:19.185794 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391db203-b76c-4386-bc9d-fe1e04b469cd None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:19.232855 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:19.294755 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07765d-cb85-4888-b67d-5fb54262cca4 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:19.307062 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391db203-b76c-4386-bc9d-fe1e04b469cd None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:19.317468 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:19.333720 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785e269-b469-4bc5-899d-1a5b1b38e8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:19.334280 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785e269-b469-4bc5-899d-1a5b1b38e8e5 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:19.334553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785e269-b469-4bc5-899d-1a5b1b38e8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:19.334820 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785e269-b469-4bc5-899d-1a5b1b38e8e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:19.335572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785e269-b469-4bc5-899d-1a5b1b38e8e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:19.335873 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785e269-b469-4bc5-899d-1a5b1b38e8e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:19.337310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785e269-b469-4bc5-899d-1a5b1b38e8e5 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:19.356179 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 399/803] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:52:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:19.356179 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785e269-b469-4bc5-899d-1a5b1b38e8e5 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:19.356425 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db191ec-96bc-4b85-b36a-aedb155a5314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:19.356425 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db191ec-96bc-4b85-b36a-aedb155a5314 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:19.356425 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db191ec-96bc-4b85-b36a-aedb155a5314 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:19.356425 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db191ec-96bc-4b85-b36a-aedb155a5314 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:19.356723 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db191ec-96bc-4b85-b36a-aedb155a5314 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:19.356723 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db191ec-96bc-4b85-b36a-aedb155a5314 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:19.358251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db191ec-96bc-4b85-b36a-aedb155a5314 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:19.377308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 405/804] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:19.377308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db191ec-96bc-4b85-b36a-aedb155a5314 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:19.478055 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:19.481969 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db191ec-96bc-4b85-b36a-aedb155a5314 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:19.489499 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785e269-b469-4bc5-899d-1a5b1b38e8e5 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:19.526663 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de9bfd-cf24-4044-83fa-d5abc81611f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:19.527666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de9bfd-cf24-4044-83fa-d5abc81611f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:19.527901 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31ff60-ae00-4d57-9ae4-c438324b9a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:19.528289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de9bfd-cf24-4044-83fa-d5abc81611f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:19.528705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31ff60-ae00-4d57-9ae4-c438324b9a1f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:19.528839 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de9bfd-cf24-4044-83fa-d5abc81611f2 None admin] PATH_INFO: `/v3/projects/f37c835c05924364bcd1530d44f024fe/users/c8d05652bfe542d5a2cfa39fbf7a83c9/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:19.529143 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31ff60-ae00-4d57-9ae4-c438324b9a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:19.530297 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31ff60-ae00-4d57-9ae4-c438324b9a1f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:19.532524 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de9bfd-cf24-4044-83fa-d5abc81611f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f37c835c05924364bcd1530d44f024fe, user_id=c8d05652bfe542d5a2cfa39fbf7a83c9, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:19.534899 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de9bfd-cf24-4044-83fa-d5abc81611f2 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:19.538747 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31ff60-ae00-4d57-9ae4-c438324b9a1f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:19.540409 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31ff60-ae00-4d57-9ae4-c438324b9a1f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:19.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-bd31ff60-ae00-4d57-9ae4-c438324b9a1f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 00:52:19.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:19.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:19.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:19.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:19.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:19.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:19.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:19.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:19.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:19.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:19.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:19.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:52:19.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:52:19.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:52:19.557830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:52:19.558812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:19.558812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:19.558812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:52:19.558812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:19.558812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:52:19.558812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:19.558812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:19.558812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:19.558812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:19.558812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:19.558812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:19.558812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:19.558812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:19.558812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:19.558812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:19.558812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:19.558812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:19.558812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:19.559746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:19.559746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:19.559746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:52:19.559746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:52:19.559746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:52:19.559746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:52:19.559746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:52:19.559746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:52:19.559746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 00:52:19.559746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:19.560278 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 400/806] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Sep 14 00:52:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:19.561141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 406/806] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 14 00:52:19 2022] PUT /identity/v3/projects/f37c835c05924364bcd1530d44f024fe/users/c8d05652bfe542d5a2cfa39fbf7a83c9/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 00:52:19.562441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31ff60-ae00-4d57-9ae4-c438324b9a1f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:19.564292 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de9bfd-cf24-4044-83fa-d5abc81611f2 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:19.639556 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:19.705923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31ff60-ae00-4d57-9ae4-c438324b9a1f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:19.744648 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f041307-9b51-42ca-9d45-d88967b916b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:19.745485 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f041307-9b51-42ca-9d45-d88967b916b9 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:19.745895 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f041307-9b51-42ca-9d45-d88967b916b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:19.746255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f041307-9b51-42ca-9d45-d88967b916b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:19.756117 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f041307-9b51-42ca-9d45-d88967b916b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:19.757729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f041307-9b51-42ca-9d45-d88967b916b9 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:19.770908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-2f041307-9b51-42ca-9d45-d88967b916b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 00:52:19.770908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:19.770908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:19.770908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:19.770908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:19.770908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:19.770908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:19.770908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:19.770908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:19.770908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:19.770908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:19.770908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:19.770908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:52:19.770908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:52:19.770908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:52:19.770908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:52:19.771902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:19.771902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:19.771902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:52:19.771902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:19.771902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:52:19.771902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:19.771902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:19.771902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:19.771902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:19.771902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:19.771902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:19.771902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:19.771902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:19.771902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:19.771902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:19.771902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:19.771902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:19.771902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:19.772854 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:19.772854 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:19.772854 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:52:19.772854 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:52:19.772854 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:52:19.772854 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:52:19.772854 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:52:19.772854 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:52:19.772854 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 00:52:19.772854 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:19.772854 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 401/807] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Sep 14 00:52:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:19.779993 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f041307-9b51-42ca-9d45-d88967b916b9 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:19.819779 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de9bfd-cf24-4044-83fa-d5abc81611f2 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:19.863863 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1deff0-c7f3-4b49-a4ed-e522b4986095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:19.864472 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1deff0-c7f3-4b49-a4ed-e522b4986095 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:19.864817 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1deff0-c7f3-4b49-a4ed-e522b4986095 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:19.865088 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1deff0-c7f3-4b49-a4ed-e522b4986095 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:19.866042 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1deff0-c7f3-4b49-a4ed-e522b4986095 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:19.866276 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1deff0-c7f3-4b49-a4ed-e522b4986095 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:19.867650 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1deff0-c7f3-4b49-a4ed-e522b4986095 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:19.891961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 407/808] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Sep 14 00:52:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:19.893212 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f1e8b-f0e9-4d51-be95-87704244ff01 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:19.893497 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f1e8b-f0e9-4d51-be95-87704244ff01 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:19.893832 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f1e8b-f0e9-4d51-be95-87704244ff01 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:19.895418 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 408/809] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:19.901425 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f1e8b-f0e9-4d51-be95-87704244ff01 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:19.919384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:19.935380 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:19.939737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f041307-9b51-42ca-9d45-d88967b916b9 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:19.987544 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3d03d-3a46-42fc-b902-04c444da00d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:19.988533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3d03d-3a46-42fc-b902-04c444da00d3 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:19.988815 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3d03d-3a46-42fc-b902-04c444da00d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:19.989089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3d03d-3a46-42fc-b902-04c444da00d3 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:19.990015 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3d03d-3a46-42fc-b902-04c444da00d3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:19.990322 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3d03d-3a46-42fc-b902-04c444da00d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:19.992301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3d03d-3a46-42fc-b902-04c444da00d3 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:20.014729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 402/810] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Sep 14 00:52:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:20.015982 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce27bd-fd9a-48f5-816a-7a1184853ef1 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:20.016269 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce27bd-fd9a-48f5-816a-7a1184853ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:20.016538 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce27bd-fd9a-48f5-816a-7a1184853ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:20.031862 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f1e8b-f0e9-4d51-be95-87704244ff01 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:20.034587 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-09ce27bd-fd9a-48f5-816a-7a1184853ef1 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:20.035768 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-09ce27bd-fd9a-48f5-816a-7a1184853ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:20.068347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d419da-49d2-4da1-91b6-1c00422315b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:20.069243 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d419da-49d2-4da1-91b6-1c00422315b3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:20.069524 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d419da-49d2-4da1-91b6-1c00422315b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:20.069820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d419da-49d2-4da1-91b6-1c00422315b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:20.080752 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d419da-49d2-4da1-91b6-1c00422315b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:20.082206 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d419da-49d2-4da1-91b6-1c00422315b3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:20.097533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-67d419da-49d2-4da1-91b6-1c00422315b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:20.097533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:20.097533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:20.097533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:20.097533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:20.097533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:20.097533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:20.097533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:20.097533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:20.097533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:20.097533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:20.097533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:20.097533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:20.097533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:20.097533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:20.097533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:20.098532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:20.098532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:20.098532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:20.098532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:20.098532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:20.098532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:20.098532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:20.098532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:20.098532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:20.098532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:20.098532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:20.098532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:20.098532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:20.098532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:20.098532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:20.098532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:20.098532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:20.099405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:20.099405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:20.099405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:20.099405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 409/811] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:20.100317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966ca28-f4d6-4468-b020-f0dcd8f277f1 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:20.100317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966ca28-f4d6-4468-b020-f0dcd8f277f1 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:20.100489 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966ca28-f4d6-4468-b020-f0dcd8f277f1 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:20.101686 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 410/812] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:20.102284 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966ca28-f4d6-4468-b020-f0dcd8f277f1 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:20.112171 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 403/813] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:52:20.112871 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce27bd-fd9a-48f5-816a-7a1184853ef1 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:20.191797 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:20.210634 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:20.224082 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce27bd-fd9a-48f5-816a-7a1184853ef1 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:20.231280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966ca28-f4d6-4468-b020-f0dcd8f277f1 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:20.272349 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91952a00-156f-4304-8cdd-fec708ab350c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:20.272961 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91952a00-156f-4304-8cdd-fec708ab350c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:20.273236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91952a00-156f-4304-8cdd-fec708ab350c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:20.273501 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91952a00-156f-4304-8cdd-fec708ab350c None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:20.274187 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91952a00-156f-4304-8cdd-fec708ab350c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:20.274486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91952a00-156f-4304-8cdd-fec708ab350c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:20.275511 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c8244-e2f6-4aff-b959-e8ab0f6a44c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:20.275866 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91952a00-156f-4304-8cdd-fec708ab350c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:20.276539 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c8244-e2f6-4aff-b959-e8ab0f6a44c6 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:20.277016 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c8244-e2f6-4aff-b959-e8ab0f6a44c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:20.277925 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c8244-e2f6-4aff-b959-e8ab0f6a44c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:20.299904 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 404/814] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:20.301344 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43392939-eb7d-475c-92af-01c7b9647a81 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:20.301627 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43392939-eb7d-475c-92af-01c7b9647a81 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:20.302237 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43392939-eb7d-475c-92af-01c7b9647a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:20.322220 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-43392939-eb7d-475c-92af-01c7b9647a81 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:20.323398 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-43392939-eb7d-475c-92af-01c7b9647a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:20.361642 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c8244-e2f6-4aff-b959-e8ab0f6a44c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:20.363857 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c8244-e2f6-4aff-b959-e8ab0f6a44c6 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:20.398839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 405/815] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:52:20.399763 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43392939-eb7d-475c-92af-01c7b9647a81 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:20.446082 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:20.489606 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 411/816] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:52:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 00:52:20.489606 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c8244-e2f6-4aff-b959-e8ab0f6a44c6 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:20.504894 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:20.534313 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43392939-eb7d-475c-92af-01c7b9647a81 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:20.583685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914933e-682b-4bbf-8bdf-1d8445ec456d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:20.584338 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914933e-682b-4bbf-8bdf-1d8445ec456d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:20.584613 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914933e-682b-4bbf-8bdf-1d8445ec456d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:20.584875 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914933e-682b-4bbf-8bdf-1d8445ec456d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:20.594021 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914933e-682b-4bbf-8bdf-1d8445ec456d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:20.597553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914933e-682b-4bbf-8bdf-1d8445ec456d None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:20.614069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-2914933e-682b-4bbf-8bdf-1d8445ec456d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:20.614069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:20.614069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:20.614069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:20.614069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:20.614069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:20.614069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:20.614069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:20.614069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:20.614069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:20.614069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:20.614069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:20.614069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:52:20.614069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:52:20.614069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:52:20.614982 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:52:20.614982 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:20.614982 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:20.614982 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:20.614982 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:20.614982 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:20.614982 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:20.614982 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:20.614982 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:20.614982 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:20.614982 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:20.614982 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:20.614982 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:20.614982 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:20.614982 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:20.614982 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:20.614982 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:20.615900 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:52:20.615900 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:52:20.615900 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:52:20.615900 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:52:20.615900 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:52:20.615900 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:52:20.615900 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:20.615900 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:20.618526 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c8244-e2f6-4aff-b959-e8ab0f6a44c6 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:20.620175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 406/817] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:52:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:20.621545 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914933e-682b-4bbf-8bdf-1d8445ec456d None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:20.657790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147f72d-905e-4670-96a5-975bd9cf1ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:20.659067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147f72d-905e-4670-96a5-975bd9cf1ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:20.659578 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147f72d-905e-4670-96a5-975bd9cf1ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:20.660061 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147f72d-905e-4670-96a5-975bd9cf1ab8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:20.660838 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147f72d-905e-4670-96a5-975bd9cf1ab8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:20.662453 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147f72d-905e-4670-96a5-975bd9cf1ab8 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:20.672799 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-c147f72d-905e-4670-96a5-975bd9cf1ab8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 00:52:20.672799 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:20.672799 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 00:52:20.672799 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 00:52:20.672799 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 00:52:20.672799 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 00:52:20.672799 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 00:52:20.672799 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:20.672799 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 00:52:20.672799 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:20.672799 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:52:20.672799 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:20.672799 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:20.672799 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:20.672799 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:20.672799 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:20.672799 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:20.673778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:20.673778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:20.673778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:20.673778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:20.673778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:20.673778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:20.673778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 00:52:20.673778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 00:52:20.673778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 00:52:20.673778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 00:52:20.673778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:20.673778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:20.673778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:20.673778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:20.673778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:20.673778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:20.674666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:20.674666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:20.674666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:20.674666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:20.674666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:20.674666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:20.674666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:20.674666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:20.674666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:20.674666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:20.674666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 00:52:20.674666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:20.674666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 00:52:20.674666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:20.677045 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 412/818] 10.222.0.20 () {56 vars in 1129 bytes} [Wed Sep 14 00:52:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:20.678130 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147f72d-905e-4670-96a5-975bd9cf1ab8 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:20.716395 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:20.739546 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914933e-682b-4bbf-8bdf-1d8445ec456d None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:20.772831 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195acef-5ad4-4dd9-85f3-db94fdd08bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:20.773470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195acef-5ad4-4dd9-85f3-db94fdd08bfc None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:20.773744 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195acef-5ad4-4dd9-85f3-db94fdd08bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:20.774049 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195acef-5ad4-4dd9-85f3-db94fdd08bfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:20.781598 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:20.785863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195acef-5ad4-4dd9-85f3-db94fdd08bfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:20.787661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195acef-5ad4-4dd9-85f3-db94fdd08bfc None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:20.788938 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147f72d-905e-4670-96a5-975bd9cf1ab8 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:20.803629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-8195acef-5ad4-4dd9-85f3-db94fdd08bfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:20.803629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:20.803629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:20.803629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:20.803629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:20.803629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:20.803629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:20.803629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:20.803629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:20.803629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:20.803629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:20.803629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:20.803629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:20.803629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:20.803629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:20.803629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:20.804593 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:20.804593 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:20.804593 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:20.804593 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:20.804593 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:20.804593 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:20.804593 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:20.804593 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:20.804593 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:20.804593 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:20.804593 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:20.804593 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:20.804593 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:20.804593 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:20.804593 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:20.804593 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:20.804593 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:20.805507 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:20.805507 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:20.805507 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:20.806942 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 407/819] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:20.807862 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195acef-5ad4-4dd9-85f3-db94fdd08bfc None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:20.829036 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa332a5-877e-4d66-bb22-450a70cd61a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:20.829691 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa332a5-877e-4d66-bb22-450a70cd61a5 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:20.829995 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa332a5-877e-4d66-bb22-450a70cd61a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:20.830262 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa332a5-877e-4d66-bb22-450a70cd61a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:20.831385 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa332a5-877e-4d66-bb22-450a70cd61a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:20.831842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa332a5-877e-4d66-bb22-450a70cd61a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:20.833307 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa332a5-877e-4d66-bb22-450a70cd61a5 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:20.845593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 413/820] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:52:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:20.850690 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa332a5-877e-4d66-bb22-450a70cd61a5 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:20.916098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195acef-5ad4-4dd9-85f3-db94fdd08bfc None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:20.948099 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:20.952899 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a2e89-f4fe-4384-b270-7cb84f16191b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:20.953519 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a2e89-f4fe-4384-b270-7cb84f16191b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:20.953790 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a2e89-f4fe-4384-b270-7cb84f16191b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:20.954119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a2e89-f4fe-4384-b270-7cb84f16191b None admin] PATH_INFO: `/v3/services/network` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:20.954699 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a2e89-f4fe-4384-b270-7cb84f16191b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:20.956144 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a2e89-f4fe-4384-b270-7cb84f16191b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:20.957109 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa332a5-877e-4d66-bb22-450a70cd61a5 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:20.965113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-409a2e89-f4fe-4384-b270-7cb84f16191b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 00:52:20.965113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:20.965113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 00:52:20.965113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 00:52:20.965113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 00:52:20.965113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 00:52:20.965113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 00:52:20.965113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:20.965113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 00:52:20.965113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:20.965113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:52:20.965113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:20.965113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:20.965113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:20.965113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:20.965113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:20.965113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:20.966219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:20.966219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:20.966219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:20.966219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:20.966219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:20.966219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:20.966219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 00:52:20.966219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 00:52:20.966219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 00:52:20.966219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 00:52:20.966219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:20.966219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:20.966219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:20.966219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:20.966219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:20.966219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:20.967825 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:20.967825 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:20.967825 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:20.967825 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:20.967825 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:20.967825 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:20.967825 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:20.967825 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:20.967825 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:20.967825 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:20.967825 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 00:52:20.967825 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:20.967825 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 00:52:20.967825 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:20.967825 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 408/821] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:52:20 2022] GET /identity/v3/services/network => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:20.969225 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a2e89-f4fe-4384-b270-7cb84f16191b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:21.001821 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d08f06-c461-47ad-a8c9-c1166866bae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:21.002356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d08f06-c461-47ad-a8c9-c1166866bae4 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:21.002712 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d08f06-c461-47ad-a8c9-c1166866bae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:21.002996 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d08f06-c461-47ad-a8c9-c1166866bae4 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:21.003614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d08f06-c461-47ad-a8c9-c1166866bae4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:21.003910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d08f06-c461-47ad-a8c9-c1166866bae4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:21.005255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d08f06-c461-47ad-a8c9-c1166866bae4 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:21.014283 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 414/822] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Sep 14 00:52:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:21.014283 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d08f06-c461-47ad-a8c9-c1166866bae4 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:21.038481 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:21.084595 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a2e89-f4fe-4384-b270-7cb84f16191b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:21.114485 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d08f06-c461-47ad-a8c9-c1166866bae4 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:21.119565 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975b2f8-bc90-41e7-8500-435c8d54335a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:21.120165 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975b2f8-bc90-41e7-8500-435c8d54335a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:21.120441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975b2f8-bc90-41e7-8500-435c8d54335a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:21.120710 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975b2f8-bc90-41e7-8500-435c8d54335a None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:21.121340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975b2f8-bc90-41e7-8500-435c8d54335a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:21.121643 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975b2f8-bc90-41e7-8500-435c8d54335a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:21.123560 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975b2f8-bc90-41e7-8500-435c8d54335a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:21.141277 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 409/823] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:21.142150 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975b2f8-bc90-41e7-8500-435c8d54335a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:21.148563 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556624e-9393-4bad-bd3b-cfae4a9a63e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:21.149212 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556624e-9393-4bad-bd3b-cfae4a9a63e0 None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:21.149487 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556624e-9393-4bad-bd3b-cfae4a9a63e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:21.149755 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556624e-9393-4bad-bd3b-cfae4a9a63e0 None admin] PATH_INFO: `/v3/projects/f37c835c05924364bcd1530d44f024fe/users/eb9d1149a417436bbf1577d61407c0a9/roles/b9c910c1c68948858203c62521b73efc` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:21.165270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556624e-9393-4bad-bd3b-cfae4a9a63e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f37c835c05924364bcd1530d44f024fe, user_id=eb9d1149a417436bbf1577d61407c0a9, role_id=b9c910c1c68948858203c62521b73efc)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:21.166712 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556624e-9393-4bad-bd3b-cfae4a9a63e0 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:21.179843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 415/824] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 14 00:52:21 2022] PUT /identity/v3/projects/f37c835c05924364bcd1530d44f024fe/users/eb9d1149a417436bbf1577d61407c0a9/roles/b9c910c1c68948858203c62521b73efc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 00:52:21.180630 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556624e-9393-4bad-bd3b-cfae4a9a63e0 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:21.194787 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:21.314897 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556624e-9393-4bad-bd3b-cfae4a9a63e0 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:21.371490 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681eae1a-bcef-48e0-bc61-4d7c6df71e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:21.372368 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eae1a-bcef-48e0-bc61-4d7c6df71e90 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:21.372649 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eae1a-bcef-48e0-bc61-4d7c6df71e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:21.372933 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eae1a-bcef-48e0-bc61-4d7c6df71e90 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:21.373598 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681eae1a-bcef-48e0-bc61-4d7c6df71e90 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:21.374492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681eae1a-bcef-48e0-bc61-4d7c6df71e90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:21.375297 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681eae1a-bcef-48e0-bc61-4d7c6df71e90 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:21.381624 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 416/825] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Sep 14 00:52:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:21.382491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681eae1a-bcef-48e0-bc61-4d7c6df71e90 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:21.392813 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975b2f8-bc90-41e7-8500-435c8d54335a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:21.410497 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:21.439628 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c2f19-3839-44d1-9f65-a943d69a3a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:21.440718 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c2f19-3839-44d1-9f65-a943d69a3a57 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:21.440997 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c2f19-3839-44d1-9f65-a943d69a3a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:21.441265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c2f19-3839-44d1-9f65-a943d69a3a57 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:21.441928 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c2f19-3839-44d1-9f65-a943d69a3a57 None admin] RBAC: Adding query filter params (name=network) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:21.442231 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c2f19-3839-44d1-9f65-a943d69a3a57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:21.444273 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c2f19-3839-44d1-9f65-a943d69a3a57 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:21.450847 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 410/826] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Sep 14 00:52:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:21.452211 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c2f19-3839-44d1-9f65-a943d69a3a57 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:21.481870 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:21.525433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681eae1a-bcef-48e0-bc61-4d7c6df71e90 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:21.567799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c2f19-3839-44d1-9f65-a943d69a3a57 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:21.572510 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c712213-a918-4810-850d-62b89e5bb88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:21.573150 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c712213-a918-4810-850d-62b89e5bb88f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:21.573428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c712213-a918-4810-850d-62b89e5bb88f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:21.573703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c712213-a918-4810-850d-62b89e5bb88f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:21.583768 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c712213-a918-4810-850d-62b89e5bb88f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:21.585958 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c712213-a918-4810-850d-62b89e5bb88f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:21.602852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-1c712213-a918-4810-850d-62b89e5bb88f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:21.602852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:21.602852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:21.602852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:21.602852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:21.602852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:21.602852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:21.602852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:21.602852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:21.602852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:21.602852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:21.602852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:21.602852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:52:21.602852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:52:21.602852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:52:21.603791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:52:21.603791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:21.603791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:21.603791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:21.603791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:21.603791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:21.603791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:21.603791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:21.603791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:21.603791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:21.603791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:21.603791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:21.603791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:21.603791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:21.603791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:21.603791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:21.603791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:21.604658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:52:21.604658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:52:21.604658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:52:21.604658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:52:21.604658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:52:21.604658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:52:21.604658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:21.604658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:21.605085 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe672d83-7001-41c8-ba21-e44f5b8939cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:21.605085 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe672d83-7001-41c8-ba21-e44f5b8939cc None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:21.605085 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe672d83-7001-41c8-ba21-e44f5b8939cc None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:21.605085 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe672d83-7001-41c8-ba21-e44f5b8939cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:21.605347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 417/827] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:52:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:21.605416 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe672d83-7001-41c8-ba21-e44f5b8939cc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:21.605483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c712213-a918-4810-850d-62b89e5bb88f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:21.610657 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe672d83-7001-41c8-ba21-e44f5b8939cc None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:21.633005 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 411/828] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 00:52:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:52:21.633995 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe672d83-7001-41c8-ba21-e44f5b8939cc None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:21.729332 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:21.759745 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c712213-a918-4810-850d-62b89e5bb88f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:21.830281 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:21.864168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387178f-6fc1-44e5-b1de-83a7024628eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:21.864783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387178f-6fc1-44e5-b1de-83a7024628eb None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:21.865064 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387178f-6fc1-44e5-b1de-83a7024628eb None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:21.865336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387178f-6fc1-44e5-b1de-83a7024628eb None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:21.865995 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387178f-6fc1-44e5-b1de-83a7024628eb None admin] RBAC: Adding query filter params (type=network) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:21.866297 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387178f-6fc1-44e5-b1de-83a7024628eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:21.868225 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387178f-6fc1-44e5-b1de-83a7024628eb None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:21.877186 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 418/829] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Sep 14 00:52:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:21.882735 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387178f-6fc1-44e5-b1de-83a7024628eb None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:21.885934 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe672d83-7001-41c8-ba21-e44f5b8939cc None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:21.936086 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fc2ec-010b-4287-bfeb-228dc2ddbeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:21.936693 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fc2ec-010b-4287-bfeb-228dc2ddbeb7 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:21.937009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fc2ec-010b-4287-bfeb-228dc2ddbeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:21.937274 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fc2ec-010b-4287-bfeb-228dc2ddbeb7 None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:21.938102 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92fc2ec-010b-4287-bfeb-228dc2ddbeb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:21.938560 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92fc2ec-010b-4287-bfeb-228dc2ddbeb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:21.940807 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92fc2ec-010b-4287-bfeb-228dc2ddbeb7 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:21.955747 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 412/830] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:52:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:21.957068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7674f-2806-4c80-93b8-e970c805fa45 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:21.957342 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7674f-2806-4c80-93b8-e970c805fa45 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:21.957611 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7674f-2806-4c80-93b8-e970c805fa45 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:21.961929 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 413/831] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:21.963646 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7674f-2806-4c80-93b8-e970c805fa45 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:22.009622 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387178f-6fc1-44e5-b1de-83a7024628eb None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:22.047847 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441962a0-45c1-4400-aab6-11bab89235d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:22.049562 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441962a0-45c1-4400-aab6-11bab89235d7 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:22.050076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441962a0-45c1-4400-aab6-11bab89235d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:22.050545 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441962a0-45c1-4400-aab6-11bab89235d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:22.051438 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441962a0-45c1-4400-aab6-11bab89235d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:22.053012 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441962a0-45c1-4400-aab6-11bab89235d7 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:22.086098 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 419/832] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 00:52:21 2022] POST /identity/v3/endpoints => generated 337 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:52:22.086775 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:22.087606 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe74ba2-f4ae-4143-8e8b-fe909d5f63f6 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:22.087833 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe74ba2-f4ae-4143-8e8b-fe909d5f63f6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:22.088283 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe74ba2-f4ae-4143-8e8b-fe909d5f63f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:22.116565 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7674f-2806-4c80-93b8-e970c805fa45 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:22.131018 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-bbe74ba2-f4ae-4143-8e8b-fe909d5f63f6 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:22.132250 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-bbe74ba2-f4ae-4143-8e8b-fe909d5f63f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:22.155890 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d380db8-5b07-4eb3-9977-b760aeaad4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:22.156507 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d380db8-5b07-4eb3-9977-b760aeaad4f9 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:22.156782 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d380db8-5b07-4eb3-9977-b760aeaad4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:22.157054 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d380db8-5b07-4eb3-9977-b760aeaad4f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:22.157917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d380db8-5b07-4eb3-9977-b760aeaad4f9 None admin] RBAC: Adding query filter params (role.id=0d7a36bda723430eae02f10f4c775c96, scope.project.id=f37c835c05924364bcd1530d44f024fe, user.id=c05caac9e8b9498583780306887734be) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:22.158227 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d380db8-5b07-4eb3-9977-b760aeaad4f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:22.159871 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d380db8-5b07-4eb3-9977-b760aeaad4f9 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:22.170084 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 414/833] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:52:21 2022] GET /identity/v3/role_assignments?user.id=c05caac9e8b9498583780306887734be&scope.project.id=f37c835c05924364bcd1530d44f024fe&role.id=0d7a36bda723430eae02f10f4c775c96 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:22.211739 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:22.250313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 420/834] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:22 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:52:22.568214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d380db8-5b07-4eb3-9977-b760aeaad4f9 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:22.678063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d380db8-5b07-4eb3-9977-b760aeaad4f9 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:22.713619 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525abb0-5435-4932-be8a-ec4dcb95a35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:22.714608 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525abb0-5435-4932-be8a-ec4dcb95a35a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:22.715082 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525abb0-5435-4932-be8a-ec4dcb95a35a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:22.715545 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525abb0-5435-4932-be8a-ec4dcb95a35a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:22.726725 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525abb0-5435-4932-be8a-ec4dcb95a35a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:52:22.731750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-8525abb0-5435-4932-be8a-ec4dcb95a35a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:52:22.731750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:22.731750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:22.731750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:22.731750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:22.731750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:22.731750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:22.731750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:22.731750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:22.731750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:22.731750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:22.731750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:22.731750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:52:22.731750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:52:22.731750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:52:22.731750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:52:22.733175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:52:22.733175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:52:22.733175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:52:22.733175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:52:22.733175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:22.733175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:22.733175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:22.733175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:22.733175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:22.733175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:22.733175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:22.733175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:22.733175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:22.733175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:22.733175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:22.733175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:22.734038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:22.734038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:22.734038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:22.734038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:22.734038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:52:22.734038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:52:22.734038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:52:22.734038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:52:22.734038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:52:22.734038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:52:22.734038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:52:22.734038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:22.736578 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 415/835] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:52:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:22.743743 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe74ba2-f4ae-4143-8e8b-fe909d5f63f6 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:22.849063 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe74ba2-f4ae-4143-8e8b-fe909d5f63f6 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:22.887588 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa18cb-20cc-4218-b590-a35d6340bf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:22.888189 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa18cb-20cc-4218-b590-a35d6340bf94 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:22.888466 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa18cb-20cc-4218-b590-a35d6340bf94 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:22.889271 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa18cb-20cc-4218-b590-a35d6340bf94 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:22.889951 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa18cb-20cc-4218-b590-a35d6340bf94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:22.890256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa18cb-20cc-4218-b590-a35d6340bf94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:22.891602 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa18cb-20cc-4218-b590-a35d6340bf94 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:22.899921 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 421/836] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:52:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:22.905769 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525abb0-5435-4932-be8a-ec4dcb95a35a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:22.924295 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:23.017423 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525abb0-5435-4932-be8a-ec4dcb95a35a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:23.053127 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d444f-498c-4c47-9783-f1fb352b4416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:23.053745 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d444f-498c-4c47-9783-f1fb352b4416 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:23.054048 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d444f-498c-4c47-9783-f1fb352b4416 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:23.054316 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d444f-498c-4c47-9783-f1fb352b4416 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:23.065964 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d444f-498c-4c47-9783-f1fb352b4416 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:23.067401 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d444f-498c-4c47-9783-f1fb352b4416 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:23.081701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-0b2d444f-498c-4c47-9783-f1fb352b4416 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:23.081701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:23.081701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:23.081701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:23.081701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:23.081701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:23.081701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:23.081701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:23.081701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:23.081701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:23.081701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:23.081701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:23.081701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:23.081701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:23.081701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:23.081701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:23.082655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:23.082655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:23.082655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:23.082655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:23.082655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:23.082655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:23.082655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:23.082655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:23.082655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:23.082655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:23.082655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:23.082655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:23.082655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:23.082655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:23.082655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:23.082655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:23.082655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:23.083528 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:23.083528 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:23.083528 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:23.083528 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 416/837] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:23.088918 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa18cb-20cc-4218-b590-a35d6340bf94 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:23.133295 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:23.195096 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa18cb-20cc-4218-b590-a35d6340bf94 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:23.229758 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2dd90-ca1b-408e-933b-b3f737359b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:23.230443 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2dd90-ca1b-408e-933b-b3f737359b5f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:23.230655 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2dd90-ca1b-408e-933b-b3f737359b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:23.230913 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2dd90-ca1b-408e-933b-b3f737359b5f None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:23.231541 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2dd90-ca1b-408e-933b-b3f737359b5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:23.231835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2dd90-ca1b-408e-933b-b3f737359b5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:23.233219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2dd90-ca1b-408e-933b-b3f737359b5f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:23.245411 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 422/838] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:23.251458 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d444f-498c-4c47-9783-f1fb352b4416 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:23.348001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:23.390538 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d444f-498c-4c47-9783-f1fb352b4416 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:23.425824 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1238888-65a4-4f7b-87e5-f8a3ce6a0e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:23.426447 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1238888-65a4-4f7b-87e5-f8a3ce6a0e80 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:23.426721 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1238888-65a4-4f7b-87e5-f8a3ce6a0e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:23.426985 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1238888-65a4-4f7b-87e5-f8a3ce6a0e80 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:23.434769 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1238888-65a4-4f7b-87e5-f8a3ce6a0e80 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:23.436250 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1238888-65a4-4f7b-87e5-f8a3ce6a0e80 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:23.447289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-b1238888-65a4-4f7b-87e5-f8a3ce6a0e80 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 00:52:23.447289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:23.447289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:23.447289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:23.447289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:23.447289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:23.447289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:23.447289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:23.447289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:23.447289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:23.447289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:23.447289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:23.447289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:52:23.447289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:52:23.447289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:52:23.447289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:52:23.448205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:23.448205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:23.448205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:52:23.448205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:23.448205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:52:23.448205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:23.448205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:23.448205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:23.448205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:23.448205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:23.448205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:23.448205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:23.448205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:23.448205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:23.448205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:23.448205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:23.448205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:23.448205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:23.449168 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:23.449168 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:23.449168 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:52:23.449168 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:52:23.449168 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:52:23.449168 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:52:23.449168 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:52:23.449168 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:52:23.449168 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 00:52:23.449168 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:23.449168 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 417/839] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:52:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:23.454815 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2dd90-ca1b-408e-933b-b3f737359b5f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:23.556394 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:23.562491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2dd90-ca1b-408e-933b-b3f737359b5f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:23.597472 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385ad04-c304-4a1b-b757-689ada4d96d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:23.598113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385ad04-c304-4a1b-b757-689ada4d96d4 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:23.598396 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385ad04-c304-4a1b-b757-689ada4d96d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:23.598729 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385ad04-c304-4a1b-b757-689ada4d96d4 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:23.599461 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385ad04-c304-4a1b-b757-689ada4d96d4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:23.599810 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385ad04-c304-4a1b-b757-689ada4d96d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:23.601242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385ad04-c304-4a1b-b757-689ada4d96d4 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:23.607154 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c86004-3cbd-4202-af9d-6619e7d8747b None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:23.608157 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c86004-3cbd-4202-af9d-6619e7d8747b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:23.608258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c86004-3cbd-4202-af9d-6619e7d8747b None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:23.609780 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 418/840] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:23.614772 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec0b59-29f0-420f-9465-c1cc02dbd430 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:23.615050 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec0b59-29f0-420f-9465-c1cc02dbd430 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:23.615323 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec0b59-29f0-420f-9465-c1cc02dbd430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:23.620568 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 423/841] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Sep 14 00:52:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:23.626338 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385ad04-c304-4a1b-b757-689ada4d96d4 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:23.634506 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-97ec0b59-29f0-420f-9465-c1cc02dbd430 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:23.635693 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-97ec0b59-29f0-420f-9465-c1cc02dbd430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:23.718045 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 419/842] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 00:52:23.765793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385ad04-c304-4a1b-b757-689ada4d96d4 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:23.805690 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7e12a-3a3c-469b-8a54-c61275865ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:23.806325 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7e12a-3a3c-469b-8a54-c61275865ecb None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:23.806607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7e12a-3a3c-469b-8a54-c61275865ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:23.806878 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7e12a-3a3c-469b-8a54-c61275865ecb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:23.833698 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:23.876507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7e12a-3a3c-469b-8a54-c61275865ecb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:23.877978 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7e12a-3a3c-469b-8a54-c61275865ecb None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:23.979735 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 424/843] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:52:23 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 14 00:52:23.986943 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec0b59-29f0-420f-9465-c1cc02dbd430 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:24.022810 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7e12a-3a3c-469b-8a54-c61275865ecb None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:24.054810 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:24.103296 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec0b59-29f0-420f-9465-c1cc02dbd430 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:24.119060 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:24.140374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bca492-a3fc-45b6-b363-c0d954576ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:24.141011 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bca492-a3fc-45b6-b363-c0d954576ccb None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:24.141311 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bca492-a3fc-45b6-b363-c0d954576ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:24.141560 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bca492-a3fc-45b6-b363-c0d954576ccb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:24.152163 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bca492-a3fc-45b6-b363-c0d954576ccb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:24.153602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bca492-a3fc-45b6-b363-c0d954576ccb None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:24.169444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-55bca492-a3fc-45b6-b363-c0d954576ccb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:24.169444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:24.169444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:24.169444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:24.169444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:24.169444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:24.169444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:24.169444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:24.169444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:24.169444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:24.169444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:24.169444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:24.169444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:24.169444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:24.169444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:24.169444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:24.172258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:24.172258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:24.172258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:24.172258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:24.172258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:24.172258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:24.172258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:24.172258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:24.172258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:24.172258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:24.172258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:24.172258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:24.172258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:24.172258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:24.172258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:24.172258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:24.172258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:24.173753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:24.173753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:24.173753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:24.173990 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7e12a-3a3c-469b-8a54-c61275865ecb None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:24.174079 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 420/844] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:24.177347 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bca492-a3fc-45b6-b363-c0d954576ccb None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:24.213190 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b8e1b-d355-47ae-a2f1-6ad7aad84b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:24.214472 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b8e1b-d355-47ae-a2f1-6ad7aad84b3c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:24.214753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b8e1b-d355-47ae-a2f1-6ad7aad84b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:24.215024 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b8e1b-d355-47ae-a2f1-6ad7aad84b3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:24.227021 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b8e1b-d355-47ae-a2f1-6ad7aad84b3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:52:24.232384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-741b8e1b-d355-47ae-a2f1-6ad7aad84b3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:52:24.232384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:24.232384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:24.232384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:24.232384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:24.232384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:24.232384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:24.232384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:24.232384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:24.232384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:24.232384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:24.232384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:24.232384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:52:24.232384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:52:24.232384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:52:24.232384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:52:24.234513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:52:24.234513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:52:24.234513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:52:24.234513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:52:24.234513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:24.234513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:24.234513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:24.234513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:24.234513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:24.234513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:24.234513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:24.234513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:24.234513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:24.234513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:24.234513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:24.234513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:24.235363 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:24.235363 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:24.235363 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:24.235363 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:24.235363 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:52:24.235363 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:52:24.235363 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:52:24.235363 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:52:24.235363 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:52:24.235363 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:52:24.235363 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:52:24.235363 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:24.235363 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 425/845] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 14 00:52:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:52:24.235363 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a5ca4-fbf8-4489-8ddd-3ebda9d5e7f0 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:24.236076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a5ca4-fbf8-4489-8ddd-3ebda9d5e7f0 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:24.236076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a5ca4-fbf8-4489-8ddd-3ebda9d5e7f0 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:24.237999 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 426/846] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:24.239118 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a5ca4-fbf8-4489-8ddd-3ebda9d5e7f0 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:24.286952 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bca492-a3fc-45b6-b363-c0d954576ccb None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:24.297406 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:24.322878 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b011d-50d4-4aeb-bd22-11ba9e350331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:24.323477 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b011d-50d4-4aeb-bd22-11ba9e350331 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:24.323748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b011d-50d4-4aeb-bd22-11ba9e350331 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:24.324014 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b011d-50d4-4aeb-bd22-11ba9e350331 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:24.324637 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b011d-50d4-4aeb-bd22-11ba9e350331 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:24.324932 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b011d-50d4-4aeb-bd22-11ba9e350331 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:24.326849 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b011d-50d4-4aeb-bd22-11ba9e350331 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:24.339434 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 421/847] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:24.340494 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5318690-5b77-4739-8807-ae1c49ea6191 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:24.340777 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5318690-5b77-4739-8807-ae1c49ea6191 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:24.341047 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5318690-5b77-4739-8807-ae1c49ea6191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:24.351436 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a5ca4-fbf8-4489-8ddd-3ebda9d5e7f0 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:24.359127 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-e5318690-5b77-4739-8807-ae1c49ea6191 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:24.360307 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e5318690-5b77-4739-8807-ae1c49ea6191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:24.370909 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:24.390426 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73cfb4-70b6-4666-a351-9cd202f357a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:24.391276 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73cfb4-70b6-4666-a351-9cd202f357a9 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:24.391719 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73cfb4-70b6-4666-a351-9cd202f357a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:24.391989 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73cfb4-70b6-4666-a351-9cd202f357a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:24.392647 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73cfb4-70b6-4666-a351-9cd202f357a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:24.392947 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73cfb4-70b6-4666-a351-9cd202f357a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:24.394330 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73cfb4-70b6-4666-a351-9cd202f357a9 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:24.402589 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 427/848] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 14 00:52:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:52:24.407448 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73cfb4-70b6-4666-a351-9cd202f357a9 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:24.441836 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 422/849] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:52:24.441836 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5318690-5b77-4739-8807-ae1c49ea6191 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:24.543943 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73cfb4-70b6-4666-a351-9cd202f357a9 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:24.548741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:24.552583 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5318690-5b77-4739-8807-ae1c49ea6191 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:24.583348 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1866c80-13e3-4319-8538-f39d2304acca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:24.583960 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1866c80-13e3-4319-8538-f39d2304acca None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:24.584232 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1866c80-13e3-4319-8538-f39d2304acca None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:24.584497 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1866c80-13e3-4319-8538-f39d2304acca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:24.588240 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427996d-43fd-4abb-9764-ba80808341bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:24.588852 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427996d-43fd-4abb-9764-ba80808341bd None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:24.589125 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427996d-43fd-4abb-9764-ba80808341bd None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:24.589386 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427996d-43fd-4abb-9764-ba80808341bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:24.591194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1866c80-13e3-4319-8538-f39d2304acca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:24.593154 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1866c80-13e3-4319-8538-f39d2304acca None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:24.599999 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427996d-43fd-4abb-9764-ba80808341bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:24.601409 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427996d-43fd-4abb-9764-ba80808341bd None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:24.604313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-e1866c80-13e3-4319-8538-f39d2304acca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:24.604313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:24.604313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:24.604313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:24.604313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:24.604313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:24.604313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:24.604313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:24.604313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:24.604313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:24.604313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:24.604313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:24.604313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:52:24.604313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:52:24.604313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:52:24.605336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:52:24.605336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:24.605336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:24.605336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:24.605336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:24.605336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:24.605336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:24.605336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:24.605336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:24.605336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:24.605336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:24.605336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:24.605336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:24.605336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:24.605336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:24.605336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:24.605336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:24.606272 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:52:24.606272 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:52:24.606272 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:52:24.606272 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:52:24.606272 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:52:24.606272 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:52:24.606272 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:24.606272 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:24.606272 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 428/850] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:52:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:24.606750 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa04df-71e0-4d6a-8068-d803306f949e None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:24.606818 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa04df-71e0-4d6a-8068-d803306f949e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:24.609839 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa04df-71e0-4d6a-8068-d803306f949e None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:24.609839 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 429/851] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:24.614028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa04df-71e0-4d6a-8068-d803306f949e None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:24.618682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-6427996d-43fd-4abb-9764-ba80808341bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:24.618682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:24.618682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:24.618682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:24.618682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:24.618682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:24.618682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:24.618682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:24.618682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:24.618682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:24.618682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:24.618682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:24.618682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:24.618682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:24.618682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:24.618682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:24.619911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:24.619911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:24.619911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:24.619911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:24.619911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:24.619911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:24.619911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:24.619911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:24.619911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:24.619911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:24.619911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:24.619911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:24.619911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:24.619911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:24.619911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:24.619911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:24.619911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:24.620821 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:24.620821 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:24.620821 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:24.620821 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 423/852] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:24.626395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923c30b-26b6-468f-b8c6-9dca24464e31 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:24.626395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923c30b-26b6-468f-b8c6-9dca24464e31 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:24.626395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923c30b-26b6-468f-b8c6-9dca24464e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:24.640668 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-a923c30b-26b6-468f-b8c6-9dca24464e31 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:24.641852 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a923c30b-26b6-468f-b8c6-9dca24464e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:24.663593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:24.710395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 424/853] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:52:24.711228 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923c30b-26b6-468f-b8c6-9dca24464e31 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:24.731548 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa04df-71e0-4d6a-8068-d803306f949e None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:24.767827 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46f1d0-e1d8-4682-ad67-027ec91a6477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:24.768679 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46f1d0-e1d8-4682-ad67-027ec91a6477 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:24.769326 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46f1d0-e1d8-4682-ad67-027ec91a6477 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:24.769652 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46f1d0-e1d8-4682-ad67-027ec91a6477 None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:24.770387 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46f1d0-e1d8-4682-ad67-027ec91a6477 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:24.770739 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46f1d0-e1d8-4682-ad67-027ec91a6477 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:24.772731 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46f1d0-e1d8-4682-ad67-027ec91a6477 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:24.792347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 430/854] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:52:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:24.792347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46f1d0-e1d8-4682-ad67-027ec91a6477 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:24.804425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:24.825268 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923c30b-26b6-468f-b8c6-9dca24464e31 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:24.860612 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdddb1-fe3b-42be-a78e-f1034fbce404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:24.861203 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdddb1-fe3b-42be-a78e-f1034fbce404 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:24.861471 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdddb1-fe3b-42be-a78e-f1034fbce404 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:24.861737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdddb1-fe3b-42be-a78e-f1034fbce404 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:24.862414 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fdddb1-fe3b-42be-a78e-f1034fbce404 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:24.862708 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fdddb1-fe3b-42be-a78e-f1034fbce404 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:24.864060 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fdddb1-fe3b-42be-a78e-f1034fbce404 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:24.876340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 425/855] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:24.876952 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdddb1-fe3b-42be-a78e-f1034fbce404 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:24.902456 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:24.906519 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46f1d0-e1d8-4682-ad67-027ec91a6477 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:24.940627 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3545072-1295-4990-9914-ad4e5f3e0e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:24.941555 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3545072-1295-4990-9914-ad4e5f3e0e1c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:24.941938 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3545072-1295-4990-9914-ad4e5f3e0e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:24.942209 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3545072-1295-4990-9914-ad4e5f3e0e1c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:24.942782 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3545072-1295-4990-9914-ad4e5f3e0e1c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:24.944110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3545072-1295-4990-9914-ad4e5f3e0e1c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:24.953491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-a3545072-1295-4990-9914-ad4e5f3e0e1c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 00:52:24.953491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:24.953491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 00:52:24.953491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 00:52:24.953491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 00:52:24.953491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 00:52:24.953491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 00:52:24.953491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:24.953491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 00:52:24.953491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:24.953491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:52:24.953491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:24.953491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:24.953491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:24.953491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:24.953491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:24.953491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:24.954486 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:24.954486 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:24.954486 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:24.954486 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:24.954486 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:24.954486 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:24.954486 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 00:52:24.954486 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 00:52:24.954486 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 00:52:24.954486 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 00:52:24.954486 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:24.954486 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:24.954486 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:24.954486 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:24.954486 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:24.954486 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:24.955317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:24.955317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:24.955317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:24.955317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:24.955317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:24.955317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:24.955317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:24.955317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:24.955317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:24.955317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:24.955317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 00:52:24.955317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:24.955317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 00:52:24.955317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:24.959544 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 431/856] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 14 00:52:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:24.960155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3545072-1295-4990-9914-ad4e5f3e0e1c None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:24.982054 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdddb1-fe3b-42be-a78e-f1034fbce404 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:25.019837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b498ce5-3c6d-4dd6-9f48-13d07ecc6852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:25.020462 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b498ce5-3c6d-4dd6-9f48-13d07ecc6852 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:25.020736 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b498ce5-3c6d-4dd6-9f48-13d07ecc6852 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:25.021000 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b498ce5-3c6d-4dd6-9f48-13d07ecc6852 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:25.021704 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b498ce5-3c6d-4dd6-9f48-13d07ecc6852 None admin] RBAC: Adding query filter params (role.id=0d7a36bda723430eae02f10f4c775c96, scope.project.id=f37c835c05924364bcd1530d44f024fe, user.id=c8d05652bfe542d5a2cfa39fbf7a83c9) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:25.022035 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b498ce5-3c6d-4dd6-9f48-13d07ecc6852 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:25.023446 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b498ce5-3c6d-4dd6-9f48-13d07ecc6852 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:25.028983 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 426/857] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:52:24 2022] GET /identity/v3/role_assignments?user.id=c8d05652bfe542d5a2cfa39fbf7a83c9&scope.project.id=f37c835c05924364bcd1530d44f024fe&role.id=0d7a36bda723430eae02f10f4c775c96 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:25.030153 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b498ce5-3c6d-4dd6-9f48-13d07ecc6852 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:25.033947 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:25.070608 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3545072-1295-4990-9914-ad4e5f3e0e1c None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:25.110305 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62aa11-dd11-452c-9f33-734c4473024d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:25.110953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62aa11-dd11-452c-9f33-734c4473024d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:25.111355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62aa11-dd11-452c-9f33-734c4473024d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:25.111627 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62aa11-dd11-452c-9f33-734c4473024d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:25.120196 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62aa11-dd11-452c-9f33-734c4473024d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:25.121670 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62aa11-dd11-452c-9f33-734c4473024d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:25.135628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-ed62aa11-dd11-452c-9f33-734c4473024d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 00:52:25.135628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:25.135628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:25.135628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:25.135628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:25.135628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:25.135628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:25.135628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:25.135628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:25.135628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:25.135628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:25.135628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:25.135628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:52:25.135628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:52:25.135628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:52:25.135628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:52:25.136675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:25.136675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:25.136675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:52:25.136675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:25.136675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:52:25.136675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:25.136675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:25.136675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:25.136675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:25.136675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:25.136675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:25.136675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:25.136675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:25.136675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:25.136675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:25.136675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:25.136675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:25.136675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:25.137621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:25.137621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:25.137621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:52:25.137621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:52:25.137621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:52:25.137621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:52:25.137621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:52:25.137621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:52:25.137621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 00:52:25.137621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:25.137621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 432/858] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Sep 14 00:52:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:25.139344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62aa11-dd11-452c-9f33-734c4473024d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:25.145294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b498ce5-3c6d-4dd6-9f48-13d07ecc6852 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:25.167215 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:25.182945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8da5a-c2ad-4f37-8ac9-a5e3d791b11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:25.183563 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8da5a-c2ad-4f37-8ac9-a5e3d791b11b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:25.183837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8da5a-c2ad-4f37-8ac9-a5e3d791b11b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:25.184103 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8da5a-c2ad-4f37-8ac9-a5e3d791b11b None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:25.184738 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8da5a-c2ad-4f37-8ac9-a5e3d791b11b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:25.185034 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8da5a-c2ad-4f37-8ac9-a5e3d791b11b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:25.186672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8da5a-c2ad-4f37-8ac9-a5e3d791b11b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:25.197432 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 427/859] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 14 00:52:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:25.199300 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8da5a-c2ad-4f37-8ac9-a5e3d791b11b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:25.258309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62aa11-dd11-452c-9f33-734c4473024d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:25.281182 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:25.296672 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cbf71-492e-4219-a37d-2c5bebb6f204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:25.297297 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cbf71-492e-4219-a37d-2c5bebb6f204 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:25.297697 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cbf71-492e-4219-a37d-2c5bebb6f204 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:25.297997 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cbf71-492e-4219-a37d-2c5bebb6f204 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:25.298697 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7cbf71-492e-4219-a37d-2c5bebb6f204 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:25.300050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7cbf71-492e-4219-a37d-2c5bebb6f204 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:25.309513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-0e7cbf71-492e-4219-a37d-2c5bebb6f204 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 00:52:25.309513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:25.309513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 00:52:25.309513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 00:52:25.309513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 00:52:25.309513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 00:52:25.309513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 00:52:25.309513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:25.309513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 00:52:25.309513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:25.309513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:52:25.309513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:25.309513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:25.309513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:25.309513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:25.309513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:25.310509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:25.310509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:25.310509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:25.310509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:25.310509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:25.310509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:25.310509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:25.310509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 00:52:25.310509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 00:52:25.310509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 00:52:25.310509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 00:52:25.310509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:25.310509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:25.310509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:25.310509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:25.310509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:25.310509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:25.311440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:25.311440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:25.311440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:25.311440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:25.311440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:25.311440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:25.311440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:25.311440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:25.311440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:25.311440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:25.311440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 00:52:25.311440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:25.311440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 00:52:25.311440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:25.311440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 433/860] 10.222.0.20 () {56 vars in 1132 bytes} [Wed Sep 14 00:52:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:25.312327 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cbf71-492e-4219-a37d-2c5bebb6f204 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:25.322553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8da5a-c2ad-4f37-8ac9-a5e3d791b11b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:25.356103 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca141b92-abb8-488b-b313-2b77e95a2ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:25.356758 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca141b92-abb8-488b-b313-2b77e95a2ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:25.356965 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca141b92-abb8-488b-b313-2b77e95a2ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:25.357229 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca141b92-abb8-488b-b313-2b77e95a2ad7 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:25.358032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca141b92-abb8-488b-b313-2b77e95a2ad7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:25.358333 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca141b92-abb8-488b-b313-2b77e95a2ad7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:25.359743 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca141b92-abb8-488b-b313-2b77e95a2ad7 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:25.377740 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 428/861] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Sep 14 00:52:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:25.382968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca141b92-abb8-488b-b313-2b77e95a2ad7 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:25.406980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:25.422527 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cbf71-492e-4219-a37d-2c5bebb6f204 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:25.462461 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9149fb-87a9-44d6-a405-7cbaf433848d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:25.463434 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9149fb-87a9-44d6-a405-7cbaf433848d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:25.463877 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9149fb-87a9-44d6-a405-7cbaf433848d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:25.464185 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9149fb-87a9-44d6-a405-7cbaf433848d None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:25.464783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9149fb-87a9-44d6-a405-7cbaf433848d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:25.465083 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9149fb-87a9-44d6-a405-7cbaf433848d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:25.466469 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9149fb-87a9-44d6-a405-7cbaf433848d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:25.471916 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 434/862] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 14 00:52:25 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:25.472699 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9149fb-87a9-44d6-a405-7cbaf433848d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:25.501748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca141b92-abb8-488b-b313-2b77e95a2ad7 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:25.534433 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:25.545577 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed865b-6fde-424a-be8f-b3c9265dbcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:25.546246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed865b-6fde-424a-be8f-b3c9265dbcb2 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:25.546544 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed865b-6fde-424a-be8f-b3c9265dbcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:25.547281 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed865b-6fde-424a-be8f-b3c9265dbcb2 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:25.547665 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed865b-6fde-424a-be8f-b3c9265dbcb2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:25.547966 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed865b-6fde-424a-be8f-b3c9265dbcb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:25.549437 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed865b-6fde-424a-be8f-b3c9265dbcb2 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:25.555180 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 429/863] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Sep 14 00:52:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:25.563074 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed865b-6fde-424a-be8f-b3c9265dbcb2 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:25.617178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9149fb-87a9-44d6-a405-7cbaf433848d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:25.657688 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c386085-b68c-4a68-a1f0-f0a3bc7fd668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:25.658756 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c386085-b68c-4a68-a1f0-f0a3bc7fd668 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:25.659233 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c386085-b68c-4a68-a1f0-f0a3bc7fd668 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:25.659716 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c386085-b68c-4a68-a1f0-f0a3bc7fd668 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:25.688243 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:25.698270 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed865b-6fde-424a-be8f-b3c9265dbcb2 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:25.741278 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac49e7-948d-449e-8ce8-0055a729a0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:25.741914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac49e7-948d-449e-8ce8-0055a729a0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:25.742192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac49e7-948d-449e-8ce8-0055a729a0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:25.742462 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac49e7-948d-449e-8ce8-0055a729a0d7 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:25.743084 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac49e7-948d-449e-8ce8-0055a729a0d7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:25.743386 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac49e7-948d-449e-8ce8-0055a729a0d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:25.744867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac49e7-948d-449e-8ce8-0055a729a0d7 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:25.750272 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 430/864] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Sep 14 00:52:25 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:25.757723 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c386085-b68c-4a68-a1f0-f0a3bc7fd668 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:25.758991 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c386085-b68c-4a68-a1f0-f0a3bc7fd668 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:25.873786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 435/865] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:52:25 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 00:52:25.879344 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac49e7-948d-449e-8ce8-0055a729a0d7 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:25.949061 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:26.000025 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac49e7-948d-449e-8ce8-0055a729a0d7 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:26.039439 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ad667-a238-4baa-a58a-fa20c3eaedfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:26.040069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ad667-a238-4baa-a58a-fa20c3eaedfa None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:26.040344 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ad667-a238-4baa-a58a-fa20c3eaedfa None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:26.040611 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ad667-a238-4baa-a58a-fa20c3eaedfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:26.051367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ad667-a238-4baa-a58a-fa20c3eaedfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:26.053019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ad667-a238-4baa-a58a-fa20c3eaedfa None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:26.068970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-1b4ad667-a238-4baa-a58a-fa20c3eaedfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:26.068970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:26.068970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:26.068970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:26.068970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:26.068970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:26.068970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:26.068970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:26.068970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:26.068970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:26.068970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:26.068970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:26.068970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:26.068970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:26.068970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:26.068970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:26.070042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:26.070042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:26.070042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:26.070042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:26.070042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:26.070042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:26.070042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:26.070042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:26.070042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:26.070042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:26.070042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:26.070042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:26.070042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:26.070042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:26.070042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:26.070042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:26.070042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:26.071009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:26.071009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:26.071009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:26.071009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 431/866] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:26.075916 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c386085-b68c-4a68-a1f0-f0a3bc7fd668 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:26.128834 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:26.176171 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c386085-b68c-4a68-a1f0-f0a3bc7fd668 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:26.210805 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310d646-c14b-4eea-9816-366dcea44f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:26.211416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310d646-c14b-4eea-9816-366dcea44f46 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:26.211693 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310d646-c14b-4eea-9816-366dcea44f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:26.211968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310d646-c14b-4eea-9816-366dcea44f46 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:26.212596 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310d646-c14b-4eea-9816-366dcea44f46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:26.212895 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310d646-c14b-4eea-9816-366dcea44f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:26.214286 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310d646-c14b-4eea-9816-366dcea44f46 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:26.226695 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 436/867] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:26.232129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ad667-a238-4baa-a58a-fa20c3eaedfa None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:26.340712 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ad667-a238-4baa-a58a-fa20c3eaedfa None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:26.349381 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:26.377581 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24844731-b17e-4472-9d5c-9cb5475a7c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:26.378234 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24844731-b17e-4472-9d5c-9cb5475a7c1c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:26.378509 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24844731-b17e-4472-9d5c-9cb5475a7c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:26.378776 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24844731-b17e-4472-9d5c-9cb5475a7c1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:26.385874 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24844731-b17e-4472-9d5c-9cb5475a7c1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:26.387257 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24844731-b17e-4472-9d5c-9cb5475a7c1c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:26.398603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-24844731-b17e-4472-9d5c-9cb5475a7c1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:26.398603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:26.398603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:26.398603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:26.398603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:26.398603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:26.398603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:26.398603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:26.398603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:26.398603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:26.398603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:26.398603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:26.398603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:52:26.398603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:52:26.398603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:52:26.399508 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:52:26.399508 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:26.399508 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:26.399508 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:26.399508 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:26.399508 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:26.399508 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:26.399508 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:26.399508 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:26.399508 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:26.399508 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:26.399508 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:26.399508 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:26.399508 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:26.399508 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:26.399508 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:26.399508 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:26.400398 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:52:26.400398 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:52:26.400398 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:52:26.400398 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:52:26.400398 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:52:26.400398 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:52:26.400398 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:26.400398 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:26.400398 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 432/868] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:52:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:26.407918 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310d646-c14b-4eea-9816-366dcea44f46 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:26.510905 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310d646-c14b-4eea-9816-366dcea44f46 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:26.526739 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:26.546553 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21423dd3-bf70-4663-8931-790d42f5bf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:26.547161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21423dd3-bf70-4663-8931-790d42f5bf6e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:26.547437 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21423dd3-bf70-4663-8931-790d42f5bf6e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:26.547706 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21423dd3-bf70-4663-8931-790d42f5bf6e None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:26.548385 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21423dd3-bf70-4663-8931-790d42f5bf6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:26.548689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21423dd3-bf70-4663-8931-790d42f5bf6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:26.550126 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21423dd3-bf70-4663-8931-790d42f5bf6e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:26.562396 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 437/869] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:52:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:26.568351 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24844731-b17e-4472-9d5c-9cb5475a7c1c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:26.676833 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24844731-b17e-4472-9d5c-9cb5475a7c1c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:26.712291 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa60ef-bd31-4c4e-b4d4-b82a2a61891f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:26.713043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa60ef-bd31-4c4e-b4d4-b82a2a61891f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:26.713242 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa60ef-bd31-4c4e-b4d4-b82a2a61891f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:26.713501 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa60ef-bd31-4c4e-b4d4-b82a2a61891f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:26.714247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa60ef-bd31-4c4e-b4d4-b82a2a61891f None admin] RBAC: Adding query filter params (role.id=b9c910c1c68948858203c62521b73efc, scope.project.id=f37c835c05924364bcd1530d44f024fe, user.id=eb9d1149a417436bbf1577d61407c0a9) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:26.714547 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa60ef-bd31-4c4e-b4d4-b82a2a61891f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:26.715957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa60ef-bd31-4c4e-b4d4-b82a2a61891f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:26.722214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 433/870] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:52:26 2022] GET /identity/v3/role_assignments?user.id=eb9d1149a417436bbf1577d61407c0a9&scope.project.id=f37c835c05924364bcd1530d44f024fe&role.id=b9c910c1c68948858203c62521b73efc => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:27.287188 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137382be-1e0b-4ce7-9a41-898378f6762f None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:27.287531 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137382be-1e0b-4ce7-9a41-898378f6762f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:27.287648 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137382be-1e0b-4ce7-9a41-898378f6762f None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:27.289229 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 438/871] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:27.294366 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead6d01-7f34-460d-b954-282d93965e5b None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:27.294645 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead6d01-7f34-460d-b954-282d93965e5b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:27.295002 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead6d01-7f34-460d-b954-282d93965e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:27.313267 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-4ead6d01-7f34-460d-b954-282d93965e5b None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:27.314471 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4ead6d01-7f34-460d-b954-282d93965e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:27.339787 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:27.385238 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 434/872] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:52:27.652572 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137382be-1e0b-4ce7-9a41-898378f6762f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:27.761085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137382be-1e0b-4ce7-9a41-898378f6762f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:27.767273 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727cc34-8ee0-4650-aac5-192951c17005 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:27.767829 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727cc34-8ee0-4650-aac5-192951c17005 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:27.767829 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727cc34-8ee0-4650-aac5-192951c17005 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:27.770571 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 435/873] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:27.774564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d0a7a-bc6b-4b32-8efc-8a14e37f18ad None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:27.774846 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d0a7a-bc6b-4b32-8efc-8a14e37f18ad None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:27.775117 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d0a7a-bc6b-4b32-8efc-8a14e37f18ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:27.795545 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-644d0a7a-bc6b-4b32-8efc-8a14e37f18ad None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:27.797148 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-644d0a7a-bc6b-4b32-8efc-8a14e37f18ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:27.799317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759be5f3-14b9-4e47-851d-1919967e3e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:27.799945 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759be5f3-14b9-4e47-851d-1919967e3e09 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:27.800225 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759be5f3-14b9-4e47-851d-1919967e3e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:27.800499 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759be5f3-14b9-4e47-851d-1919967e3e09 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:27.801080 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759be5f3-14b9-4e47-851d-1919967e3e09 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:27.802461 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759be5f3-14b9-4e47-851d-1919967e3e09 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:27.812066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-759be5f3-14b9-4e47-851d-1919967e3e09 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 00:52:27.812066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:27.812066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 00:52:27.812066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 00:52:27.812066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 00:52:27.812066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 00:52:27.812066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 00:52:27.812066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:27.812066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 00:52:27.812066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:27.812066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:52:27.812066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:27.812066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:27.812066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:27.812066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:27.812066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:27.812066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:27.813100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:27.813100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:27.813100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:27.813100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:27.813100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:27.813100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:27.813100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 00:52:27.813100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 00:52:27.813100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 00:52:27.813100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 00:52:27.813100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:27.813100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:27.813100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:27.813100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:27.813100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:27.813100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:27.813968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:27.813968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:27.813968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:27.813968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:27.813968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:27.813968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:27.813968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:27.813968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:27.813968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:27.813968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:27.813968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 00:52:27.813968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:27.813968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 00:52:27.813968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:27.813968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 439/874] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Sep 14 00:52:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:27.820583 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759be5f3-14b9-4e47-851d-1919967e3e09 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:27.864033 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:27.901894 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 436/875] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 00:52:27.944797 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759be5f3-14b9-4e47-851d-1919967e3e09 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:27.986044 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368166d-4037-41e7-8ceb-4e00bd749342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:27.986674 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368166d-4037-41e7-8ceb-4e00bd749342 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:27.986950 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368166d-4037-41e7-8ceb-4e00bd749342 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:27.987228 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368166d-4037-41e7-8ceb-4e00bd749342 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:27.987871 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368166d-4037-41e7-8ceb-4e00bd749342 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:27.988172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368166d-4037-41e7-8ceb-4e00bd749342 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:27.989557 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368166d-4037-41e7-8ceb-4e00bd749342 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:28.001260 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 440/876] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Sep 14 00:52:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:52:28.001836 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d0a7a-bc6b-4b32-8efc-8a14e37f18ad None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:28.089320 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291640cd-e976-4726-a94b-c8f43a3868b8 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:28.089612 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291640cd-e976-4726-a94b-c8f43a3868b8 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:28.089962 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291640cd-e976-4726-a94b-c8f43a3868b8 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:28.091556 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 441/877] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 00:52:28.096988 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a92fdd-7e68-45d1-81f8-9d72aafe64ab None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:28.097273 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a92fdd-7e68-45d1-81f8-9d72aafe64ab None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:28.097552 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a92fdd-7e68-45d1-81f8-9d72aafe64ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:28.100550 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:28.110909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d0a7a-bc6b-4b32-8efc-8a14e37f18ad None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:28.119824 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-a3a92fdd-7e68-45d1-81f8-9d72aafe64ab None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:28.121125 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a3a92fdd-7e68-45d1-81f8-9d72aafe64ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:28.146031 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf46c2-a707-4b7a-b726-1d0e7abfe919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:28.146753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf46c2-a707-4b7a-b726-1d0e7abfe919 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:28.147025 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf46c2-a707-4b7a-b726-1d0e7abfe919 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:28.147402 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf46c2-a707-4b7a-b726-1d0e7abfe919 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:28.148028 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf46c2-a707-4b7a-b726-1d0e7abfe919 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:28.148587 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf46c2-a707-4b7a-b726-1d0e7abfe919 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:28.149994 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf46c2-a707-4b7a-b726-1d0e7abfe919 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:28.156593 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 437/878] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Sep 14 00:52:27 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:28.204863 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 442/879] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 00:52:28.212417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf46c2-a707-4b7a-b726-1d0e7abfe919 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:28.328955 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf46c2-a707-4b7a-b726-1d0e7abfe919 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:28.364800 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d131ec7-d93f-4d03-85f5-773ec453a928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:28.365754 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d131ec7-d93f-4d03-85f5-773ec453a928 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:28.366293 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d131ec7-d93f-4d03-85f5-773ec453a928 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:28.366767 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d131ec7-d93f-4d03-85f5-773ec453a928 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:28.367622 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d131ec7-d93f-4d03-85f5-773ec453a928 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:28.369178 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d131ec7-d93f-4d03-85f5-773ec453a928 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:28.386344 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 438/880] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Sep 14 00:52:28 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:52:28.512381 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a92fdd-7e68-45d1-81f8-9d72aafe64ab None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:28.545869 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:28.622089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a92fdd-7e68-45d1-81f8-9d72aafe64ab None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:28.664884 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1aacda-df7b-47be-bf13-37df3919b461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:28.666302 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1aacda-df7b-47be-bf13-37df3919b461 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:28.666819 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1aacda-df7b-47be-bf13-37df3919b461 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:28.667296 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1aacda-df7b-47be-bf13-37df3919b461 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:28.668147 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1aacda-df7b-47be-bf13-37df3919b461 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:28.669745 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1aacda-df7b-47be-bf13-37df3919b461 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:28.687126 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 443/881] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Sep 14 00:52:28 2022] POST /identity/v3/services => generated 269 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:52:29.085141 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57b579-42d6-46ba-9fa4-118ef68b2209 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:29.086029 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57b579-42d6-46ba-9fa4-118ef68b2209 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:29.086460 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57b579-42d6-46ba-9fa4-118ef68b2209 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:29.088189 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 439/882] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:29.094572 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0004b0-35a7-4285-8064-a99786706bc4 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:29.095071 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0004b0-35a7-4285-8064-a99786706bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:29.095507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0004b0-35a7-4285-8064-a99786706bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:29.113826 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-9e0004b0-35a7-4285-8064-a99786706bc4 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:29.115207 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-9e0004b0-35a7-4285-8064-a99786706bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:29.193925 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 444/883] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:29 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 00:52:29.461327 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57b579-42d6-46ba-9fa4-118ef68b2209 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:29.477872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:29.571783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57b579-42d6-46ba-9fa4-118ef68b2209 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:29.606036 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46d290-3879-4d70-b480-79b7a7869293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:29.606652 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46d290-3879-4d70-b480-79b7a7869293 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:29.606925 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46d290-3879-4d70-b480-79b7a7869293 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:29.607212 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46d290-3879-4d70-b480-79b7a7869293 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:29.617655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46d290-3879-4d70-b480-79b7a7869293 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:52:29.622364 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-8b46d290-3879-4d70-b480-79b7a7869293 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 00:52:29.622364 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:29.622364 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:29.622364 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:29.622364 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:29.622364 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:29.622364 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:29.622364 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:29.622364 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:29.622364 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:29.622364 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:29.622364 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:29.622364 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:52:29.622364 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:52:29.622364 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:52:29.622364 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:52:29.623345 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:52:29.623345 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:52:29.623345 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:52:29.623345 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:52:29.623345 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:29.623345 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:29.623345 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:29.623345 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:29.623345 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:29.623345 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:29.623345 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:29.623345 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:29.623345 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:29.623345 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:29.623345 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:29.623345 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:29.624192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:29.624192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:29.624192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:29.624192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:29.624192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:52:29.624192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:52:29.624192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:52:29.624192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:52:29.624192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:52:29.624192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:52:29.624192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 00:52:29.624192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:29.624192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 440/884] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Sep 14 00:52:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:29.630330 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0004b0-35a7-4285-8064-a99786706bc4 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:29.647030 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:29.740754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0004b0-35a7-4285-8064-a99786706bc4 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:29.775978 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01b7ee-4c7f-4e92-a3ef-efff041ff621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:29.776587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01b7ee-4c7f-4e92-a3ef-efff041ff621 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:29.776865 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01b7ee-4c7f-4e92-a3ef-efff041ff621 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:29.777134 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01b7ee-4c7f-4e92-a3ef-efff041ff621 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:29.777794 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01b7ee-4c7f-4e92-a3ef-efff041ff621 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:29.778117 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01b7ee-4c7f-4e92-a3ef-efff041ff621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:29.779592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01b7ee-4c7f-4e92-a3ef-efff041ff621 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:29.792888 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 445/885] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Sep 14 00:52:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:29.794259 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46d290-3879-4d70-b480-79b7a7869293 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:29.873756 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:29.897613 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46d290-3879-4d70-b480-79b7a7869293 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:29.932107 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae421955-9149-416e-bde6-50433365ed3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:29.932736 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae421955-9149-416e-bde6-50433365ed3f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:29.933010 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae421955-9149-416e-bde6-50433365ed3f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:29.933280 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae421955-9149-416e-bde6-50433365ed3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:29.948511 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae421955-9149-416e-bde6-50433365ed3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:29.950000 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae421955-9149-416e-bde6-50433365ed3f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:29.965001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-ae421955-9149-416e-bde6-50433365ed3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:29.965001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:29.965001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:29.965001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:29.965001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:29.965001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:29.965001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:29.965001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:29.965001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:29.965001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:29.965001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:29.965001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:29.965001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:29.965001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:29.965001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:29.965001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:29.967246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:29.967246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:29.967246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:29.967246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:29.967246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:29.967246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:29.967246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:29.967246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:29.967246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:29.967246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:29.967246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:29.967246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:29.967246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:29.967246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:29.967246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:29.967246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:29.967246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:29.969438 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:29.969438 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:29.969438 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:29.969438 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 441/886] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:29.975097 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01b7ee-4c7f-4e92-a3ef-efff041ff621 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:30.055578 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:30.081038 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01b7ee-4c7f-4e92-a3ef-efff041ff621 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:30.113526 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739cea7-d1d3-4d08-a870-8cb1ea742232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:30.114152 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739cea7-d1d3-4d08-a870-8cb1ea742232 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:30.114433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739cea7-d1d3-4d08-a870-8cb1ea742232 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:30.114703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739cea7-d1d3-4d08-a870-8cb1ea742232 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:30.115332 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739cea7-d1d3-4d08-a870-8cb1ea742232 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:30.115687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739cea7-d1d3-4d08-a870-8cb1ea742232 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:30.117051 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739cea7-d1d3-4d08-a870-8cb1ea742232 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:30.129727 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 446/887] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:30.139161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae421955-9149-416e-bde6-50433365ed3f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:30.249436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae421955-9149-416e-bde6-50433365ed3f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:30.275553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:30.286012 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7452af8-880c-4bd4-98fc-fa677fc675bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:30.286634 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7452af8-880c-4bd4-98fc-fa677fc675bb None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:30.286965 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7452af8-880c-4bd4-98fc-fa677fc675bb None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:30.287239 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7452af8-880c-4bd4-98fc-fa677fc675bb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:30.295895 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7452af8-880c-4bd4-98fc-fa677fc675bb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:30.297461 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7452af8-880c-4bd4-98fc-fa677fc675bb None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:30.310695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-d7452af8-880c-4bd4-98fc-fa677fc675bb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 00:52:30.310695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:30.310695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:30.310695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:30.310695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:30.310695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:30.310695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:30.310695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:30.310695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:30.310695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:30.310695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:30.310695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:30.310695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:52:30.310695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:52:30.310695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:52:30.310695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:52:30.312944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:30.312944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:30.312944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:52:30.312944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:30.312944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:52:30.312944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:30.312944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:30.312944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:30.312944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:30.312944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:30.312944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:30.312944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:30.312944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:30.312944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:30.312944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:30.312944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:30.312944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:30.312944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:30.315249 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:30.315249 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:30.315249 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:52:30.315249 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:52:30.315249 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:52:30.315249 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:52:30.315249 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:52:30.315249 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:52:30.315249 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 00:52:30.315249 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:30.321951 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 442/888] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Sep 14 00:52:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:30.322241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739cea7-d1d3-4d08-a870-8cb1ea742232 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:30.427142 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739cea7-d1d3-4d08-a870-8cb1ea742232 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:30.446482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141072f1-9595-4303-a8f6-bbc239f2e68d None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:30.447103 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141072f1-9595-4303-a8f6-bbc239f2e68d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:30.447592 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141072f1-9595-4303-a8f6-bbc239f2e68d None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:30.449370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 443/889] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:30.454986 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2884b-eb8e-4565-af2d-c31bfb96b3ed None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:30.455506 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2884b-eb8e-4565-af2d-c31bfb96b3ed None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:30.455999 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2884b-eb8e-4565-af2d-c31bfb96b3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:30.463732 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf823e65-0e91-41dc-9b08-f90544071445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:30.464341 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf823e65-0e91-41dc-9b08-f90544071445 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:30.464617 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf823e65-0e91-41dc-9b08-f90544071445 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:30.464885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf823e65-0e91-41dc-9b08-f90544071445 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:30.465607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf823e65-0e91-41dc-9b08-f90544071445 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:30.465936 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf823e65-0e91-41dc-9b08-f90544071445 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:30.467417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf823e65-0e91-41dc-9b08-f90544071445 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:30.469071 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:30.477266 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-2cd2884b-eb8e-4565-af2d-c31bfb96b3ed None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:30.478851 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-2cd2884b-eb8e-4565-af2d-c31bfb96b3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:30.491971 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 447/890] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Sep 14 00:52:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:30.493213 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf823e65-0e91-41dc-9b08-f90544071445 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:30.557960 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 444/891] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:30 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 00:52:30.603929 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf823e65-0e91-41dc-9b08-f90544071445 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:30.641716 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b8ad1-236c-4a90-b60f-26605ea021ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:30.642626 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b8ad1-236c-4a90-b60f-26605ea021ff None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:30.643057 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b8ad1-236c-4a90-b60f-26605ea021ff None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:30.643475 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b8ad1-236c-4a90-b60f-26605ea021ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:30.705950 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:30.707516 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0799d-d76e-4d53-a2e7-9b79ef8bcd13 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:30.707912 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0799d-d76e-4d53-a2e7-9b79ef8bcd13 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:30.708432 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0799d-d76e-4d53-a2e7-9b79ef8bcd13 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:30.713922 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 445/892] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 00:52:30.715147 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2013c2-ec9c-4b81-ada7-a0688f3ced2a None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:30.715672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2013c2-ec9c-4b81-ada7-a0688f3ced2a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:30.717491 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2013c2-ec9c-4b81-ada7-a0688f3ced2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:30.718984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b8ad1-236c-4a90-b60f-26605ea021ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:30.720709 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b8ad1-236c-4a90-b60f-26605ea021ff None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:30.736870 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-2a2013c2-ec9c-4b81-ada7-a0688f3ced2a None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:30.738446 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-2a2013c2-ec9c-4b81-ada7-a0688f3ced2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:30.823335 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 446/893] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:30 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:52:30.826596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2013c2-ec9c-4b81-ada7-a0688f3ced2a None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:30.850228 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 448/894] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:52:30 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 00:52:30.856428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b8ad1-236c-4a90-b60f-26605ea021ff None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:30.878714 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:30.936342 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2013c2-ec9c-4b81-ada7-a0688f3ced2a None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:30.960186 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:30.970948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b8ad1-236c-4a90-b60f-26605ea021ff None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:30.991318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436315b-cfe1-4a2f-bdc4-ce01f614abad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:30.992386 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436315b-cfe1-4a2f-bdc4-ce01f614abad None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:30.993272 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436315b-cfe1-4a2f-bdc4-ce01f614abad None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:30.993727 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436315b-cfe1-4a2f-bdc4-ce01f614abad None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:30.994621 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436315b-cfe1-4a2f-bdc4-ce01f614abad None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:30.996742 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436315b-cfe1-4a2f-bdc4-ce01f614abad None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:31.015287 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 447/895] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Sep 14 00:52:30 2022] POST /identity/v3/services => generated 241 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 00:52:31.025679 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a67e7f-a205-4bca-a776-3885058ae293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:31.025679 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a67e7f-a205-4bca-a776-3885058ae293 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:31.025679 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a67e7f-a205-4bca-a776-3885058ae293 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:31.025679 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a67e7f-a205-4bca-a776-3885058ae293 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:31.036789 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a67e7f-a205-4bca-a776-3885058ae293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:31.038494 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a67e7f-a205-4bca-a776-3885058ae293 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:31.050392 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53902363-138d-4761-8908-c776b888ee45 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:31.051053 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53902363-138d-4761-8908-c776b888ee45 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:31.051534 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53902363-138d-4761-8908-c776b888ee45 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:31.053434 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 448/896] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 00:52:31.057682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-68a67e7f-a205-4bca-a776-3885058ae293 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:31.057682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:31.057682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:31.057682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:31.057682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:31.057682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:31.057682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:31.057682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:31.057682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:31.057682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:31.057682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:31.057682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:31.057682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:31.057682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:31.057682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:31.057682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:31.058702 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:31.058702 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:31.058702 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:31.058702 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:31.058702 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:31.058702 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:31.058702 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:31.058702 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:31.058702 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:31.058702 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:31.058702 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:31.058702 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:31.058702 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:31.058702 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:31.058702 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:31.058702 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:31.058702 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:31.059592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:31.059592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:31.059592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:31.059592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 449/897] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:52:31.059818 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae9e44-19bd-401a-b0ab-7a28d1603f51 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:31.059818 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae9e44-19bd-401a-b0ab-7a28d1603f51 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:31.059954 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae9e44-19bd-401a-b0ab-7a28d1603f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:31.063421 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a67e7f-a205-4bca-a776-3885058ae293 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:31.081291 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-16ae9e44-19bd-401a-b0ab-7a28d1603f51 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:31.082948 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-16ae9e44-19bd-401a-b0ab-7a28d1603f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:31.161153 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 449/898] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 00:52:31.163070 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae9e44-19bd-401a-b0ab-7a28d1603f51 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:31.179432 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a67e7f-a205-4bca-a776-3885058ae293 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:31.204436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:31.222426 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104f596-d51d-4c12-9e96-3e5ff750110d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:31.223326 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104f596-d51d-4c12-9e96-3e5ff750110d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:31.223800 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104f596-d51d-4c12-9e96-3e5ff750110d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:31.224237 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104f596-d51d-4c12-9e96-3e5ff750110d None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:31.225093 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104f596-d51d-4c12-9e96-3e5ff750110d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:31.225577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104f596-d51d-4c12-9e96-3e5ff750110d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:31.227022 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104f596-d51d-4c12-9e96-3e5ff750110d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:31.239298 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:31.242652 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 450/899] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:31.248637 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104f596-d51d-4c12-9e96-3e5ff750110d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:31.280490 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae9e44-19bd-401a-b0ab-7a28d1603f51 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:31.326069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49905b-251c-4b8f-ab02-ab116321743f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:31.327399 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49905b-251c-4b8f-ab02-ab116321743f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:31.328135 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49905b-251c-4b8f-ab02-ab116321743f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:31.328661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49905b-251c-4b8f-ab02-ab116321743f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:31.330383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49905b-251c-4b8f-ab02-ab116321743f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:31.332099 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49905b-251c-4b8f-ab02-ab116321743f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:31.342991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-ad49905b-251c-4b8f-ab02-ab116321743f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 00:52:31.342991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:31.342991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 00:52:31.342991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 00:52:31.342991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 00:52:31.342991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 00:52:31.342991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 00:52:31.342991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:31.342991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 00:52:31.342991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:31.342991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:52:31.342991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:31.342991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:31.342991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:31.342991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:31.342991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:31.342991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:31.344002 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:31.344002 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:31.344002 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:31.344002 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:31.344002 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:31.344002 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:31.344002 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 00:52:31.344002 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 00:52:31.344002 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 00:52:31.344002 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 00:52:31.344002 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:31.344002 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:31.344002 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:31.344002 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:31.344002 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:31.344002 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:31.344867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:31.344867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:31.344867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:31.344867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:31.344867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:31.344867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:31.344867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:31.344867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:31.344867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:31.344867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:31.344867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 00:52:31.344867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:31.344867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 00:52:31.344867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:31.344867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 450/900] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 14 00:52:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:31.352274 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49905b-251c-4b8f-ab02-ab116321743f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:31.367554 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104f596-d51d-4c12-9e96-3e5ff750110d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:31.414870 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af419a-2a7b-41b7-86fb-02f1995a7238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:31.416185 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af419a-2a7b-41b7-86fb-02f1995a7238 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:31.416962 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af419a-2a7b-41b7-86fb-02f1995a7238 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:31.417522 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af419a-2a7b-41b7-86fb-02f1995a7238 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:31.427759 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af419a-2a7b-41b7-86fb-02f1995a7238 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:31.430296 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af419a-2a7b-41b7-86fb-02f1995a7238 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:31.447069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-02af419a-2a7b-41b7-86fb-02f1995a7238 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:31.447069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:31.447069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:31.447069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:31.447069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:31.447069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:31.447069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:31.447069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:31.447069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:31.447069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:31.447069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:31.447069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:31.447069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:52:31.447069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:52:31.447069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:52:31.448013 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:52:31.448013 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:31.448013 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:31.448013 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:31.448013 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:31.448013 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:31.448013 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:31.448013 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:31.448013 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:31.448013 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:31.448013 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:31.448013 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:31.448013 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:31.448013 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:31.448013 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:31.448013 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:31.448013 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:31.448879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:52:31.448879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:52:31.448879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:52:31.448879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:52:31.448879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:52:31.448879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:52:31.448879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:31.448879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:31.449310 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 451/901] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:52:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:31.450816 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af419a-2a7b-41b7-86fb-02f1995a7238 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:31.461584 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:31.464495 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49905b-251c-4b8f-ab02-ab116321743f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:31.500498 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66277110-f0b7-4aa1-8cdc-e8a79ac10574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:31.501093 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66277110-f0b7-4aa1-8cdc-e8a79ac10574 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:31.501370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66277110-f0b7-4aa1-8cdc-e8a79ac10574 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:31.501637 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66277110-f0b7-4aa1-8cdc-e8a79ac10574 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:31.502287 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66277110-f0b7-4aa1-8cdc-e8a79ac10574 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:31.502586 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66277110-f0b7-4aa1-8cdc-e8a79ac10574 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:31.503947 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66277110-f0b7-4aa1-8cdc-e8a79ac10574 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:31.513286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 451/902] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 14 00:52:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:31.513286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66277110-f0b7-4aa1-8cdc-e8a79ac10574 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:31.521325 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:31.573509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af419a-2a7b-41b7-86fb-02f1995a7238 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:31.610479 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bda891-14d7-4caa-973e-90d1f3f0fd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:31.611030 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bda891-14d7-4caa-973e-90d1f3f0fd8d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:31.611311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bda891-14d7-4caa-973e-90d1f3f0fd8d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:31.611595 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bda891-14d7-4caa-973e-90d1f3f0fd8d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:31.612170 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bda891-14d7-4caa-973e-90d1f3f0fd8d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:31.613656 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bda891-14d7-4caa-973e-90d1f3f0fd8d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:31.622219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66277110-f0b7-4aa1-8cdc-e8a79ac10574 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:31.623593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-59bda891-14d7-4caa-973e-90d1f3f0fd8d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 00:52:31.623593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:31.623593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 00:52:31.623593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 00:52:31.623593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 00:52:31.623593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 00:52:31.623593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 00:52:31.623593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:31.623593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 00:52:31.623593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:31.623593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:52:31.623593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:31.623593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:31.623593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:31.623593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:31.623593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:31.624483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:31.624483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:31.624483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:31.624483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:31.624483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:31.624483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:31.624483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:31.624483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 00:52:31.624483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 00:52:31.624483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 00:52:31.624483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 00:52:31.624483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:31.624483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:31.624483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:31.624483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:31.624483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:31.624483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:31.625344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:31.625344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:31.625344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:31.625344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:31.625344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:31.625344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:31.625344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:31.625344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:31.625344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:31.625344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:31.625344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 00:52:31.625344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:31.625344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 00:52:31.625344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:31.625344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 452/903] 10.222.0.20 () {56 vars in 1132 bytes} [Wed Sep 14 00:52:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:31.626156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bda891-14d7-4caa-973e-90d1f3f0fd8d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:31.662453 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af4283-e6a1-4dbf-bf7c-eba872586a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:31.663056 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af4283-e6a1-4dbf-bf7c-eba872586a85 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:31.663337 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af4283-e6a1-4dbf-bf7c-eba872586a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:31.663607 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af4283-e6a1-4dbf-bf7c-eba872586a85 None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:31.664289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af4283-e6a1-4dbf-bf7c-eba872586a85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:31.664588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af4283-e6a1-4dbf-bf7c-eba872586a85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:31.666034 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af4283-e6a1-4dbf-bf7c-eba872586a85 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:31.683045 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 452/904] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:52:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:31.683045 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af4283-e6a1-4dbf-bf7c-eba872586a85 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:31.711554 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:31.743625 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bda891-14d7-4caa-973e-90d1f3f0fd8d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:31.771109 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:31.785217 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036a571-4e3e-40b3-bb86-bcf229937cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:31.785842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036a571-4e3e-40b3-bb86-bcf229937cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:31.786127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036a571-4e3e-40b3-bb86-bcf229937cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:31.786400 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036a571-4e3e-40b3-bb86-bcf229937cf0 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:31.787086 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036a571-4e3e-40b3-bb86-bcf229937cf0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:31.787384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036a571-4e3e-40b3-bb86-bcf229937cf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:31.788745 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036a571-4e3e-40b3-bb86-bcf229937cf0 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:31.791484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af4283-e6a1-4dbf-bf7c-eba872586a85 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:31.798820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 453/905] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 14 00:52:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:31.798820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036a571-4e3e-40b3-bb86-bcf229937cf0 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:31.839367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662390c-d6b3-4d73-aa02-4cc7c678c3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:31.840246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662390c-d6b3-4d73-aa02-4cc7c678c3c0 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:31.840527 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662390c-d6b3-4d73-aa02-4cc7c678c3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:31.840799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662390c-d6b3-4d73-aa02-4cc7c678c3c0 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:31.842188 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662390c-d6b3-4d73-aa02-4cc7c678c3c0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:31.842501 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662390c-d6b3-4d73-aa02-4cc7c678c3c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:31.844662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662390c-d6b3-4d73-aa02-4cc7c678c3c0 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:31.855592 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 453/906] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Sep 14 00:52:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:31.855592 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662390c-d6b3-4d73-aa02-4cc7c678c3c0 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:31.910721 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036a571-4e3e-40b3-bb86-bcf229937cf0 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:31.944791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5a3ce-f617-4282-99e7-40ebedd1c3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:31.945582 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5a3ce-f617-4282-99e7-40ebedd1c3f9 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:31.946071 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5a3ce-f617-4282-99e7-40ebedd1c3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:31.946410 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5a3ce-f617-4282-99e7-40ebedd1c3f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:31.947196 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5a3ce-f617-4282-99e7-40ebedd1c3f9 None admin] RBAC: Adding query filter params (role.id=021ad4c2b0894799925fdfadbf561b0b, scope.project.id=f37c835c05924364bcd1530d44f024fe, user.id=eb9d1149a417436bbf1577d61407c0a9) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:31.947573 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5a3ce-f617-4282-99e7-40ebedd1c3f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:31.949150 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:31.950189 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5a3ce-f617-4282-99e7-40ebedd1c3f9 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:31.957571 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 454/907] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:52:31 2022] GET /identity/v3/role_assignments?user.id=eb9d1149a417436bbf1577d61407c0a9&scope.project.id=f37c835c05924364bcd1530d44f024fe&role.id=021ad4c2b0894799925fdfadbf561b0b => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:31.958504 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5a3ce-f617-4282-99e7-40ebedd1c3f9 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:31.981596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662390c-d6b3-4d73-aa02-4cc7c678c3c0 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:32.024313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:32.026355 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b8481-95c2-4473-85b0-b3c11c9f8bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:32.028210 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b8481-95c2-4473-85b0-b3c11c9f8bbb None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:32.028210 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b8481-95c2-4473-85b0-b3c11c9f8bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:32.028210 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b8481-95c2-4473-85b0-b3c11c9f8bbb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:32.029037 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b8481-95c2-4473-85b0-b3c11c9f8bbb None admin] RBAC: Adding query filter params (interface=public, service_id=bf00f4fc43214a66ac4c8efece52f956, region_id=RegionOne) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:32.030775 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b8481-95c2-4473-85b0-b3c11c9f8bbb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:32.034381 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b8481-95c2-4473-85b0-b3c11c9f8bbb None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:32.042560 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 454/908] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Sep 14 00:52:31 2022] GET /identity/v3/endpoints?service_id=bf00f4fc43214a66ac4c8efece52f956&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:32.053856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b8481-95c2-4473-85b0-b3c11c9f8bbb None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:32.085358 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5a3ce-f617-4282-99e7-40ebedd1c3f9 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:32.124574 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe68910-7846-4c90-84c2-951f323df026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:32.125364 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe68910-7846-4c90-84c2-951f323df026 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:32.125745 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe68910-7846-4c90-84c2-951f323df026 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:32.126157 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe68910-7846-4c90-84c2-951f323df026 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:32.126899 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe68910-7846-4c90-84c2-951f323df026 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:32.127313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe68910-7846-4c90-84c2-951f323df026 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:32.128910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe68910-7846-4c90-84c2-951f323df026 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:32.139661 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 455/909] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Sep 14 00:52:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:32.140909 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe68910-7846-4c90-84c2-951f323df026 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:32.197836 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b8481-95c2-4473-85b0-b3c11c9f8bbb None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:32.244802 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8dee4d-23be-48f4-b0c8-4648d7366ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:32.246194 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dee4d-23be-48f4-b0c8-4648d7366ddc None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:32.246643 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dee4d-23be-48f4-b0c8-4648d7366ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:32.247318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dee4d-23be-48f4-b0c8-4648d7366ddc None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:32.248829 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8dee4d-23be-48f4-b0c8-4648d7366ddc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:32.251043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8dee4d-23be-48f4-b0c8-4648d7366ddc None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:32.258279 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe68910-7846-4c90-84c2-951f323df026 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:32.266258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 455/910] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Sep 14 00:52:32 2022] GET /identity/v3/services => generated 1497 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 00:52:32.283670 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:32.305288 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ad3a1-8cd2-4178-a144-9ee409ba12fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:32.305952 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ad3a1-8cd2-4178-a144-9ee409ba12fc None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:32.306234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ad3a1-8cd2-4178-a144-9ee409ba12fc None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:32.306502 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ad3a1-8cd2-4178-a144-9ee409ba12fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:32.307204 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ad3a1-8cd2-4178-a144-9ee409ba12fc None admin] RBAC: Adding query filter params (interface=public, service_id=ee063c232f1b401ca37b819dd676d56c, region_id=RegionOne) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:32.307508 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ad3a1-8cd2-4178-a144-9ee409ba12fc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:32.308883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ad3a1-8cd2-4178-a144-9ee409ba12fc None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:32.315904 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 456/911] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Sep 14 00:52:32 2022] GET /identity/v3/endpoints?service_id=ee063c232f1b401ca37b819dd676d56c&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:32.321472 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8dee4d-23be-48f4-b0c8-4648d7366ddc None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:32.342534 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:32.436697 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8dee4d-23be-48f4-b0c8-4648d7366ddc None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:32.476191 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0703be9-a177-456b-b730-a0c538bc8163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:32.476803 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0703be9-a177-456b-b730-a0c538bc8163 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:32.477071 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0703be9-a177-456b-b730-a0c538bc8163 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:32.477335 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0703be9-a177-456b-b730-a0c538bc8163 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:32.477964 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0703be9-a177-456b-b730-a0c538bc8163 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:32.479314 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0703be9-a177-456b-b730-a0c538bc8163 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:32.486497 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 456/912] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Sep 14 00:52:32 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 00:52:33.313053 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4218f9-74f3-44db-93c9-b4e9fba8b6a4 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:33.313571 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4218f9-74f3-44db-93c9-b4e9fba8b6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:33.313571 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4218f9-74f3-44db-93c9-b4e9fba8b6a4 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:33.314995 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 457/913] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:33.320491 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4afb9a-3171-4e4c-9876-3e7c7d85084f None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:33.320880 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4afb9a-3171-4e4c-9876-3e7c7d85084f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:33.321067 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4afb9a-3171-4e4c-9876-3e7c7d85084f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:33.339429 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-5a4afb9a-3171-4e4c-9876-3e7c7d85084f None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:33.340590 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5a4afb9a-3171-4e4c-9876-3e7c7d85084f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:33.411780 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 457/914] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:52:33.690627 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4218f9-74f3-44db-93c9-b4e9fba8b6a4 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:33.797784 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4218f9-74f3-44db-93c9-b4e9fba8b6a4 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:33.833192 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f7915-5fb2-43b3-81ec-885b9cc0e6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:33.833964 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f7915-5fb2-43b3-81ec-885b9cc0e6dd None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:33.834127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f7915-5fb2-43b3-81ec-885b9cc0e6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:33.834400 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f7915-5fb2-43b3-81ec-885b9cc0e6dd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:33.834980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f7915-5fb2-43b3-81ec-885b9cc0e6dd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:33.836327 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f7915-5fb2-43b3-81ec-885b9cc0e6dd None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:33.845689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-143f7915-5fb2-43b3-81ec-885b9cc0e6dd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 00:52:33.845689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:33.845689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 00:52:33.845689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 00:52:33.845689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 00:52:33.845689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 00:52:33.845689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 00:52:33.845689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:33.845689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 00:52:33.845689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:33.845689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:52:33.845689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:33.845689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:33.845689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:33.845689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:33.845689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:33.845689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:33.846680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:33.846680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:33.846680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:33.846680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:33.846680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:33.846680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:33.846680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 00:52:33.846680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 00:52:33.846680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 00:52:33.846680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 00:52:33.846680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:33.846680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:33.846680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:33.846680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:33.846680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:33.846680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:33.847768 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:33.847768 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:33.847768 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:33.847768 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:33.847768 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:33.847768 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:33.847768 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:33.847768 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:33.847768 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:33.847768 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:33.847768 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 00:52:33.847768 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:33.847768 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 00:52:33.847768 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:33.847768 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 458/915] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Sep 14 00:52:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:33.854890 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4afb9a-3171-4e4c-9876-3e7c7d85084f None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:33.867387 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:33.960227 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4afb9a-3171-4e4c-9876-3e7c7d85084f None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:34.012007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38639ed8-cc40-4807-a4e8-1f1d80be6a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:34.012623 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38639ed8-cc40-4807-a4e8-1f1d80be6a1f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:34.012901 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38639ed8-cc40-4807-a4e8-1f1d80be6a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:34.013172 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38639ed8-cc40-4807-a4e8-1f1d80be6a1f None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:34.014370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38639ed8-cc40-4807-a4e8-1f1d80be6a1f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:34.014673 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38639ed8-cc40-4807-a4e8-1f1d80be6a1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:34.016181 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38639ed8-cc40-4807-a4e8-1f1d80be6a1f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:34.021136 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 458/916] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Sep 14 00:52:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:34.027059 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f7915-5fb2-43b3-81ec-885b9cc0e6dd None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:34.081482 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:34.139915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f7915-5fb2-43b3-81ec-885b9cc0e6dd None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:34.175334 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3215e-8c01-4b8e-9692-18f5ae528b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:34.175955 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3215e-8c01-4b8e-9692-18f5ae528b1f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:34.176233 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3215e-8c01-4b8e-9692-18f5ae528b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:34.176504 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3215e-8c01-4b8e-9692-18f5ae528b1f None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:34.177135 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3215e-8c01-4b8e-9692-18f5ae528b1f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:34.177440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3215e-8c01-4b8e-9692-18f5ae528b1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:34.178829 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3215e-8c01-4b8e-9692-18f5ae528b1f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:34.181532 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bd6cc-68b5-440b-ae98-bdc9f3d9fb2f None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:34.181838 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bd6cc-68b5-440b-ae98-bdc9f3d9fb2f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:34.182118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bd6cc-68b5-440b-ae98-bdc9f3d9fb2f None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:34.183763 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 459/917] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:34.184403 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 459/918] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Sep 14 00:52:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:34.189309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c8998-202d-408d-8305-557464a80d85 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:34.189595 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c8998-202d-408d-8305-557464a80d85 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:34.189897 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c8998-202d-408d-8305-557464a80d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:34.191909 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3215e-8c01-4b8e-9692-18f5ae528b1f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:34.208070 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-874c8998-202d-408d-8305-557464a80d85 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:34.209553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-874c8998-202d-408d-8305-557464a80d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:34.290062 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 460/919] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:52:34.311820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3215e-8c01-4b8e-9692-18f5ae528b1f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:34.321406 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:34.347574 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb362cb-54dc-4055-8ebc-e65a4e91a561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:34.348528 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb362cb-54dc-4055-8ebc-e65a4e91a561 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:34.349009 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb362cb-54dc-4055-8ebc-e65a4e91a561 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:34.349477 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb362cb-54dc-4055-8ebc-e65a4e91a561 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:34.350611 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb362cb-54dc-4055-8ebc-e65a4e91a561 None admin] RBAC: Adding query filter params (interface=public, service_id=1f4b69bc18864d58a4820c4309016d49, region_id=RegionOne) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:34.351138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb362cb-54dc-4055-8ebc-e65a4e91a561 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:34.352792 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb362cb-54dc-4055-8ebc-e65a4e91a561 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:34.363093 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 460/920] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Sep 14 00:52:34 2022] GET /identity/v3/endpoints?service_id=1f4b69bc18864d58a4820c4309016d49&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:52:34.364744 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c8998-202d-408d-8305-557464a80d85 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:34.368980 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:34.473733 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c8998-202d-408d-8305-557464a80d85 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:34.511400 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a319e-387c-4644-a817-5013d077b3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:34.512426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a319e-387c-4644-a817-5013d077b3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:34.512952 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a319e-387c-4644-a817-5013d077b3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:34.513480 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a319e-387c-4644-a817-5013d077b3c8 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:34.514349 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a319e-387c-4644-a817-5013d077b3c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:34.516020 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a319e-387c-4644-a817-5013d077b3c8 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:34.526119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 461/921] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Sep 14 00:52:34 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 00:52:34.558548 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb362cb-54dc-4055-8ebc-e65a4e91a561 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:34.586711 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d65c1f-137e-449d-82aa-45476058a0c3 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:34.587360 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d65c1f-137e-449d-82aa-45476058a0c3 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:34.587833 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d65c1f-137e-449d-82aa-45476058a0c3 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:34.589763 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 462/922] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:34.596685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c44d1-dd40-4152-a1fb-a52b33fb94c8 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:34.597314 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c44d1-dd40-4152-a1fb-a52b33fb94c8 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:34.597831 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c44d1-dd40-4152-a1fb-a52b33fb94c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:34.617522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-c78c44d1-dd40-4152-a1fb-a52b33fb94c8 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:34.619211 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c78c44d1-dd40-4152-a1fb-a52b33fb94c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:34.678476 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb362cb-54dc-4055-8ebc-e65a4e91a561 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:34.694514 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:34.710254 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 463/923] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 00:52:34.720614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc1ef8-504b-4f3c-a783-19ec170ccb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:34.721255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc1ef8-504b-4f3c-a783-19ec170ccb95 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:34.721534 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc1ef8-504b-4f3c-a783-19ec170ccb95 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:34.722567 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc1ef8-504b-4f3c-a783-19ec170ccb95 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:34.736131 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc1ef8-504b-4f3c-a783-19ec170ccb95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:52:34.743094 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-09bc1ef8-504b-4f3c-a783-19ec170ccb95 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 00:52:34.743094 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:34.743094 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:34.743094 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:34.743094 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:34.743094 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:34.743094 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:34.743094 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:34.743094 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:34.743094 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:34.743094 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:34.743094 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:34.743094 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:52:34.743094 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:52:34.743094 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:52:34.743094 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:52:34.744019 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:52:34.744019 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:52:34.744019 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:52:34.744019 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:52:34.744019 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:34.744019 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:34.744019 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:34.744019 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:34.744019 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:34.744019 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:34.744019 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:34.744019 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:34.744019 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:34.744019 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:34.744019 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:34.744019 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:34.744869 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:34.744869 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:34.744869 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:34.744869 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:34.744869 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:52:34.744869 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:52:34.744869 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:52:34.744869 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:52:34.744869 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:52:34.744869 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:52:34.744869 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 00:52:34.744869 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:34.744869 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 461/924] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Sep 14 00:52:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:34.750054 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c44d1-dd40-4152-a1fb-a52b33fb94c8 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:34.760301 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75697ac9-2faa-4247-880a-b7e61a3aaf89 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:34.760301 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75697ac9-2faa-4247-880a-b7e61a3aaf89 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:34.760544 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75697ac9-2faa-4247-880a-b7e61a3aaf89 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:34.762159 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 462/925] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:34.767826 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a75771-327b-46f4-8e58-0979d04f7864 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:34.768326 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a75771-327b-46f4-8e58-0979d04f7864 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:34.768769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a75771-327b-46f4-8e58-0979d04f7864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:34.787173 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-23a75771-327b-46f4-8e58-0979d04f7864 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:34.788573 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-23a75771-327b-46f4-8e58-0979d04f7864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:34.816250 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:34.869834 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 463/926] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 00:52:34.878541 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c44d1-dd40-4152-a1fb-a52b33fb94c8 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:34.915398 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c7343-0a8f-4de5-ba1d-525aa84931f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:34.916007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c7343-0a8f-4de5-ba1d-525aa84931f9 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:34.916287 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c7343-0a8f-4de5-ba1d-525aa84931f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:34.916558 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c7343-0a8f-4de5-ba1d-525aa84931f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:34.917223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c7343-0a8f-4de5-ba1d-525aa84931f9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:34.917569 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c7343-0a8f-4de5-ba1d-525aa84931f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:34.919016 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c7343-0a8f-4de5-ba1d-525aa84931f9 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:34.928168 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 464/927] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Sep 14 00:52:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:34.933842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a75771-327b-46f4-8e58-0979d04f7864 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:34.995751 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c7343-0a8f-4de5-ba1d-525aa84931f9 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:35.046338 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a75771-327b-46f4-8e58-0979d04f7864 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:35.078617 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:35.084740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c77fd7-f2b1-4297-910d-6c7b0d725d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:35.085384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c77fd7-f2b1-4297-910d-6c7b0d725d05 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:35.085658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c77fd7-f2b1-4297-910d-6c7b0d725d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:35.085967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c77fd7-f2b1-4297-910d-6c7b0d725d05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:35.098217 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c77fd7-f2b1-4297-910d-6c7b0d725d05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:35.099679 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c77fd7-f2b1-4297-910d-6c7b0d725d05 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:35.117372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-d3c77fd7-f2b1-4297-910d-6c7b0d725d05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:35.117372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:35.117372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:35.117372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:35.117372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:35.117372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:35.117372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:35.117372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:35.117372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:35.117372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:35.117372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:35.117372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:35.117372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:35.117372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:35.117372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:35.117372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:35.118616 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:35.118616 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:35.118616 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:35.118616 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:35.118616 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:35.118616 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:35.118616 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:35.118616 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:35.118616 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:35.118616 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:35.118616 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:35.118616 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:35.118616 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:35.118616 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:35.118616 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:35.118616 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:35.118616 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:35.119742 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:35.119742 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:35.119742 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:35.119742 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 464/928] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:35.126141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c77fd7-f2b1-4297-910d-6c7b0d725d05 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:35.137563 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c7343-0a8f-4de5-ba1d-525aa84931f9 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:35.146845 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:35.176922 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547fb5c-3f6a-4a2d-8446-fbd8dc89f0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:35.177937 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547fb5c-3f6a-4a2d-8446-fbd8dc89f0ab None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:35.178213 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547fb5c-3f6a-4a2d-8446-fbd8dc89f0ab None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:35.178481 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547fb5c-3f6a-4a2d-8446-fbd8dc89f0ab None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:35.179381 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547fb5c-3f6a-4a2d-8446-fbd8dc89f0ab None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:35.180888 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547fb5c-3f6a-4a2d-8446-fbd8dc89f0ab None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:35.190223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-3547fb5c-3f6a-4a2d-8446-fbd8dc89f0ab None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 00:52:35.190223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:35.190223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 00:52:35.190223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 00:52:35.190223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 00:52:35.190223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 00:52:35.190223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 00:52:35.190223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:35.190223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 00:52:35.190223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:35.190223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:52:35.190223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:35.190223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:35.190223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:35.190223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:35.190223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:35.190223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:35.191241 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:35.191241 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:35.191241 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:35.191241 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:35.191241 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:35.191241 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:35.191241 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 00:52:35.191241 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 00:52:35.191241 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 00:52:35.191241 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 00:52:35.191241 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:35.191241 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:35.191241 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:35.191241 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:35.191241 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:35.191241 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:35.192073 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:35.192073 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:35.192073 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:35.192073 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:35.192073 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:35.192073 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:35.192073 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:35.192073 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:35.192073 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:35.192073 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:35.192073 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 00:52:35.192073 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:35.192073 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 00:52:35.192073 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:35.192073 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 465/929] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 14 00:52:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:35.193551 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547fb5c-3f6a-4a2d-8446-fbd8dc89f0ab None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:35.244133 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c77fd7-f2b1-4297-910d-6c7b0d725d05 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:35.280858 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c6cbe-64da-4cad-83ec-ef1b48cb4b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:35.281474 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c6cbe-64da-4cad-83ec-ef1b48cb4b7a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:35.281749 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c6cbe-64da-4cad-83ec-ef1b48cb4b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:35.282048 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c6cbe-64da-4cad-83ec-ef1b48cb4b7a None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:35.282684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c6cbe-64da-4cad-83ec-ef1b48cb4b7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:35.282988 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c6cbe-64da-4cad-83ec-ef1b48cb4b7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:35.284336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c6cbe-64da-4cad-83ec-ef1b48cb4b7a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:35.297026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 465/930] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:35.297876 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c6cbe-64da-4cad-83ec-ef1b48cb4b7a None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:35.298978 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547fb5c-3f6a-4a2d-8446-fbd8dc89f0ab None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:35.324647 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:35.336738 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36b368-b9b3-49d1-949a-865a7cf5eab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:35.337444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36b368-b9b3-49d1-949a-865a7cf5eab7 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:35.337724 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36b368-b9b3-49d1-949a-865a7cf5eab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:35.338041 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36b368-b9b3-49d1-949a-865a7cf5eab7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:35.338621 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36b368-b9b3-49d1-949a-865a7cf5eab7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:35.340683 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36b368-b9b3-49d1-949a-865a7cf5eab7 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:35.349318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-2d36b368-b9b3-49d1-949a-865a7cf5eab7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 00:52:35.349318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:35.349318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 00:52:35.349318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 00:52:35.349318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 00:52:35.349318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 00:52:35.349318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 00:52:35.349318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:35.349318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 00:52:35.349318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:35.349318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:52:35.349318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:35.349318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:35.349318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:35.349318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:35.349318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:35.350383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:35.350383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:35.350383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:35.350383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:35.350383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:35.350383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:35.350383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:35.350383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 00:52:35.350383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 00:52:35.350383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 00:52:35.350383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 00:52:35.350383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:35.350383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:35.350383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:35.350383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:35.350383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:35.350383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:35.351598 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:35.351598 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:35.351598 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:35.351598 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:35.351598 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:35.351598 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:35.351598 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:35.351598 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:35.351598 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:35.351598 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:35.351598 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 00:52:35.351598 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:35.351598 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 00:52:35.351598 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:35.355200 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 466/931] 10.222.0.20 () {56 vars in 1132 bytes} [Wed Sep 14 00:52:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:35.356010 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36b368-b9b3-49d1-949a-865a7cf5eab7 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:35.389229 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:35.417555 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c6cbe-64da-4cad-83ec-ef1b48cb4b7a None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:35.457722 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed124c2-c136-448c-8030-1e08c51fbb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:35.458361 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed124c2-c136-448c-8030-1e08c51fbb4c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:35.458642 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed124c2-c136-448c-8030-1e08c51fbb4c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:35.458916 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed124c2-c136-448c-8030-1e08c51fbb4c None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:35.459543 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed124c2-c136-448c-8030-1e08c51fbb4c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:35.459844 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed124c2-c136-448c-8030-1e08c51fbb4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:35.461194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed124c2-c136-448c-8030-1e08c51fbb4c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:35.462238 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36b368-b9b3-49d1-949a-865a7cf5eab7 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:35.471979 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 466/932] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 14 00:52:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:35.471979 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed124c2-c136-448c-8030-1e08c51fbb4c None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:35.498407 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e97ff7-61e9-4476-bc67-55bf1c253253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:35.499029 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e97ff7-61e9-4476-bc67-55bf1c253253 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:35.499307 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e97ff7-61e9-4476-bc67-55bf1c253253 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:35.499585 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e97ff7-61e9-4476-bc67-55bf1c253253 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:35.507101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e97ff7-61e9-4476-bc67-55bf1c253253 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:35.508692 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e97ff7-61e9-4476-bc67-55bf1c253253 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:35.520631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-44e97ff7-61e9-4476-bc67-55bf1c253253 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 00:52:35.520631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:35.520631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:35.520631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:35.520631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:35.520631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:35.520631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:35.520631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:35.520631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:35.520631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:35.520631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:35.520631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:35.520631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:52:35.520631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:52:35.520631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:52:35.520631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:52:35.521667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:35.521667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:35.521667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:52:35.521667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:35.521667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:52:35.521667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:35.521667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:35.521667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:35.521667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:35.521667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:35.521667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:35.521667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:35.521667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:35.521667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:35.521667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:35.521667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:35.521667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:35.521667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:35.522909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:35.522909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:35.522909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:52:35.522909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:52:35.522909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:52:35.522909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:52:35.522909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:52:35.522909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:52:35.522909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 00:52:35.522909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:35.522909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 467/933] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Sep 14 00:52:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:35.522909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e97ff7-61e9-4476-bc67-55bf1c253253 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:35.579119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:35.591383 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed124c2-c136-448c-8030-1e08c51fbb4c None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:35.625637 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f66da2-0be1-491b-b24f-4551d29d56da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:35.626282 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f66da2-0be1-491b-b24f-4551d29d56da None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:35.626692 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f66da2-0be1-491b-b24f-4551d29d56da None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:35.626965 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f66da2-0be1-491b-b24f-4551d29d56da None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:35.627590 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f66da2-0be1-491b-b24f-4551d29d56da None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:35.627888 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f66da2-0be1-491b-b24f-4551d29d56da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:35.629241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f66da2-0be1-491b-b24f-4551d29d56da None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:35.633901 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 467/934] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Sep 14 00:52:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:35.634662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f66da2-0be1-491b-b24f-4551d29d56da None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:35.637220 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:35.642025 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e97ff7-61e9-4476-bc67-55bf1c253253 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:35.677490 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5fe8c-da2c-4ef0-bc27-6723c55d2f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:35.678119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5fe8c-da2c-4ef0-bc27-6723c55d2f65 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:35.678399 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5fe8c-da2c-4ef0-bc27-6723c55d2f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:35.678676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5fe8c-da2c-4ef0-bc27-6723c55d2f65 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:35.679295 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5fe8c-da2c-4ef0-bc27-6723c55d2f65 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:35.679593 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5fe8c-da2c-4ef0-bc27-6723c55d2f65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:35.680951 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5fe8c-da2c-4ef0-bc27-6723c55d2f65 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:35.690301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 468/935] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 14 00:52:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:35.690301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5fe8c-da2c-4ef0-bc27-6723c55d2f65 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:35.744461 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f66da2-0be1-491b-b24f-4551d29d56da None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:35.779139 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb56cd-1d7e-488b-bcaf-8ea3157dded3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:35.780059 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb56cd-1d7e-488b-bcaf-8ea3157dded3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:35.780351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb56cd-1d7e-488b-bcaf-8ea3157dded3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:35.780620 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb56cd-1d7e-488b-bcaf-8ea3157dded3 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:35.781347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb56cd-1d7e-488b-bcaf-8ea3157dded3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:35.781648 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb56cd-1d7e-488b-bcaf-8ea3157dded3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:35.783134 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb56cd-1d7e-488b-bcaf-8ea3157dded3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:35.791334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5fe8c-da2c-4ef0-bc27-6723c55d2f65 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:35.804954 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:35.807513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 468/936] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Sep 14 00:52:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:35.808360 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb56cd-1d7e-488b-bcaf-8ea3157dded3 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:35.828350 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db84712-51d5-4574-b8c8-588f390c3db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:35.829033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db84712-51d5-4574-b8c8-588f390c3db4 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:35.829834 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db84712-51d5-4574-b8c8-588f390c3db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:35.830181 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db84712-51d5-4574-b8c8-588f390c3db4 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:35.830881 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db84712-51d5-4574-b8c8-588f390c3db4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:35.831253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db84712-51d5-4574-b8c8-588f390c3db4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:35.832690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db84712-51d5-4574-b8c8-588f390c3db4 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:35.837635 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 469/937] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Sep 14 00:52:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:35.843437 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db84712-51d5-4574-b8c8-588f390c3db4 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:35.872530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:35.920564 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb56cd-1d7e-488b-bcaf-8ea3157dded3 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:35.954600 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db84712-51d5-4574-b8c8-588f390c3db4 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:35.956374 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b5b10-248c-48ae-ac73-ff3e1d398f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:35.957076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b5b10-248c-48ae-ac73-ff3e1d398f0e None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:35.957446 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b5b10-248c-48ae-ac73-ff3e1d398f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:35.957830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b5b10-248c-48ae-ac73-ff3e1d398f0e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:35.958495 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b5b10-248c-48ae-ac73-ff3e1d398f0e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:35.959848 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b5b10-248c-48ae-ac73-ff3e1d398f0e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:35.981289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 469/938] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 00:52:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:52:35.982824 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b5b10-248c-48ae-ac73-ff3e1d398f0e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:36.024492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff6f71-9427-4491-b056-94fb2a758bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:36.025513 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff6f71-9427-4491-b056-94fb2a758bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:36.026566 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff6f71-9427-4491-b056-94fb2a758bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:36.026915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff6f71-9427-4491-b056-94fb2a758bc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:36.048046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff6f71-9427-4491-b056-94fb2a758bc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:36.050556 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff6f71-9427-4491-b056-94fb2a758bc1 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:36.072265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-edff6f71-9427-4491-b056-94fb2a758bc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:36.072265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:36.072265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:36.072265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:36.072265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:36.072265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:36.072265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:36.072265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:36.072265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:36.072265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:36.072265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:36.072265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:36.072265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:36.072265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:36.072265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:36.072265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:36.073378 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:36.073378 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:36.073378 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:36.073378 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:36.073378 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:36.073378 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:36.073378 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:36.073378 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:36.073378 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:36.073378 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:36.073378 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:36.073378 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:36.073378 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:36.073378 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:36.073378 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:36.073378 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:36.073378 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:36.074416 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:36.074416 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:36.074416 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:36.075114 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 470/939] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:36.081417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff6f71-9427-4491-b056-94fb2a758bc1 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:36.118375 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:36.121511 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b5b10-248c-48ae-ac73-ff3e1d398f0e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:36.142138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:36.168000 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc5bc6-e9bf-470e-9986-37269d4af9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:36.168907 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc5bc6-e9bf-470e-9986-37269d4af9c4 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:36.169336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc5bc6-e9bf-470e-9986-37269d4af9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:36.169964 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc5bc6-e9bf-470e-9986-37269d4af9c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:36.170910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc5bc6-e9bf-470e-9986-37269d4af9c4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:36.172476 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc5bc6-e9bf-470e-9986-37269d4af9c4 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:36.197275 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 470/940] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 00:52:35 2022] POST /identity/v3/endpoints => generated 347 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:52:36.222784 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff6f71-9427-4491-b056-94fb2a758bc1 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:36.273073 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f7a90-f10c-4282-90c8-a9ea70ccea0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:36.273694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f7a90-f10c-4282-90c8-a9ea70ccea0f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:36.274001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f7a90-f10c-4282-90c8-a9ea70ccea0f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:36.274270 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f7a90-f10c-4282-90c8-a9ea70ccea0f None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:36.274928 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f7a90-f10c-4282-90c8-a9ea70ccea0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:36.275227 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f7a90-f10c-4282-90c8-a9ea70ccea0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:36.276663 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f7a90-f10c-4282-90c8-a9ea70ccea0f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:36.292573 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 471/941] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:36.297341 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc5bc6-e9bf-470e-9986-37269d4af9c4 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:36.411072 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc5bc6-e9bf-470e-9986-37269d4af9c4 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:36.446661 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04359dde-13f9-4a29-bdd7-bf8e597957ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:36.447637 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04359dde-13f9-4a29-bdd7-bf8e597957ad None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:36.448130 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04359dde-13f9-4a29-bdd7-bf8e597957ad None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:36.448595 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04359dde-13f9-4a29-bdd7-bf8e597957ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:36.456426 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04359dde-13f9-4a29-bdd7-bf8e597957ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:36.458142 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04359dde-13f9-4a29-bdd7-bf8e597957ad None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:36.470166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-04359dde-13f9-4a29-bdd7-bf8e597957ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:36.470166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:36.470166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:36.470166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:36.470166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:36.470166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:36.470166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:36.470166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:36.470166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:36.470166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:36.470166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:36.470166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:36.470166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:52:36.470166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:52:36.470166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:52:36.471114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:52:36.471114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:36.471114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:36.471114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:36.471114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:36.471114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:36.471114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:36.471114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:36.471114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:36.471114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:36.471114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:36.471114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:36.471114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:36.471114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:36.471114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:36.471114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:36.471114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:36.471986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:52:36.471986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:52:36.471986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:52:36.471986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:52:36.471986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:52:36.471986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:52:36.471986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:36.471986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:36.474376 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 471/942] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:52:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:36.483414 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f7a90-f10c-4282-90c8-a9ea70ccea0f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:36.568863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:36.590038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f7a90-f10c-4282-90c8-a9ea70ccea0f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:36.628526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f3545-e4e4-4b71-88cc-d403bd0e810c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:36.629447 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f3545-e4e4-4b71-88cc-d403bd0e810c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:36.629894 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f3545-e4e4-4b71-88cc-d403bd0e810c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:36.630361 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f3545-e4e4-4b71-88cc-d403bd0e810c None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:36.631258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f3545-e4e4-4b71-88cc-d403bd0e810c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:36.631710 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f3545-e4e4-4b71-88cc-d403bd0e810c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:36.633357 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f3545-e4e4-4b71-88cc-d403bd0e810c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:36.648068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 472/943] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:52:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:36.654313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04359dde-13f9-4a29-bdd7-bf8e597957ad None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:36.687102 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:36.745103 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc01e1f-664d-4671-86e1-34bee9dc8eda None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:36.745461 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc01e1f-664d-4671-86e1-34bee9dc8eda None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:36.745651 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc01e1f-664d-4671-86e1-34bee9dc8eda None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:36.747256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 473/944] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 00:52:36.752795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569529c8-7d28-4b73-85a7-46aacdc90a9b None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:36.753076 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569529c8-7d28-4b73-85a7-46aacdc90a9b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:36.753346 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569529c8-7d28-4b73-85a7-46aacdc90a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:36.761439 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04359dde-13f9-4a29-bdd7-bf8e597957ad None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:36.771564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-569529c8-7d28-4b73-85a7-46aacdc90a9b None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:36.772741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-569529c8-7d28-4b73-85a7-46aacdc90a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:36.796199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2c1db-c8b1-4b6c-9df8-be631ae138ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:36.796867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2c1db-c8b1-4b6c-9df8-be631ae138ff None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:36.797155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2c1db-c8b1-4b6c-9df8-be631ae138ff None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:36.797428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2c1db-c8b1-4b6c-9df8-be631ae138ff None admin] PATH_INFO: `/v3/projects/f37c835c05924364bcd1530d44f024fe/users/eb9d1149a417436bbf1577d61407c0a9/roles/021ad4c2b0894799925fdfadbf561b0b` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:36.799622 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2c1db-c8b1-4b6c-9df8-be631ae138ff None admin] RBAC: Authorizing `identity:create_grant(project_id=f37c835c05924364bcd1530d44f024fe, user_id=eb9d1149a417436bbf1577d61407c0a9, role_id=021ad4c2b0894799925fdfadbf561b0b)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:36.801053 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2c1db-c8b1-4b6c-9df8-be631ae138ff None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:36.825923 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 472/945] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 14 00:52:36 2022] PUT /identity/v3/projects/f37c835c05924364bcd1530d44f024fe/users/eb9d1149a417436bbf1577d61407c0a9/roles/021ad4c2b0894799925fdfadbf561b0b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 00:52:36.852736 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 474/946] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 00:52:37.127296 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2c1db-c8b1-4b6c-9df8-be631ae138ff None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:37.223815 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:37.233696 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2c1db-c8b1-4b6c-9df8-be631ae138ff None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:37.268826 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bb693-b3e6-4741-9c7f-b1e950d2d1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:37.269381 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bb693-b3e6-4741-9c7f-b1e950d2d1eb None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:37.269661 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bb693-b3e6-4741-9c7f-b1e950d2d1eb None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:37.269960 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bb693-b3e6-4741-9c7f-b1e950d2d1eb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:37.270590 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930bb693-b3e6-4741-9c7f-b1e950d2d1eb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:37.271947 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930bb693-b3e6-4741-9c7f-b1e950d2d1eb None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:37.281085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-930bb693-b3e6-4741-9c7f-b1e950d2d1eb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 00:52:37.281085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:37.281085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 00:52:37.281085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 00:52:37.281085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 00:52:37.281085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 00:52:37.281085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 00:52:37.281085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:37.281085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 00:52:37.281085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:37.281085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:52:37.281085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:37.281085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:37.281085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:37.281085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:37.281085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:37.281085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:37.282065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:37.282065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:37.282065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:37.282065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:37.282065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:37.282065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:37.282065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 00:52:37.282065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 00:52:37.282065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 00:52:37.282065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 00:52:37.282065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:37.282065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:37.282065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:37.282065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:37.282065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:37.282065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:37.282881 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:37.282881 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:37.282881 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:37.282881 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:37.282881 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:37.282881 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:37.282881 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:37.282881 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:37.282881 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:37.282881 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:37.282881 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 00:52:37.282881 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:37.282881 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 00:52:37.282881 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:37.282881 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 473/947] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Sep 14 00:52:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:37.291195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569529c8-7d28-4b73-85a7-46aacdc90a9b None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:37.362639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:37.395154 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569529c8-7d28-4b73-85a7-46aacdc90a9b None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:37.430498 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ce864-0d66-415a-98aa-7f6a36410301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:37.431098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ce864-0d66-415a-98aa-7f6a36410301 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:37.431368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ce864-0d66-415a-98aa-7f6a36410301 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:37.431632 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ce864-0d66-415a-98aa-7f6a36410301 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:37.432248 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ce864-0d66-415a-98aa-7f6a36410301 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:37.432545 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ce864-0d66-415a-98aa-7f6a36410301 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:37.433963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ce864-0d66-415a-98aa-7f6a36410301 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:37.439526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 475/948] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Sep 14 00:52:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:37.445143 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bb693-b3e6-4741-9c7f-b1e950d2d1eb None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:37.550784 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bb693-b3e6-4741-9c7f-b1e950d2d1eb None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:37.586005 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae802de-3150-4473-8cf0-3d890e4bb20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:37.586618 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae802de-3150-4473-8cf0-3d890e4bb20f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:37.586899 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae802de-3150-4473-8cf0-3d890e4bb20f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:37.587173 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae802de-3150-4473-8cf0-3d890e4bb20f None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:37.587803 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae802de-3150-4473-8cf0-3d890e4bb20f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:37.588106 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae802de-3150-4473-8cf0-3d890e4bb20f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:37.589465 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae802de-3150-4473-8cf0-3d890e4bb20f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:37.595470 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 474/949] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Sep 14 00:52:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:37.600766 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ce864-0d66-415a-98aa-7f6a36410301 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:37.712798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ce864-0d66-415a-98aa-7f6a36410301 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:37.748595 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cf5dd-55ad-431a-803a-53c9875083df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:37.749188 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cf5dd-55ad-431a-803a-53c9875083df None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:37.749460 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cf5dd-55ad-431a-803a-53c9875083df None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:37.749726 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cf5dd-55ad-431a-803a-53c9875083df None admin] PATH_INFO: `/v3/endpoints` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:37.750420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1cf5dd-55ad-431a-803a-53c9875083df None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:37.751765 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1cf5dd-55ad-431a-803a-53c9875083df None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:37.756266 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:37.774689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 476/950] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 00:52:37 2022] POST /identity/v3/endpoints => generated 349 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:52:38.359463 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134f7c1-5db8-4a1b-84a1-71629d24502b None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:38.360180 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134f7c1-5db8-4a1b-84a1-71629d24502b None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:38.360679 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134f7c1-5db8-4a1b-84a1-71629d24502b None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:38.362685 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 475/951] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:38.368787 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ffa45-736e-4cc8-ac9b-125ae9a3ae8b None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:38.369401 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ffa45-736e-4cc8-ac9b-125ae9a3ae8b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:38.369904 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ffa45-736e-4cc8-ac9b-125ae9a3ae8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:38.390849 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-bd7ffa45-736e-4cc8-ac9b-125ae9a3ae8b None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:38.392414 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-bd7ffa45-736e-4cc8-ac9b-125ae9a3ae8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:38.469597 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 477/952] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:52:38.499003 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd579a-cfcd-457d-a828-ce84a798fe85 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:38.499513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd579a-cfcd-457d-a828-ce84a798fe85 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:38.499513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd579a-cfcd-457d-a828-ce84a798fe85 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:38.500843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 476/953] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:38.506166 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875eb954-fecf-40e1-92e7-92a7718211fa None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:38.506444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875eb954-fecf-40e1-92e7-92a7718211fa None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:38.506708 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875eb954-fecf-40e1-92e7-92a7718211fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:38.525836 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-875eb954-fecf-40e1-92e7-92a7718211fa None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:38.527029 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-875eb954-fecf-40e1-92e7-92a7718211fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:38.601475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 478/954] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:52:38.740354 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd579a-cfcd-457d-a828-ce84a798fe85 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:38.764688 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:38.854365 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd579a-cfcd-457d-a828-ce84a798fe85 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:38.879312 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875eb954-fecf-40e1-92e7-92a7718211fa None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:38.890995 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af0a0e-007c-4c7a-9d49-c6a0039fceac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:38.891611 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af0a0e-007c-4c7a-9d49-c6a0039fceac None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:38.891893 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af0a0e-007c-4c7a-9d49-c6a0039fceac None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:38.892170 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af0a0e-007c-4c7a-9d49-c6a0039fceac None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:38.892819 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af0a0e-007c-4c7a-9d49-c6a0039fceac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:38.894292 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af0a0e-007c-4c7a-9d49-c6a0039fceac None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:38.896931 dv-cinder-857528-1-smb devstack@keystone.service[81475]: WARNING keystone.server.flask.common [None req-84af0a0e-007c-4c7a-9d49-c6a0039fceac None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 14 00:52:38.917724 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.sql.core [None req-84af0a0e-007c-4c7a-9d49-c6a0039fceac None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 14 00:52:38.917724 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 14 00:52:38.917724 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [parameters: {'id': '556e08e110f840c9895c1f5e01adcd81', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 14 00:52:38.917724 dv-cinder-857528-1-smb devstack@keystone.service[81475]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81475) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 14 00:52:38.926598 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-84af0a0e-007c-4c7a-9d49-c6a0039fceac None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 556e08e110f840c9895c1f5e01adcd81.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 556e08e110f840c9895c1f5e01adcd81. Sep 14 00:52:38.926598 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:38.926598 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 00:52:38.926598 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 00:52:38.926598 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 00:52:38.926598 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 00:52:38.926598 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 00:52:38.926598 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 00:52:38.926598 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 00:52:38.926598 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application conn.query(q) Sep 14 00:52:38.926598 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 00:52:38.926598 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 00:52:38.926598 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 00:52:38.927369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application result.read() Sep 14 00:52:38.927369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 00:52:38.927369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 00:52:38.927369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 00:52:38.927369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 00:52:38.927369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 00:52:38.927369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 00:52:38.927369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 00:52:38.927369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 00:52:38.927369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 14 00:52:38.927369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:38.927369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 14 00:52:38.927369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:38.927369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:38.927369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 14 00:52:38.927369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 14 00:52:38.927369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 14 00:52:38.927369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 14 00:52:38.928303 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 00:52:38.928303 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application next(self.gen) Sep 14 00:52:38.928303 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 14 00:52:38.928303 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application yield resource Sep 14 00:52:38.928303 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 00:52:38.928303 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application next(self.gen) Sep 14 00:52:38.928303 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 14 00:52:38.928303 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self.session.rollback() Sep 14 00:52:38.928303 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 00:52:38.928303 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self.force_reraise() Sep 14 00:52:38.928303 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 00:52:38.928303 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise self.value Sep 14 00:52:38.928303 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 14 00:52:38.928303 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 14 00:52:38.928303 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 14 00:52:38.928303 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application session.commit() Sep 14 00:52:38.928303 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 14 00:52:38.929172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 14 00:52:38.929172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 14 00:52:38.929172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._prepare_impl() Sep 14 00:52:38.929172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 14 00:52:38.929172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self.session.flush() Sep 14 00:52:38.929172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 14 00:52:38.929172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._flush(objects) Sep 14 00:52:38.929172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 14 00:52:38.929172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 14 00:52:38.929172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 14 00:52:38.929172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application compat.raise_( Sep 14 00:52:38.929172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 00:52:38.929172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception Sep 14 00:52:38.929172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 14 00:52:38.929172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application flush_context.execute() Sep 14 00:52:38.929172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 14 00:52:38.929172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rec.execute(self) Sep 14 00:52:38.930089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 14 00:52:38.930089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 14 00:52:38.930089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 14 00:52:38.930089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 14 00:52:38.930089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 14 00:52:38.930089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 14 00:52:38.930089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 14 00:52:38.930089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 14 00:52:38.930089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 14 00:52:38.930089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 14 00:52:38.930089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 14 00:52:38.930089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 14 00:52:38.930089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 14 00:52:38.930089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 14 00:52:38.930089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 14 00:52:38.930861 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 14 00:52:38.930861 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 00:52:38.930861 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception Sep 14 00:52:38.930861 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 00:52:38.930861 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 00:52:38.930861 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 00:52:38.930861 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 00:52:38.930861 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 00:52:38.930861 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 00:52:38.930861 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 00:52:38.930861 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application conn.query(q) Sep 14 00:52:38.930861 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 00:52:38.930861 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 00:52:38.930861 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 00:52:38.930861 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application result.read() Sep 14 00:52:38.930861 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 00:52:38.930861 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 00:52:38.931713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 00:52:38.931713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 00:52:38.931713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 00:52:38.931713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 00:52:38.931713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 00:52:38.931713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 00:52:38.931713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 14 00:52:38.931713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 14 00:52:38.931713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [parameters: {'id': '556e08e110f840c9895c1f5e01adcd81', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 14 00:52:38.931713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 14 00:52:38.931713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:38.931713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:52:38.931713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:38.931713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:38.931713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 14 00:52:38.932489 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 14 00:52:38.932489 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 14 00:52:38.932489 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 14 00:52:38.932489 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 14 00:52:38.932489 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:38.932489 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:52:38.932489 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:38.932489 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:38.932489 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:38.932489 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:38.932489 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:38.932489 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:38.932489 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:38.932489 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:38.932489 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:38.932489 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:38.932489 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:38.933590 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:38.933590 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 14 00:52:38.933590 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 14 00:52:38.933590 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:38.933590 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:38.933590 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 14 00:52:38.933590 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 14 00:52:38.933590 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 556e08e110f840c9895c1f5e01adcd81. Sep 14 00:52:38.933590 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:38.933590 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 477/955] 10.222.0.20 () {60 vars in 1140 bytes} [Wed Sep 14 00:52:38 2022] POST /identity/v3/projects => generated 262 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:38.940164 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:38.942808 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af0a0e-007c-4c7a-9d49-c6a0039fceac None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:38.989183 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875eb954-fecf-40e1-92e7-92a7718211fa None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:39.026445 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc589e-095c-4995-ad92-35cd531b9d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:39.027118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc589e-095c-4995-ad92-35cd531b9d89 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:39.027392 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc589e-095c-4995-ad92-35cd531b9d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:39.027660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc589e-095c-4995-ad92-35cd531b9d89 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:39.028286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc589e-095c-4995-ad92-35cd531b9d89 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:39.030638 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc589e-095c-4995-ad92-35cd531b9d89 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:39.039939 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-98bc589e-095c-4995-ad92-35cd531b9d89 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 00:52:39.039939 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:39.039939 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 00:52:39.039939 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 00:52:39.039939 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 00:52:39.039939 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 00:52:39.039939 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 00:52:39.039939 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:39.039939 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 00:52:39.039939 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:39.039939 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:52:39.039939 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:39.039939 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:39.039939 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:39.039939 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:39.039939 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:39.039939 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:39.040971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:39.040971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:39.040971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:39.040971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:39.040971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:39.040971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:39.040971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 00:52:39.040971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 00:52:39.040971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 00:52:39.040971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 00:52:39.040971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:39.040971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:39.040971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:39.040971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:39.040971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:39.040971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:39.041839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:39.041839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:39.041839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:39.041839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:39.041839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:39.041839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:39.041839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:39.041839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:39.041839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:39.041839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:39.041839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 00:52:39.041839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:39.041839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 00:52:39.041839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:39.046094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 479/956] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:52:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:39.046773 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:39.047042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc589e-095c-4995-ad92-35cd531b9d89 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:39.064548 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af0a0e-007c-4c7a-9d49-c6a0039fceac None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:39.101295 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67feff2b-d40f-4a34-afa0-87db52a885d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:39.101955 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67feff2b-d40f-4a34-afa0-87db52a885d3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:39.102235 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67feff2b-d40f-4a34-afa0-87db52a885d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:39.102506 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67feff2b-d40f-4a34-afa0-87db52a885d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:39.109375 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67feff2b-d40f-4a34-afa0-87db52a885d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:39.111044 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67feff2b-d40f-4a34-afa0-87db52a885d3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:39.122113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-67feff2b-d40f-4a34-afa0-87db52a885d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:39.122113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:39.122113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:39.122113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:39.122113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:39.122113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:39.122113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:39.122113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:39.122113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:39.122113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:39.122113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:39.122113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:39.122113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:52:39.122113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:52:39.122113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:52:39.123733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:52:39.123733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:39.123733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:39.123733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:39.123733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:39.123733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:39.123733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:39.123733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:39.123733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:39.123733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:39.123733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:39.123733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:39.123733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:39.123733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:39.123733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:39.123733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:39.123733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:39.124798 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:52:39.124798 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:52:39.124798 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:52:39.124798 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:52:39.124798 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:52:39.124798 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:52:39.124798 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:39.124798 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:39.124798 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 478/957] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:52:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:52:39.125396 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d06b0-50a6-4f92-aafc-caecf43cf5e0 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:39.125562 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d06b0-50a6-4f92-aafc-caecf43cf5e0 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:39.125853 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d06b0-50a6-4f92-aafc-caecf43cf5e0 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:39.134364 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 479/958] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:39.134364 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d06b0-50a6-4f92-aafc-caecf43cf5e0 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:39.160224 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc589e-095c-4995-ad92-35cd531b9d89 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:39.171038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:39.201284 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506235cb-7100-4932-b09f-02bb82097106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:39.202335 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506235cb-7100-4932-b09f-02bb82097106 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:39.202807 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506235cb-7100-4932-b09f-02bb82097106 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:39.203234 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506235cb-7100-4932-b09f-02bb82097106 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:39.204403 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506235cb-7100-4932-b09f-02bb82097106 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:39.204595 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506235cb-7100-4932-b09f-02bb82097106 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:39.205951 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506235cb-7100-4932-b09f-02bb82097106 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:39.211922 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 480/959] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Sep 14 00:52:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:52:39.212993 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed473b24-5aff-4537-b103-f108769183a2 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:39.213275 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed473b24-5aff-4537-b103-f108769183a2 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:39.213764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed473b24-5aff-4537-b103-f108769183a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:39.237045 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-ed473b24-5aff-4537-b103-f108769183a2 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:39.238746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ed473b24-5aff-4537-b103-f108769183a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:39.255490 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d06b0-50a6-4f92-aafc-caecf43cf5e0 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:39.293039 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7677c23-6058-4af4-abf0-32839ed813b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:39.293784 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7677c23-6058-4af4-abf0-32839ed813b3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:39.294092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7677c23-6058-4af4-abf0-32839ed813b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:39.294390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7677c23-6058-4af4-abf0-32839ed813b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:39.295042 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7677c23-6058-4af4-abf0-32839ed813b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:39.295391 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7677c23-6058-4af4-abf0-32839ed813b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:39.296919 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7677c23-6058-4af4-abf0-32839ed813b3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:39.301338 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:39.309847 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 481/960] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:52:39.309847 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed473b24-5aff-4537-b103-f108769183a2 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:39.322932 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 480/961] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Sep 14 00:52:39 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:39.425230 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed473b24-5aff-4537-b103-f108769183a2 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:39.427901 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:39.465234 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b0723-8808-4863-ac72-d99049836a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:39.465887 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b0723-8808-4863-ac72-d99049836a27 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:39.466164 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b0723-8808-4863-ac72-d99049836a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:39.467059 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b0723-8808-4863-ac72-d99049836a27 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:39.467777 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b0723-8808-4863-ac72-d99049836a27 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:39.468080 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b0723-8808-4863-ac72-d99049836a27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:39.469486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b0723-8808-4863-ac72-d99049836a27 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:39.475153 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 482/962] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Sep 14 00:52:39 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:39.589048 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7677c23-6058-4af4-abf0-32839ed813b3 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:39.706370 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7677c23-6058-4af4-abf0-32839ed813b3 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:39.745832 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b619ce-e2a9-4e69-9ef3-030ae0620f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:39.746568 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b619ce-e2a9-4e69-9ef3-030ae0620f49 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:39.746986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b619ce-e2a9-4e69-9ef3-030ae0620f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:39.747259 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b619ce-e2a9-4e69-9ef3-030ae0620f49 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:39.758410 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b619ce-e2a9-4e69-9ef3-030ae0620f49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:52:39.763264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-16b619ce-e2a9-4e69-9ef3-030ae0620f49 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 00:52:39.763264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:39.763264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:39.763264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:39.763264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:39.763264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:39.763264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:39.763264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:39.763264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:39.763264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:39.763264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:39.763264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:39.763264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:52:39.763264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:52:39.763264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:52:39.763264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:52:39.764180 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:52:39.764180 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:52:39.764180 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:52:39.764180 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:52:39.764180 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:39.764180 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:39.764180 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:39.764180 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:39.764180 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:39.764180 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:39.764180 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:39.764180 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:39.764180 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:39.764180 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:39.764180 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:39.764180 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:39.765646 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:39.765646 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:39.765646 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:39.765646 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:39.765646 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:52:39.765646 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:52:39.765646 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:52:39.765646 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:52:39.765646 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:52:39.765646 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:52:39.765646 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 00:52:39.765646 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:39.765646 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 481/963] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Sep 14 00:52:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:39.771142 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b0723-8808-4863-ac72-d99049836a27 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:39.883429 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b0723-8808-4863-ac72-d99049836a27 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:39.919378 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455be584-1077-4042-8054-169f6d2c9818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:39.920043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455be584-1077-4042-8054-169f6d2c9818 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:39.920316 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455be584-1077-4042-8054-169f6d2c9818 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:39.920579 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455be584-1077-4042-8054-169f6d2c9818 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:39.921234 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455be584-1077-4042-8054-169f6d2c9818 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:39.921526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455be584-1077-4042-8054-169f6d2c9818 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:39.922908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455be584-1077-4042-8054-169f6d2c9818 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:39.931399 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 483/964] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Sep 14 00:52:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:39.936969 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b619ce-e2a9-4e69-9ef3-030ae0620f49 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:40.006019 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:40.047375 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b619ce-e2a9-4e69-9ef3-030ae0620f49 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:40.082104 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11347d-4a05-4b58-9190-d4ba34ed775e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:40.082733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11347d-4a05-4b58-9190-d4ba34ed775e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:40.083007 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11347d-4a05-4b58-9190-d4ba34ed775e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:40.083275 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11347d-4a05-4b58-9190-d4ba34ed775e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:40.094740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11347d-4a05-4b58-9190-d4ba34ed775e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:40.096183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11347d-4a05-4b58-9190-d4ba34ed775e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:40.112628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-2f11347d-4a05-4b58-9190-d4ba34ed775e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:40.112628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:40.112628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:40.112628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:40.112628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:40.112628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:40.112628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:40.112628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:40.112628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:40.112628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:40.112628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:40.112628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:40.112628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:40.112628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:40.112628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:40.112628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:40.113621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:40.113621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:40.113621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:40.113621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:40.113621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:40.113621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:40.113621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:40.113621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:40.113621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:40.113621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:40.113621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:40.113621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:40.113621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:40.113621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:40.113621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:40.113621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:40.113621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:40.114763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:40.114763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:40.114763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:40.114763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 482/965] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:40.123119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455be584-1077-4042-8054-169f6d2c9818 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:40.128161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a06a91-e2f3-4d04-b0ac-fa9799c63e4f None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:40.128466 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a06a91-e2f3-4d04-b0ac-fa9799c63e4f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:40.128739 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a06a91-e2f3-4d04-b0ac-fa9799c63e4f None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:40.130449 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 483/966] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 00:52:40.136501 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a711f0-f588-4355-84ea-2e9698592afe None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:40.136698 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a711f0-f588-4355-84ea-2e9698592afe None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:40.136969 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a711f0-f588-4355-84ea-2e9698592afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:40.157565 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:40.161771 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-a0a711f0-f588-4355-84ea-2e9698592afe None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:40.163535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a0a711f0-f588-4355-84ea-2e9698592afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:40.231499 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455be584-1077-4042-8054-169f6d2c9818 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:40.250004 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 484/967] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 00:52:40.276295 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bfa40-ffc1-477b-893d-510b1a9f9028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:40.276924 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bfa40-ffc1-477b-893d-510b1a9f9028 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:40.277205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bfa40-ffc1-477b-893d-510b1a9f9028 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:40.277479 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bfa40-ffc1-477b-893d-510b1a9f9028 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:40.278249 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bfa40-ffc1-477b-893d-510b1a9f9028 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:40.278554 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bfa40-ffc1-477b-893d-510b1a9f9028 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:40.280363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bfa40-ffc1-477b-893d-510b1a9f9028 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:40.293964 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 484/968] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:40.300414 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a711f0-f588-4355-84ea-2e9698592afe None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:40.340203 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:40.400055 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a711f0-f588-4355-84ea-2e9698592afe None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:40.434228 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e97470-e4aa-4493-9f23-191ef0df9ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:40.434851 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e97470-e4aa-4493-9f23-191ef0df9ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:40.435721 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e97470-e4aa-4493-9f23-191ef0df9ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:40.436002 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e97470-e4aa-4493-9f23-191ef0df9ba3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:40.443076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e97470-e4aa-4493-9f23-191ef0df9ba3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:40.444493 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e97470-e4aa-4493-9f23-191ef0df9ba3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:40.456694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-94e97470-e4aa-4493-9f23-191ef0df9ba3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 00:52:40.456694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:40.456694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:40.456694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:40.456694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:40.456694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:40.456694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:40.456694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:40.456694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:40.456694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:40.456694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:40.456694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:40.456694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:52:40.456694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:52:40.456694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:52:40.456694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:52:40.457718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:40.457718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:40.457718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:52:40.457718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:40.457718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:52:40.457718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:40.457718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:40.457718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:40.457718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:40.457718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:40.457718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:40.457718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:40.457718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:40.457718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:40.457718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:40.457718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:40.457718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:40.457718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:40.459329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:40.459329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:40.459329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:52:40.459329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:52:40.459329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:52:40.459329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:52:40.459329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:52:40.459329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:52:40.459329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 00:52:40.459329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:40.459329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 485/969] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Sep 14 00:52:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:40.464114 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bfa40-ffc1-477b-893d-510b1a9f9028 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:40.558833 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e97470-e4aa-4493-9f23-191ef0df9ba3 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:40.565075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:40.576774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bfa40-ffc1-477b-893d-510b1a9f9028 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:40.622425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7506c6-e05b-4aef-ac93-884ba43d324e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:40.624174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7506c6-e05b-4aef-ac93-884ba43d324e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:40.624604 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7506c6-e05b-4aef-ac93-884ba43d324e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:40.625014 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7506c6-e05b-4aef-ac93-884ba43d324e None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:40.625912 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7506c6-e05b-4aef-ac93-884ba43d324e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:40.626948 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7506c6-e05b-4aef-ac93-884ba43d324e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:40.628853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7506c6-e05b-4aef-ac93-884ba43d324e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:40.650134 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 485/970] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Sep 14 00:52:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:40.665823 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7506c6-e05b-4aef-ac93-884ba43d324e None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:40.681991 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:40.687513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e97470-e4aa-4493-9f23-191ef0df9ba3 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:40.733707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3d00c-90d8-41a1-9da9-0494f2501bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:40.734603 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3d00c-90d8-41a1-9da9-0494f2501bcb None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:40.735308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3d00c-90d8-41a1-9da9-0494f2501bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:40.735725 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3d00c-90d8-41a1-9da9-0494f2501bcb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:40.737044 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3d00c-90d8-41a1-9da9-0494f2501bcb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:40.738905 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3d00c-90d8-41a1-9da9-0494f2501bcb None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:40.750776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-e2a3d00c-90d8-41a1-9da9-0494f2501bcb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 00:52:40.750776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:40.750776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 00:52:40.750776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 00:52:40.750776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 00:52:40.750776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 00:52:40.750776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 00:52:40.750776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:40.750776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 00:52:40.750776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:40.750776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:52:40.750776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:40.750776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:40.750776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:40.750776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:40.750776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:40.750776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:40.751987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:40.751987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:40.751987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:40.751987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:40.751987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:40.751987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:40.751987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 00:52:40.751987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 00:52:40.751987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 00:52:40.751987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 00:52:40.751987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:40.751987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:40.751987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:40.751987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:40.751987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:40.751987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:40.753002 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:40.753002 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:40.753002 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:40.753002 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:40.753002 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:40.753002 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:40.753002 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:40.753002 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:40.753002 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:40.753002 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:40.753002 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 00:52:40.753002 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:40.753002 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 00:52:40.753002 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:40.756114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 486/971] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Sep 14 00:52:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:52:40.762750 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3d00c-90d8-41a1-9da9-0494f2501bcb None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:40.778891 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7506c6-e05b-4aef-ac93-884ba43d324e None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:40.827251 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89249cbc-163c-4300-b32c-d5321c6d81a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:40.827861 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89249cbc-163c-4300-b32c-d5321c6d81a9 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:40.828137 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89249cbc-163c-4300-b32c-d5321c6d81a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:40.828407 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89249cbc-163c-4300-b32c-d5321c6d81a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:40.867300 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:40.875155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3d00c-90d8-41a1-9da9-0494f2501bcb None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:40.916025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48d758-16bb-443a-b000-89c906be5e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:40.917025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48d758-16bb-443a-b000-89c906be5e2a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:40.917511 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48d758-16bb-443a-b000-89c906be5e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:40.918025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48d758-16bb-443a-b000-89c906be5e2a None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:40.918425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89249cbc-163c-4300-b32c-d5321c6d81a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:40.919090 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48d758-16bb-443a-b000-89c906be5e2a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:40.920160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48d758-16bb-443a-b000-89c906be5e2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:40.920417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89249cbc-163c-4300-b32c-d5321c6d81a9 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:40.921980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48d758-16bb-443a-b000-89c906be5e2a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:40.932200 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 487/972] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Sep 14 00:52:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:40.933332 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48d758-16bb-443a-b000-89c906be5e2a None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:40.963585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:41.050382 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48d758-16bb-443a-b000-89c906be5e2a None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:41.053925 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 486/973] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:52:40 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 00:52:41.059039 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89249cbc-163c-4300-b32c-d5321c6d81a9 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:41.099446 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e0edc-3532-448e-850d-2d14eba56cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:41.101203 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e0edc-3532-448e-850d-2d14eba56cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:41.101635 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e0edc-3532-448e-850d-2d14eba56cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:41.102094 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e0edc-3532-448e-850d-2d14eba56cd9 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:41.102883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e0edc-3532-448e-850d-2d14eba56cd9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:41.103329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e0edc-3532-448e-850d-2d14eba56cd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:41.104844 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e0edc-3532-448e-850d-2d14eba56cd9 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:41.112106 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 488/974] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Sep 14 00:52:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:41.117199 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:41.118539 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e0edc-3532-448e-850d-2d14eba56cd9 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:41.188050 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89249cbc-163c-4300-b32c-d5321c6d81a9 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:41.226805 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e487f7-eb7f-4af8-a8a5-96e88b767566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:41.227780 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e487f7-eb7f-4af8-a8a5-96e88b767566 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:41.228261 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e487f7-eb7f-4af8-a8a5-96e88b767566 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:41.228733 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e487f7-eb7f-4af8-a8a5-96e88b767566 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:41.231014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:41.240493 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e487f7-eb7f-4af8-a8a5-96e88b767566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:41.242734 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e487f7-eb7f-4af8-a8a5-96e88b767566 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:41.243701 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e0edc-3532-448e-850d-2d14eba56cd9 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:41.259065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-89e487f7-eb7f-4af8-a8a5-96e88b767566 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:41.259065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:41.259065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:41.259065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:41.259065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:41.259065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:41.259065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:41.259065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:41.259065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:41.259065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:41.259065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:41.259065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:41.259065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:41.259065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:41.259065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:41.259065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:41.260043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:41.260043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:41.260043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:41.260043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:41.260043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:41.260043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:41.260043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:41.260043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:41.260043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:41.260043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:41.260043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:41.260043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:41.260043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:41.260043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:41.260043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:41.260043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:41.260043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:41.260954 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:41.260954 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:41.260954 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:41.263148 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 487/975] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:52:41.269047 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e487f7-eb7f-4af8-a8a5-96e88b767566 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:41.289206 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d168e1-7464-4418-8562-1ac2c9ef07df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:41.289838 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d168e1-7464-4418-8562-1ac2c9ef07df None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:41.290129 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d168e1-7464-4418-8562-1ac2c9ef07df None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:41.290403 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d168e1-7464-4418-8562-1ac2c9ef07df None admin] PATH_INFO: `/v3/endpoints` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:41.291409 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d168e1-7464-4418-8562-1ac2c9ef07df None admin] RBAC: Adding query filter params (interface=admin, service_id=1f4b69bc18864d58a4820c4309016d49, region_id=RegionOne) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:41.291718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d168e1-7464-4418-8562-1ac2c9ef07df None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:41.293518 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d168e1-7464-4418-8562-1ac2c9ef07df None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:41.301844 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 489/976] 10.222.0.20 () {56 vars in 1249 bytes} [Wed Sep 14 00:52:41 2022] GET /identity/v3/endpoints?service_id=1f4b69bc18864d58a4820c4309016d49&interface=admin®ion_id=RegionOne => generated 193 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:41.307429 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d168e1-7464-4418-8562-1ac2c9ef07df None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:41.379927 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:41.383506 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e487f7-eb7f-4af8-a8a5-96e88b767566 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:41.420894 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06630fb7-e0ae-460d-963d-53ccd417ec19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:41.421510 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06630fb7-e0ae-460d-963d-53ccd417ec19 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:41.421789 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06630fb7-e0ae-460d-963d-53ccd417ec19 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:41.422094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06630fb7-e0ae-460d-963d-53ccd417ec19 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:41.422739 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06630fb7-e0ae-460d-963d-53ccd417ec19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:41.423031 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06630fb7-e0ae-460d-963d-53ccd417ec19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:41.424399 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06630fb7-e0ae-460d-963d-53ccd417ec19 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:41.437863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 488/977] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:41.446196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06630fb7-e0ae-460d-963d-53ccd417ec19 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:41.456327 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d168e1-7464-4418-8562-1ac2c9ef07df None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:41.503197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2098137-bbff-4b37-8cfd-02f11cab6f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:41.504059 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2098137-bbff-4b37-8cfd-02f11cab6f9d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:41.504512 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2098137-bbff-4b37-8cfd-02f11cab6f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:41.505384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2098137-bbff-4b37-8cfd-02f11cab6f9d None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:41.506169 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2098137-bbff-4b37-8cfd-02f11cab6f9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:41.508533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2098137-bbff-4b37-8cfd-02f11cab6f9d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:41.517481 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 490/978] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Sep 14 00:52:41 2022] GET /identity/v3/services => generated 1497 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 00:52:41.571047 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4627f93-7735-45b3-bbea-a7f8aef62482 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:41.571637 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4627f93-7735-45b3-bbea-a7f8aef62482 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:41.572484 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4627f93-7735-45b3-bbea-a7f8aef62482 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:41.574910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 491/979] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 00:52:41.581640 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da9078-883a-4188-8e71-66798d6e4ffc None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:41.582232 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da9078-883a-4188-8e71-66798d6e4ffc None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:41.582727 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da9078-883a-4188-8e71-66798d6e4ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:41.583948 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06630fb7-e0ae-460d-963d-53ccd417ec19 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:41.602223 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-87da9078-883a-4188-8e71-66798d6e4ffc None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:41.603839 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-87da9078-883a-4188-8e71-66798d6e4ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:41.622191 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7336b5-f9f2-4255-9711-e5862569e922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:41.622407 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:41.622915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7336b5-f9f2-4255-9711-e5862569e922 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:41.623292 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7336b5-f9f2-4255-9711-e5862569e922 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:41.623572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7336b5-f9f2-4255-9711-e5862569e922 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:41.631178 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7336b5-f9f2-4255-9711-e5862569e922 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:41.632641 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7336b5-f9f2-4255-9711-e5862569e922 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:41.645262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-3d7336b5-f9f2-4255-9711-e5862569e922 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:41.645262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:41.645262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:41.645262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:41.645262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:41.645262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:41.645262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:41.645262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:41.645262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:41.645262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:41.645262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:41.645262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:41.645262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:52:41.645262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:52:41.645262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:52:41.646481 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:52:41.646481 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:41.646481 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:41.646481 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:41.646481 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:41.646481 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:41.646481 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:41.646481 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:41.646481 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:41.646481 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:41.646481 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:41.646481 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:41.646481 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:41.646481 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:41.646481 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:41.646481 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:41.646481 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:41.648001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:52:41.648001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:52:41.648001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:52:41.648001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:52:41.648001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:52:41.648001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:52:41.648001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:41.648001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:41.648001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 489/980] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:52:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:41.653879 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7336b5-f9f2-4255-9711-e5862569e922 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:41.689642 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:41.706126 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 492/981] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 00:52:41.772396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7336b5-f9f2-4255-9711-e5862569e922 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:41.777680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d964a-130e-4339-9aa1-37dfc93584c3 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:41.778001 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d964a-130e-4339-9aa1-37dfc93584c3 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:41.778274 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d964a-130e-4339-9aa1-37dfc93584c3 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:41.780213 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 493/982] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 00:52:41.785088 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cadb3-f891-465c-b379-d7d84b4407e3 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:41.785376 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cadb3-f891-465c-b379-d7d84b4407e3 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:41.785648 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cadb3-f891-465c-b379-d7d84b4407e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:41.804342 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-0a6cadb3-f891-465c-b379-d7d84b4407e3 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:41.805511 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0a6cadb3-f891-465c-b379-d7d84b4407e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:41.810635 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fe74b-fe94-46e0-85a9-1a798420450b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:41.811806 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fe74b-fe94-46e0-85a9-1a798420450b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:41.812348 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fe74b-fe94-46e0-85a9-1a798420450b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:41.812811 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fe74b-fe94-46e0-85a9-1a798420450b None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:41.814203 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fe74b-fe94-46e0-85a9-1a798420450b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:41.814714 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fe74b-fe94-46e0-85a9-1a798420450b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:41.816821 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fe74b-fe94-46e0-85a9-1a798420450b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:41.835346 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 490/983] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:52:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:41.841917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fe74b-fe94-46e0-85a9-1a798420450b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:41.893780 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 494/984] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 00:52:41.938248 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:41.955151 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fe74b-fe94-46e0-85a9-1a798420450b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:41.980769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cadb3-f891-465c-b379-d7d84b4407e3 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:41.991746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e388b7b-5ad4-443f-bd79-1a02acddddea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:41.992351 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e388b7b-5ad4-443f-bd79-1a02acddddea None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:41.992631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e388b7b-5ad4-443f-bd79-1a02acddddea None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:41.992910 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e388b7b-5ad4-443f-bd79-1a02acddddea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:41.993625 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e388b7b-5ad4-443f-bd79-1a02acddddea None admin] RBAC: Adding query filter params (role.id=021ad4c2b0894799925fdfadbf561b0b, scope.project.id=f37c835c05924364bcd1530d44f024fe, user.id=eb9d1149a417436bbf1577d61407c0a9) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:41.993976 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e388b7b-5ad4-443f-bd79-1a02acddddea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:41.995397 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e388b7b-5ad4-443f-bd79-1a02acddddea None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:42.007755 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 491/985] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:52:41 2022] GET /identity/v3/role_assignments?user.id=eb9d1149a417436bbf1577d61407c0a9&scope.project.id=f37c835c05924364bcd1530d44f024fe&role.id=021ad4c2b0894799925fdfadbf561b0b => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:52:42.078505 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:42.103417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cadb3-f891-465c-b379-d7d84b4407e3 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:42.143041 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1f3e0-3003-4cc7-90d8-11212f848df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:42.144069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1f3e0-3003-4cc7-90d8-11212f848df6 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:42.144578 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1f3e0-3003-4cc7-90d8-11212f848df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:42.145049 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1f3e0-3003-4cc7-90d8-11212f848df6 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:42.145941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1f3e0-3003-4cc7-90d8-11212f848df6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:42.147590 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1f3e0-3003-4cc7-90d8-11212f848df6 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:42.166530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.sql.core [None req-7ba1f3e0-3003-4cc7-90d8-11212f848df6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 14 00:52:42.166530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 14 00:52:42.166530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [parameters: {'user_id': 'ae37fadc976a410eb3cdabd9806930c9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 14 00:52:42.166530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81475) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 14 00:52:42.175034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-7ba1f3e0-3003-4cc7-90d8-11212f848df6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 14 00:52:42.175034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:42.175034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 00:52:42.175034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 00:52:42.175034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 00:52:42.175034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 00:52:42.175034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 00:52:42.175034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 00:52:42.175034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 00:52:42.175034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application conn.query(q) Sep 14 00:52:42.175034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 00:52:42.175034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 00:52:42.175034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 00:52:42.175034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application result.read() Sep 14 00:52:42.175034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 00:52:42.175961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 00:52:42.175961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 00:52:42.175961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 00:52:42.175961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 00:52:42.175961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 00:52:42.175961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 00:52:42.175961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 00:52:42.175961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 14 00:52:42.175961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:42.175961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 14 00:52:42.175961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:42.175961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:42.175961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 14 00:52:42.175961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 14 00:52:42.175961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 14 00:52:42.175961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 14 00:52:42.175961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 00:52:42.175961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application next(self.gen) Sep 14 00:52:42.176994 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 14 00:52:42.176994 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application yield resource Sep 14 00:52:42.176994 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 00:52:42.176994 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application next(self.gen) Sep 14 00:52:42.176994 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 14 00:52:42.176994 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self.session.rollback() Sep 14 00:52:42.176994 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 00:52:42.176994 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self.force_reraise() Sep 14 00:52:42.176994 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 00:52:42.176994 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise self.value Sep 14 00:52:42.176994 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 14 00:52:42.176994 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 14 00:52:42.176994 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 14 00:52:42.176994 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application session.commit() Sep 14 00:52:42.176994 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 14 00:52:42.176994 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 14 00:52:42.176994 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 14 00:52:42.177948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._prepare_impl() Sep 14 00:52:42.177948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 14 00:52:42.177948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self.session.flush() Sep 14 00:52:42.177948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 14 00:52:42.177948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._flush(objects) Sep 14 00:52:42.177948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 14 00:52:42.177948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 14 00:52:42.177948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 14 00:52:42.177948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application compat.raise_( Sep 14 00:52:42.177948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 00:52:42.177948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception Sep 14 00:52:42.177948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 14 00:52:42.177948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application flush_context.execute() Sep 14 00:52:42.177948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 14 00:52:42.177948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rec.execute(self) Sep 14 00:52:42.177948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 14 00:52:42.177948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 14 00:52:42.178847 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 14 00:52:42.178847 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 14 00:52:42.178847 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 14 00:52:42.178847 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 14 00:52:42.178847 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 14 00:52:42.178847 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 14 00:52:42.178847 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 14 00:52:42.178847 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 14 00:52:42.178847 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 14 00:52:42.178847 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 14 00:52:42.178847 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 14 00:52:42.178847 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 14 00:52:42.178847 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 14 00:52:42.178847 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 14 00:52:42.178847 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 00:52:42.178847 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception Sep 14 00:52:42.185820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 00:52:42.185820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 00:52:42.185820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 00:52:42.185820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 00:52:42.185820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 00:52:42.185820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 00:52:42.185820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 00:52:42.185820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application conn.query(q) Sep 14 00:52:42.185820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 00:52:42.185820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 00:52:42.185820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 00:52:42.185820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application result.read() Sep 14 00:52:42.185820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 00:52:42.185820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 00:52:42.185820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 00:52:42.185820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 00:52:42.187843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 00:52:42.187843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 00:52:42.187843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 00:52:42.187843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 00:52:42.187843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 14 00:52:42.187843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 14 00:52:42.187843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ae37fadc976a410eb3cdabd9806930c9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 14 00:52:42.187843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 14 00:52:42.187843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:42.187843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:52:42.187843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:42.187843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:42.187843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:42.187843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:42.187843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:42.189879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:42.189879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:42.189879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:42.189879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:42.189879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:42.189879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:42.189879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:42.189879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 14 00:52:42.189879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 14 00:52:42.189879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:42.189879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:42.189879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:52:42.189879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:42.189879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:52:42.189879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:42.189879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 14 00:52:42.189879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 14 00:52:42.193046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 14 00:52:42.193046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 14 00:52:42.193046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 14 00:52:42.193046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 14 00:52:42.193046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 14 00:52:42.193046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:42.193906 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e388b7b-5ad4-443f-bd79-1a02acddddea None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:42.194062 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 495/986] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Sep 14 00:52:41 2022] POST /identity/v3/users => generated 160 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:52:42.194062 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1f3e0-3003-4cc7-90d8-11212f848df6 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:42.308921 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1f3e0-3003-4cc7-90d8-11212f848df6 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:42.313403 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e388b7b-5ad4-443f-bd79-1a02acddddea None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:42.345155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65dfd14-0d62-487c-ab69-627035dce9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:42.345784 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dfd14-0d62-487c-ab69-627035dce9cc None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:42.346101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dfd14-0d62-487c-ab69-627035dce9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:42.346374 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dfd14-0d62-487c-ab69-627035dce9cc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:42.354021 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65dfd14-0d62-487c-ab69-627035dce9cc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:42.355629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65dfd14-0d62-487c-ab69-627035dce9cc None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:42.359365 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:42.362460 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6899f-1b54-4dec-9029-b472eb5d168b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:42.364012 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6899f-1b54-4dec-9029-b472eb5d168b None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:42.364012 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6899f-1b54-4dec-9029-b472eb5d168b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:42.364207 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6899f-1b54-4dec-9029-b472eb5d168b None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:42.365069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6899f-1b54-4dec-9029-b472eb5d168b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:42.366616 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6899f-1b54-4dec-9029-b472eb5d168b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:42.370488 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-c65dfd14-0d62-487c-ab69-627035dce9cc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 00:52:42.370488 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:42.370488 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:42.370488 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:42.370488 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:42.370488 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:42.370488 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:42.370488 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:42.370488 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:42.370488 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:42.370488 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:42.370488 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:42.370488 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:52:42.370488 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:52:42.370488 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:52:42.370488 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:52:42.371392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:42.371392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:42.371392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:52:42.371392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:42.371392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:52:42.371392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:42.371392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:42.371392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:42.371392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:42.371392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:42.371392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:42.371392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:42.371392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:42.371392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:42.371392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:42.371392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:42.371392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:42.371392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:42.372329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:42.372329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:42.372329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:52:42.372329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:52:42.372329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:52:42.372329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:52:42.372329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:52:42.372329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:52:42.372329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 00:52:42.372329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:42.375544 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 496/987] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:52:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:42.381330 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65dfd14-0d62-487c-ab69-627035dce9cc None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:42.389417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 492/988] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Sep 14 00:52:42 2022] POST /identity/v3/services => generated 242 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:52:42.506569 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65dfd14-0d62-487c-ab69-627035dce9cc None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:42.560221 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2500264-0ebe-4b2f-9148-0a6176107b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:42.560760 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2500264-0ebe-4b2f-9148-0a6176107b2b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:42.561042 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2500264-0ebe-4b2f-9148-0a6176107b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:42.561314 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2500264-0ebe-4b2f-9148-0a6176107b2b None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:42.562045 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2500264-0ebe-4b2f-9148-0a6176107b2b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:42.562348 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2500264-0ebe-4b2f-9148-0a6176107b2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:42.563778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2500264-0ebe-4b2f-9148-0a6176107b2b None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:42.600740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 497/989] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 14 00:52:42 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:43.815327 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33859d-3caa-4e21-9dff-ec43105668af None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:43.815915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33859d-3caa-4e21-9dff-ec43105668af None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:43.815915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33859d-3caa-4e21-9dff-ec43105668af None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:43.817208 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 493/990] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:43.822417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0254b6-fa59-4328-bbf3-ebecc14debe9 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:43.822808 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0254b6-fa59-4328-bbf3-ebecc14debe9 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:43.823009 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0254b6-fa59-4328-bbf3-ebecc14debe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:43.840917 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-7b0254b6-fa59-4328-bbf3-ebecc14debe9 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:43.842470 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7b0254b6-fa59-4328-bbf3-ebecc14debe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:43.894920 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:43.913679 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 498/991] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:43 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:52:44.176960 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33859d-3caa-4e21-9dff-ec43105668af None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:44.180785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:44.256103 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72026f20-b3b8-49c1-b421-18385ef817d5 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:44.256380 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72026f20-b3b8-49c1-b421-18385ef817d5 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:44.256655 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72026f20-b3b8-49c1-b421-18385ef817d5 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:44.258182 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 499/992] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 00:52:44.264257 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de19a9-bb3c-4c7b-80c1-11def2af89bb None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:44.264547 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de19a9-bb3c-4c7b-80c1-11def2af89bb None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:44.264976 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de19a9-bb3c-4c7b-80c1-11def2af89bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:44.282877 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-a1de19a9-bb3c-4c7b-80c1-11def2af89bb None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:44.284081 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a1de19a9-bb3c-4c7b-80c1-11def2af89bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:44.284331 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33859d-3caa-4e21-9dff-ec43105668af None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:44.324860 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c2de8-b197-4f7e-ba31-00a673d07d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:44.326484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c2de8-b197-4f7e-ba31-00a673d07d76 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:44.327093 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c2de8-b197-4f7e-ba31-00a673d07d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:44.327424 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c2de8-b197-4f7e-ba31-00a673d07d76 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:44.328117 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c2de8-b197-4f7e-ba31-00a673d07d76 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:44.329506 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c2de8-b197-4f7e-ba31-00a673d07d76 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:44.338317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-031c2de8-b197-4f7e-ba31-00a673d07d76 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 00:52:44.338317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:44.338317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 00:52:44.338317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 00:52:44.338317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 00:52:44.338317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 00:52:44.338317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 00:52:44.338317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:44.338317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 00:52:44.338317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:44.338317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:52:44.338317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:44.338317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:44.338317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:44.338317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:44.338317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:44.338317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:44.339320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:44.339320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:44.339320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:44.339320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:44.339320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:44.339320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:44.339320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 00:52:44.339320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 00:52:44.339320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 00:52:44.339320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 00:52:44.339320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:44.339320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:44.339320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:44.339320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:44.339320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:44.339320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:44.340161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:44.340161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:44.340161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:44.340161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:44.340161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:44.340161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:44.340161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:44.340161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:44.340161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:44.340161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:44.340161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 00:52:44.340161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:44.340161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 00:52:44.340161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:44.340161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 494/993] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Sep 14 00:52:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:44.345133 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c2de8-b197-4f7e-ba31-00a673d07d76 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:44.355313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 500/994] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:44 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 00:52:44.414525 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:44.449628 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c2de8-b197-4f7e-ba31-00a673d07d76 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:44.483861 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247890f-e14d-4ca4-bb5f-4f55f3dfc6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:44.484463 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247890f-e14d-4ca4-bb5f-4f55f3dfc6fa None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:44.484736 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247890f-e14d-4ca4-bb5f-4f55f3dfc6fa None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:44.485002 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247890f-e14d-4ca4-bb5f-4f55f3dfc6fa None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:44.485618 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247890f-e14d-4ca4-bb5f-4f55f3dfc6fa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:44.485940 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247890f-e14d-4ca4-bb5f-4f55f3dfc6fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:44.487288 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247890f-e14d-4ca4-bb5f-4f55f3dfc6fa None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:44.496826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 495/995] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Sep 14 00:52:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:52:44.503286 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de19a9-bb3c-4c7b-80c1-11def2af89bb None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:44.606580 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de19a9-bb3c-4c7b-80c1-11def2af89bb None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:44.620434 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:44.621665 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247890f-e14d-4ca4-bb5f-4f55f3dfc6fa None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:44.643606 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c08dbe-0da3-4a7e-a347-18f1ab0d8276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:44.644241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c08dbe-0da3-4a7e-a347-18f1ab0d8276 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:44.644520 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c08dbe-0da3-4a7e-a347-18f1ab0d8276 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:44.644789 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c08dbe-0da3-4a7e-a347-18f1ab0d8276 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:44.645403 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c08dbe-0da3-4a7e-a347-18f1ab0d8276 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:44.645703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c08dbe-0da3-4a7e-a347-18f1ab0d8276 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:44.647088 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c08dbe-0da3-4a7e-a347-18f1ab0d8276 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:44.657415 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 501/996] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Sep 14 00:52:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:52:44.657415 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39f845-e6e9-4506-b4cc-b4ffd8368bb2 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:44.657415 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39f845-e6e9-4506-b4cc-b4ffd8368bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:44.657415 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39f845-e6e9-4506-b4cc-b4ffd8368bb2 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:44.657415 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 502/997] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:44.658291 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39f845-e6e9-4506-b4cc-b4ffd8368bb2 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:44.730482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247890f-e14d-4ca4-bb5f-4f55f3dfc6fa None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:44.754731 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39f845-e6e9-4506-b4cc-b4ffd8368bb2 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:44.758367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:44.764165 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb5c7d-0457-410e-b588-50baf16f0fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:44.764854 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb5c7d-0457-410e-b588-50baf16f0fcb None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:44.765132 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb5c7d-0457-410e-b588-50baf16f0fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:44.765396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb5c7d-0457-410e-b588-50baf16f0fcb None admin] PATH_INFO: `/v3/services/image` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:44.765997 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb5c7d-0457-410e-b588-50baf16f0fcb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:44.767347 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb5c7d-0457-410e-b588-50baf16f0fcb None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:44.775744 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-89bb5c7d-0457-410e-b588-50baf16f0fcb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 00:52:44.775744 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:44.775744 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 00:52:44.775744 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 00:52:44.775744 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 00:52:44.775744 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 00:52:44.775744 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 00:52:44.775744 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:44.775744 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 00:52:44.775744 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:44.775744 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:52:44.775744 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:44.775744 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:44.775744 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:44.775744 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:44.775744 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:44.775744 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:44.776908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:44.776908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:44.776908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:44.776908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:44.776908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:44.776908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:44.776908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 00:52:44.776908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 00:52:44.776908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 00:52:44.776908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 00:52:44.776908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:44.776908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:44.776908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:44.776908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:44.776908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:44.776908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:44.777760 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:44.777760 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:44.777760 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:44.777760 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:44.777760 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:44.777760 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:44.777760 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:44.777760 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:44.777760 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:44.777760 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:44.777760 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 00:52:44.777760 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:44.777760 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 00:52:44.777760 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:44.777760 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 496/998] 10.222.0.20 () {56 vars in 1105 bytes} [Wed Sep 14 00:52:44 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:52:44.778788 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fb4bc-7455-4ae5-ba57-cf26e759aafd None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:44.778788 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fb4bc-7455-4ae5-ba57-cf26e759aafd None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:44.778788 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fb4bc-7455-4ae5-ba57-cf26e759aafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:44.790951 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e8d93-8596-43e8-ac37-36d8a566ceee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:44.791556 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e8d93-8596-43e8-ac37-36d8a566ceee None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:44.791834 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e8d93-8596-43e8-ac37-36d8a566ceee None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:44.792101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e8d93-8596-43e8-ac37-36d8a566ceee None admin] PATH_INFO: `/v3/endpoints` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:44.792761 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e8d93-8596-43e8-ac37-36d8a566ceee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:44.794132 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e8d93-8596-43e8-ac37-36d8a566ceee None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:44.797238 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-571fb4bc-7455-4ae5-ba57-cf26e759aafd None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:44.798431 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-571fb4bc-7455-4ae5-ba57-cf26e759aafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:44.810430 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 503/999] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 00:52:44 2022] POST /identity/v3/endpoints => generated 325 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 00:52:44.811216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e8d93-8596-43e8-ac37-36d8a566ceee None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:44.856186 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:44.895289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 497/1000] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:44 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:52:44.929283 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e8d93-8596-43e8-ac37-36d8a566ceee None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:44.967938 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06674a9-9de4-463c-b4df-88b8824dafb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:44.968566 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06674a9-9de4-463c-b4df-88b8824dafb7 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:44.968845 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06674a9-9de4-463c-b4df-88b8824dafb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:44.969116 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06674a9-9de4-463c-b4df-88b8824dafb7 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:44.969753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06674a9-9de4-463c-b4df-88b8824dafb7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:44.970091 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06674a9-9de4-463c-b4df-88b8824dafb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:44.971467 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06674a9-9de4-463c-b4df-88b8824dafb7 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:44.977086 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 504/1001] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:44.982976 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fb4bc-7455-4ae5-ba57-cf26e759aafd None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:45.088995 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fb4bc-7455-4ae5-ba57-cf26e759aafd None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:45.112823 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:45.125441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8716a3-6d2c-4dd3-b422-53c9e187aac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:45.126253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8716a3-6d2c-4dd3-b422-53c9e187aac1 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:45.126670 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8716a3-6d2c-4dd3-b422-53c9e187aac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:45.127081 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8716a3-6d2c-4dd3-b422-53c9e187aac1 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:45.127836 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8716a3-6d2c-4dd3-b422-53c9e187aac1 None admin] RBAC: Adding query filter params (type=image) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:45.128294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8716a3-6d2c-4dd3-b422-53c9e187aac1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:45.129786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8716a3-6d2c-4dd3-b422-53c9e187aac1 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:45.134741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 498/1002] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:44 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:45.174714 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06674a9-9de4-463c-b4df-88b8824dafb7 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:45.283688 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06674a9-9de4-463c-b4df-88b8824dafb7 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:45.285234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:45.322082 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4994d8-8178-4ba4-8098-e066052175f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:45.322970 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4994d8-8178-4ba4-8098-e066052175f2 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:45.323250 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4994d8-8178-4ba4-8098-e066052175f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:45.323526 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4994d8-8178-4ba4-8098-e066052175f2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:45.324111 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4994d8-8178-4ba4-8098-e066052175f2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:45.325606 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4994d8-8178-4ba4-8098-e066052175f2 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:45.334514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-fd4994d8-8178-4ba4-8098-e066052175f2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 00:52:45.334514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:45.334514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 00:52:45.334514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 00:52:45.334514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 00:52:45.334514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 00:52:45.334514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 00:52:45.334514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:45.334514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 00:52:45.334514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:45.334514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:52:45.334514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:45.334514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:45.334514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:45.334514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:45.334514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:45.334514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:45.335492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:45.335492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:45.335492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:45.335492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:45.335492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:45.335492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:45.335492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 00:52:45.335492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 00:52:45.335492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 00:52:45.335492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 00:52:45.335492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:45.335492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:45.335492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:45.335492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:45.335492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:45.335492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:45.336384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:45.336384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:45.336384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:45.336384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:45.336384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:45.336384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:45.336384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:45.336384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:45.336384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:45.336384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:45.336384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 00:52:45.336384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:45.336384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 00:52:45.336384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:45.336384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 505/1003] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:52:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:45.341765 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8716a3-6d2c-4dd3-b422-53c9e187aac1 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:45.442503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8716a3-6d2c-4dd3-b422-53c9e187aac1 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:45.475491 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b569b7b-f174-4e7b-8b1a-01b5a7e5c32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:45.476093 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b569b7b-f174-4e7b-8b1a-01b5a7e5c32d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:45.476432 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b569b7b-f174-4e7b-8b1a-01b5a7e5c32d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:45.476708 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b569b7b-f174-4e7b-8b1a-01b5a7e5c32d None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:45.477331 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b569b7b-f174-4e7b-8b1a-01b5a7e5c32d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:45.477633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b569b7b-f174-4e7b-8b1a-01b5a7e5c32d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:45.479018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b569b7b-f174-4e7b-8b1a-01b5a7e5c32d None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:45.485592 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 499/1004] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Sep 14 00:52:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:45.490242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4994d8-8178-4ba4-8098-e066052175f2 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:45.590204 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4994d8-8178-4ba4-8098-e066052175f2 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:45.627062 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20772a-556e-4e8c-85d0-65ac59b4ebb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:45.627669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20772a-556e-4e8c-85d0-65ac59b4ebb2 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:45.627971 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20772a-556e-4e8c-85d0-65ac59b4ebb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:45.628248 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20772a-556e-4e8c-85d0-65ac59b4ebb2 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:45.628871 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20772a-556e-4e8c-85d0-65ac59b4ebb2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:45.629174 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20772a-556e-4e8c-85d0-65ac59b4ebb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:45.630567 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20772a-556e-4e8c-85d0-65ac59b4ebb2 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:45.635468 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 506/1005] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Sep 14 00:52:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:45.641751 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b569b7b-f174-4e7b-8b1a-01b5a7e5c32d None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:45.693353 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:45.748734 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b569b7b-f174-4e7b-8b1a-01b5a7e5c32d None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:45.787401 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c730c-45d8-4c2f-86fa-b1527b110ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:45.788003 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c730c-45d8-4c2f-86fa-b1527b110ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:45.788280 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c730c-45d8-4c2f-86fa-b1527b110ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:45.788548 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c730c-45d8-4c2f-86fa-b1527b110ed2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:45.789243 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c730c-45d8-4c2f-86fa-b1527b110ed2 None admin] RBAC: Adding query filter params (interface=public, service_id=053b313222634cd6a77b9836b2811633, region_id=RegionOne) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:45.789549 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c730c-45d8-4c2f-86fa-b1527b110ed2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:45.790941 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c730c-45d8-4c2f-86fa-b1527b110ed2 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:45.800740 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 500/1006] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Sep 14 00:52:45 2022] GET /identity/v3/endpoints?service_id=053b313222634cd6a77b9836b2811633&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:45.801944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20772a-556e-4e8c-85d0-65ac59b4ebb2 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:45.832287 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:45.901456 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20772a-556e-4e8c-85d0-65ac59b4ebb2 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:45.934607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f3cbf-bd9c-454c-b232-79820e4e174a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:45.935261 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f3cbf-bd9c-454c-b232-79820e4e174a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:45.935538 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f3cbf-bd9c-454c-b232-79820e4e174a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:45.935849 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f3cbf-bd9c-454c-b232-79820e4e174a None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:45.936451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f3cbf-bd9c-454c-b232-79820e4e174a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:45.937826 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f3cbf-bd9c-454c-b232-79820e4e174a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:45.944222 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 507/1007] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Sep 14 00:52:45 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 00:52:47.000630 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546efae-3c40-4904-b76b-f9dee7823f96 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:47.002236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546efae-3c40-4904-b76b-f9dee7823f96 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:47.002506 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546efae-3c40-4904-b76b-f9dee7823f96 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:47.004089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 501/1008] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:47.009520 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77dc85f-8e3d-43ed-bb55-3bc30d632481 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:47.009924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77dc85f-8e3d-43ed-bb55-3bc30d632481 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:47.010200 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77dc85f-8e3d-43ed-bb55-3bc30d632481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:47.030209 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-f77dc85f-8e3d-43ed-bb55-3bc30d632481 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:47.031404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f77dc85f-8e3d-43ed-bb55-3bc30d632481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:47.098708 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 508/1009] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:47 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:52:47.288145 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6edac7-a7cd-4fa1-8661-c5e90ef39ab2 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:47.288422 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6edac7-a7cd-4fa1-8661-c5e90ef39ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:47.288617 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6edac7-a7cd-4fa1-8661-c5e90ef39ab2 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:47.290069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 502/1010] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:47.295610 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28858f03-90ca-499a-bc6d-c7f7c0ed0c54 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:47.295896 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28858f03-90ca-499a-bc6d-c7f7c0ed0c54 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:47.296167 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28858f03-90ca-499a-bc6d-c7f7c0ed0c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:47.313887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-28858f03-90ca-499a-bc6d-c7f7c0ed0c54 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:47.315051 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-28858f03-90ca-499a-bc6d-c7f7c0ed0c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:47.331718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:47.366911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6edac7-a7cd-4fa1-8661-c5e90ef39ab2 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:47.382073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 509/1011] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:47 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:52:47.472142 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6edac7-a7cd-4fa1-8661-c5e90ef39ab2 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:47.485969 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:47.506783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3e145-1f86-48fc-8949-61532fe1a563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:47.507403 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3e145-1f86-48fc-8949-61532fe1a563 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:47.507678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3e145-1f86-48fc-8949-61532fe1a563 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:47.507946 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3e145-1f86-48fc-8949-61532fe1a563 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:47.509046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3e145-1f86-48fc-8949-61532fe1a563 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:47.510512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3e145-1f86-48fc-8949-61532fe1a563 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:47.512194 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 503/1012] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:52:47.518432 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28858f03-90ca-499a-bc6d-c7f7c0ed0c54 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:47.617103 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28858f03-90ca-499a-bc6d-c7f7c0ed0c54 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:47.644404 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3e145-1f86-48fc-8949-61532fe1a563 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:47.652445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f8d45-b87b-4d6e-8199-b8216672efbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:47.653466 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f8d45-b87b-4d6e-8199-b8216672efbe None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:47.653814 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f8d45-b87b-4d6e-8199-b8216672efbe None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:47.654095 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f8d45-b87b-4d6e-8199-b8216672efbe None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:47.654749 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f8d45-b87b-4d6e-8199-b8216672efbe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:47.657096 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f8d45-b87b-4d6e-8199-b8216672efbe None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:47.688260 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 510/1013] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Sep 14 00:52:47 2022] POST /identity/v3/projects => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 00:52:47.783465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3e145-1f86-48fc-8949-61532fe1a563 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:47.820562 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a220a25-0cf6-4deb-bed0-f0ab4ce68c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:47.821185 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a220a25-0cf6-4deb-bed0-f0ab4ce68c9a None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:47.821458 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a220a25-0cf6-4deb-bed0-f0ab4ce68c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:47.821725 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a220a25-0cf6-4deb-bed0-f0ab4ce68c9a None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:47.822431 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a220a25-0cf6-4deb-bed0-f0ab4ce68c9a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:47.823806 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a220a25-0cf6-4deb-bed0-f0ab4ce68c9a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:47.840191 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 504/1014] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Sep 14 00:52:47 2022] POST /identity/v3/services => generated 242 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 00:52:48.143557 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8fe1c-015b-4f06-8aa9-b7a695e114b4 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:48.144071 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8fe1c-015b-4f06-8aa9-b7a695e114b4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:48.144147 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8fe1c-015b-4f06-8aa9-b7a695e114b4 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:48.145604 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 511/1015] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:48.150555 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f2ac2-a82b-4e62-87bb-9c13c39a7f6a None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:48.150932 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f2ac2-a82b-4e62-87bb-9c13c39a7f6a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:48.151110 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f2ac2-a82b-4e62-87bb-9c13c39a7f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:48.171018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-ac7f2ac2-a82b-4e62-87bb-9c13c39a7f6a None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:48.172207 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ac7f2ac2-a82b-4e62-87bb-9c13c39a7f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:48.210218 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:48.251627 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 505/1016] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:48 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:52:48.517314 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8fe1c-015b-4f06-8aa9-b7a695e114b4 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:48.527220 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:48.623718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8fe1c-015b-4f06-8aa9-b7a695e114b4 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:48.660020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66c221-7c8e-4bed-9920-362d39b08c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:48.660649 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66c221-7c8e-4bed-9920-362d39b08c88 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:48.660937 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66c221-7c8e-4bed-9920-362d39b08c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:48.661211 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66c221-7c8e-4bed-9920-362d39b08c88 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:48.661789 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66c221-7c8e-4bed-9920-362d39b08c88 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:48.663168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66c221-7c8e-4bed-9920-362d39b08c88 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:48.672417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-5f66c221-7c8e-4bed-9920-362d39b08c88 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 00:52:48.672417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:48.672417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 00:52:48.672417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 00:52:48.672417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 00:52:48.672417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 00:52:48.672417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 00:52:48.672417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:48.672417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 00:52:48.672417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:48.672417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:52:48.672417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:48.672417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:48.672417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:48.672417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:48.672417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:48.672417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:48.673383 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:48.673383 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:48.673383 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:48.673383 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:48.673383 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:48.673383 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:48.673383 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 00:52:48.673383 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 00:52:48.673383 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 00:52:48.673383 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 00:52:48.673383 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:48.673383 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:48.673383 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:48.673383 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:48.673383 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:48.673383 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:48.674797 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:48.674797 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:48.674797 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:48.674797 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:48.674797 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:48.674797 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:48.674797 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:48.674797 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:48.674797 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:48.674797 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:48.674797 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 00:52:48.674797 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:48.674797 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 00:52:48.674797 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:48.677945 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 512/1017] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:52:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:48.679448 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f2ac2-a82b-4e62-87bb-9c13c39a7f6a None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:48.782219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f2ac2-a82b-4e62-87bb-9c13c39a7f6a None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:48.815667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9a8e1-4a9f-4a81-99a9-ac99e18e358b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:48.816320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9a8e1-4a9f-4a81-99a9-ac99e18e358b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:48.816597 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9a8e1-4a9f-4a81-99a9-ac99e18e358b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:48.816863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9a8e1-4a9f-4a81-99a9-ac99e18e358b None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:48.817527 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9a8e1-4a9f-4a81-99a9-ac99e18e358b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:48.817899 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9a8e1-4a9f-4a81-99a9-ac99e18e358b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:48.819344 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9a8e1-4a9f-4a81-99a9-ac99e18e358b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:48.828752 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 506/1018] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Sep 14 00:52:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:48.830235 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66c221-7c8e-4bed-9920-362d39b08c88 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:48.901419 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:48.933622 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66c221-7c8e-4bed-9920-362d39b08c88 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:48.966687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96886d2-1e77-404f-bfef-ebb96e69221a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:48.967296 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96886d2-1e77-404f-bfef-ebb96e69221a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:48.967578 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96886d2-1e77-404f-bfef-ebb96e69221a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:48.967851 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96886d2-1e77-404f-bfef-ebb96e69221a None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:48.968473 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96886d2-1e77-404f-bfef-ebb96e69221a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:48.968775 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96886d2-1e77-404f-bfef-ebb96e69221a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:48.970183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96886d2-1e77-404f-bfef-ebb96e69221a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:48.979658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 513/1019] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Sep 14 00:52:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:48.984744 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9a8e1-4a9f-4a81-99a9-ac99e18e358b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:49.022058 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:49.094770 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9a8e1-4a9f-4a81-99a9-ac99e18e358b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:49.133563 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c1f6f-9966-4b9c-995e-5e9f775aa539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:49.134258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c1f6f-9966-4b9c-995e-5e9f775aa539 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:49.134533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c1f6f-9966-4b9c-995e-5e9f775aa539 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:49.134800 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c1f6f-9966-4b9c-995e-5e9f775aa539 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:49.135460 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c1f6f-9966-4b9c-995e-5e9f775aa539 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:49.136815 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c1f6f-9966-4b9c-995e-5e9f775aa539 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:49.157716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 507/1020] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 00:52:48 2022] POST /identity/v3/endpoints => generated 334 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 00:52:49.909413 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3b21f-1473-4dcf-9209-cd4eef8c2272 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:49.909992 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3b21f-1473-4dcf-9209-cd4eef8c2272 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:49.909992 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3b21f-1473-4dcf-9209-cd4eef8c2272 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:49.911529 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 514/1021] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 00:52:49.917155 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee4777-012e-4a78-a38f-e661687b3f4d None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:49.917433 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee4777-012e-4a78-a38f-e661687b3f4d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:49.917688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee4777-012e-4a78-a38f-e661687b3f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:49.936914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-79ee4777-012e-4a78-a38f-e661687b3f4d None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:49.938111 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-79ee4777-012e-4a78-a38f-e661687b3f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:50.010989 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572feb17-ee0b-4d06-8d1c-6e242a06b8f2 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:50.011275 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572feb17-ee0b-4d06-8d1c-6e242a06b8f2 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:50.011548 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572feb17-ee0b-4d06-8d1c-6e242a06b8f2 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:50.012931 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 515/1022] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 00:52:50.018838 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5ccf7-260e-4771-b9dd-e5e6a79bb7a3 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:50.018838 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5ccf7-260e-4771-b9dd-e5e6a79bb7a3 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:50.019284 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5ccf7-260e-4771-b9dd-e5e6a79bb7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:50.019901 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 508/1023] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:52:50.041834 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-85e5ccf7-260e-4771-b9dd-e5e6a79bb7a3 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:50.043116 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-85e5ccf7-260e-4771-b9dd-e5e6a79bb7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:50.121910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 516/1024] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 00:52:50.300192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee4777-012e-4a78-a38f-e661687b3f4d None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:50.315539 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:50.387302 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5ccf7-260e-4771-b9dd-e5e6a79bb7a3 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:50.404807 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee4777-012e-4a78-a38f-e661687b3f4d None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:50.441111 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aca414-33f8-4b25-b881-1119c77ff9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:50.442060 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aca414-33f8-4b25-b881-1119c77ff9d2 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:50.442339 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aca414-33f8-4b25-b881-1119c77ff9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:50.442609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aca414-33f8-4b25-b881-1119c77ff9d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:50.444050 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aca414-33f8-4b25-b881-1119c77ff9d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:50.445128 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aca414-33f8-4b25-b881-1119c77ff9d2 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:50.447025 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 509/1025] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:50.452837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aca414-33f8-4b25-b881-1119c77ff9d2 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:50.457540 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:50.504128 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5ccf7-260e-4771-b9dd-e5e6a79bb7a3 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:50.541113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e86f74-7084-4adc-bab7-08a21b30682d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:50.541749 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e86f74-7084-4adc-bab7-08a21b30682d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:50.542050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e86f74-7084-4adc-bab7-08a21b30682d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:50.542319 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e86f74-7084-4adc-bab7-08a21b30682d None admin] PATH_INFO: `/v3/services/image` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:50.542897 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e86f74-7084-4adc-bab7-08a21b30682d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:50.544284 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e86f74-7084-4adc-bab7-08a21b30682d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:50.549455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:50.553535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-35e86f74-7084-4adc-bab7-08a21b30682d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 00:52:50.553535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:50.553535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 00:52:50.553535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 00:52:50.553535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 00:52:50.553535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 00:52:50.553535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 00:52:50.553535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:50.553535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 00:52:50.553535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:50.553535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:52:50.553535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:50.553535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:50.553535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:50.553535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:50.553535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:50.553535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:50.554740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:50.554740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:50.554740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:50.554740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:50.554740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:50.554740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:50.554740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 00:52:50.554740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 00:52:50.554740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 00:52:50.554740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 00:52:50.554740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:50.554740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:50.554740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:50.554740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:50.554740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:50.554740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:50.555774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:50.555774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:50.555774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:50.555774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:50.555774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:50.555774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:50.555774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:50.555774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:50.555774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:50.555774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:50.555774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 00:52:50.555774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:50.555774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 00:52:50.555774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:50.555774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 517/1026] 10.222.0.20 () {56 vars in 1105 bytes} [Wed Sep 14 00:52:50 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:52:50.560279 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e86f74-7084-4adc-bab7-08a21b30682d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:50.571586 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aca414-33f8-4b25-b881-1119c77ff9d2 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:50.609550 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90043b-6745-4a4b-8d36-83640eb323cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:50.610184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90043b-6745-4a4b-8d36-83640eb323cd None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:50.610457 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90043b-6745-4a4b-8d36-83640eb323cd None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:50.610724 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90043b-6745-4a4b-8d36-83640eb323cd None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:50.611366 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90043b-6745-4a4b-8d36-83640eb323cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:50.612777 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90043b-6745-4a4b-8d36-83640eb323cd None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:50.635329 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 510/1027] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 14 00:52:50 2022] POST /identity/v3/users => generated 285 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 00:52:50.683772 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e86f74-7084-4adc-bab7-08a21b30682d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:50.714533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:50.724865 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e76cb6-1559-4699-905c-816535850d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:50.725488 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e76cb6-1559-4699-905c-816535850d1c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:50.725770 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e76cb6-1559-4699-905c-816535850d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:50.726076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e76cb6-1559-4699-905c-816535850d1c None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:50.726719 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e76cb6-1559-4699-905c-816535850d1c None admin] RBAC: Adding query filter params (name=image) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:50.727024 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e76cb6-1559-4699-905c-816535850d1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:50.728415 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e76cb6-1559-4699-905c-816535850d1c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:50.734386 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 518/1028] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:52:50.740001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90043b-6745-4a4b-8d36-83640eb323cd None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:50.853382 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90043b-6745-4a4b-8d36-83640eb323cd None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:50.889719 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3036e7-ee8c-4c44-b0a6-655196ca7350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:50.890375 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3036e7-ee8c-4c44-b0a6-655196ca7350 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:50.890650 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3036e7-ee8c-4c44-b0a6-655196ca7350 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:50.890918 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3036e7-ee8c-4c44-b0a6-655196ca7350 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:50.891548 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3036e7-ee8c-4c44-b0a6-655196ca7350 None admin] RBAC: Adding query filter params (type=image) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:50.891848 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3036e7-ee8c-4c44-b0a6-655196ca7350 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:50.893207 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3036e7-ee8c-4c44-b0a6-655196ca7350 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:50.898179 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 511/1029] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:50 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:52:50.904766 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e76cb6-1559-4699-905c-816535850d1c None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:51.011270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e76cb6-1559-4699-905c-816535850d1c None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:51.046912 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256795ed-371a-426e-82b3-c7354447b204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:51.047520 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256795ed-371a-426e-82b3-c7354447b204 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:51.047797 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256795ed-371a-426e-82b3-c7354447b204 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:51.048067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256795ed-371a-426e-82b3-c7354447b204 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:51.048763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256795ed-371a-426e-82b3-c7354447b204 None admin] RBAC: Adding query filter params (interface=public, service_id=90b457147e51412c81c79ac56be9844b, region_id=RegionOne) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:51.049071 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256795ed-371a-426e-82b3-c7354447b204 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:51.050459 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256795ed-371a-426e-82b3-c7354447b204 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:51.055910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 519/1030] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Sep 14 00:52:50 2022] GET /identity/v3/endpoints?service_id=90b457147e51412c81c79ac56be9844b&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:51.061866 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3036e7-ee8c-4c44-b0a6-655196ca7350 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:51.064798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:51.163724 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3036e7-ee8c-4c44-b0a6-655196ca7350 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:51.197908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e150aae-b672-4355-9c7e-26d6bfbbdb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:51.198558 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e150aae-b672-4355-9c7e-26d6bfbbdb52 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:51.198837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e150aae-b672-4355-9c7e-26d6bfbbdb52 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:51.199102 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e150aae-b672-4355-9c7e-26d6bfbbdb52 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:51.201883 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e150aae-b672-4355-9c7e-26d6bfbbdb52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:51.201883 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e150aae-b672-4355-9c7e-26d6bfbbdb52 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:51.208805 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 512/1031] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Sep 14 00:52:51 2022] GET /identity/v3/services => generated 1957 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 00:52:51.433936 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b46de-41bc-4d77-a97f-0c7cd9696b10 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:51.434232 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b46de-41bc-4d77-a97f-0c7cd9696b10 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:51.434428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b46de-41bc-4d77-a97f-0c7cd9696b10 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:51.436483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 520/1032] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:51.441956 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efc606-0f03-4262-b3dc-cf6296e2ad25 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:51.442410 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efc606-0f03-4262-b3dc-cf6296e2ad25 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:51.442511 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efc606-0f03-4262-b3dc-cf6296e2ad25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:51.460670 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-24efc606-0f03-4262-b3dc-cf6296e2ad25 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:51.461894 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-24efc606-0f03-4262-b3dc-cf6296e2ad25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:51.523320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:51.532275 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 513/1033] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:52:51.808262 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b46de-41bc-4d77-a97f-0c7cd9696b10 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:51.865719 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:51.911720 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b46de-41bc-4d77-a97f-0c7cd9696b10 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:51.946547 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd95363-681f-4773-be3b-a180836b6119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:51.947177 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd95363-681f-4773-be3b-a180836b6119 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:51.947453 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd95363-681f-4773-be3b-a180836b6119 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:51.947722 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd95363-681f-4773-be3b-a180836b6119 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:51.958485 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd95363-681f-4773-be3b-a180836b6119 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:52:51.963454 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-9cd95363-681f-4773-be3b-a180836b6119 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 00:52:51.963454 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:51.963454 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:51.963454 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:51.963454 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:51.963454 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:51.963454 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:51.963454 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:51.963454 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:51.963454 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:51.963454 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:51.963454 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:51.963454 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:52:51.963454 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:52:51.963454 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:52:51.963454 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:52:51.964345 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:52:51.964345 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:52:51.964345 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:52:51.964345 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:52:51.964345 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:51.964345 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:51.964345 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:51.964345 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:51.964345 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:51.964345 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:51.964345 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:51.964345 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:51.964345 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:51.964345 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:51.964345 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:51.964345 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:51.965154 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:51.965154 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:51.965154 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:51.965154 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:51.965154 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:52:51.965154 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:52:51.965154 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:52:51.965154 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:52:51.965154 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:52:51.965154 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:52:51.965154 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 00:52:51.965154 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:51.966927 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 521/1034] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Sep 14 00:52:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:51.971188 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efc606-0f03-4262-b3dc-cf6296e2ad25 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:52.076141 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efc606-0f03-4262-b3dc-cf6296e2ad25 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:52.113663 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01676e43-5d11-46b7-9566-38955cd739ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:52.114351 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01676e43-5d11-46b7-9566-38955cd739ad None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:52.114626 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01676e43-5d11-46b7-9566-38955cd739ad None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:52.114894 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01676e43-5d11-46b7-9566-38955cd739ad None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:52.115551 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01676e43-5d11-46b7-9566-38955cd739ad None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:52.115846 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01676e43-5d11-46b7-9566-38955cd739ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:52.117185 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01676e43-5d11-46b7-9566-38955cd739ad None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:52.130301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 514/1035] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Sep 14 00:52:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:52.131705 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd95363-681f-4773-be3b-a180836b6119 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:52.233584 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd95363-681f-4773-be3b-a180836b6119 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:52.250449 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:52.268657 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba41e55-a9c0-4873-9f64-02a615171522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:52.269287 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba41e55-a9c0-4873-9f64-02a615171522 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:52.269567 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba41e55-a9c0-4873-9f64-02a615171522 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:52.269862 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba41e55-a9c0-4873-9f64-02a615171522 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:52.279782 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba41e55-a9c0-4873-9f64-02a615171522 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:52.281464 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba41e55-a9c0-4873-9f64-02a615171522 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:52.296156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-9ba41e55-a9c0-4873-9f64-02a615171522 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:52.296156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:52.296156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:52.296156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:52.296156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:52.296156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:52.296156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:52.296156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:52.296156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:52.296156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:52.296156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:52.296156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:52.296156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:52.296156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:52.296156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:52.296156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:52.297058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:52.297058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:52.297058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:52.297058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:52.297058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:52.297058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:52.297058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:52.297058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:52.297058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:52.297058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:52.297058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:52.297058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:52.297058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:52.297058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:52.297058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:52.297058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:52.297058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:52.298421 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:52.298421 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:52.298421 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:52.302148 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 522/1036] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:52.303232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01676e43-5d11-46b7-9566-38955cd739ad None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:52.364348 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:52.407396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01676e43-5d11-46b7-9566-38955cd739ad None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:52.444403 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab012f0d-be3c-44cc-9485-04d3ae3d563a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:52.445022 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab012f0d-be3c-44cc-9485-04d3ae3d563a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:52.445273 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab012f0d-be3c-44cc-9485-04d3ae3d563a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:52.445540 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab012f0d-be3c-44cc-9485-04d3ae3d563a None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:52.446213 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab012f0d-be3c-44cc-9485-04d3ae3d563a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:52.446515 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab012f0d-be3c-44cc-9485-04d3ae3d563a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:52.447952 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab012f0d-be3c-44cc-9485-04d3ae3d563a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:52.465200 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 515/1037] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:52:52.467029 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba41e55-a9c0-4873-9f64-02a615171522 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:52.577608 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba41e55-a9c0-4873-9f64-02a615171522 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:52.616993 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a434b3-9e98-4161-a39b-121842066f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:52.617937 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a434b3-9e98-4161-a39b-121842066f3f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:52.618453 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a434b3-9e98-4161-a39b-121842066f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:52.618936 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a434b3-9e98-4161-a39b-121842066f3f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:52.627618 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a434b3-9e98-4161-a39b-121842066f3f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:52.629328 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a434b3-9e98-4161-a39b-121842066f3f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:52.641710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-87a434b3-9e98-4161-a39b-121842066f3f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 00:52:52.641710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:52.641710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:52.641710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:52.641710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:52.641710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:52.641710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:52.641710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:52.641710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:52.641710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:52.641710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:52.641710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:52.641710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:52:52.641710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:52:52.641710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:52:52.641710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:52:52.642678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:52.642678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:52.642678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:52:52.642678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:52.642678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:52:52.642678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:52.642678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:52.642678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:52.642678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:52.642678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:52.642678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:52.642678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:52.642678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:52.642678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:52.642678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:52.642678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:52.642678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:52.642678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:52.643628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:52.643628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:52.643628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:52:52.643628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:52:52.643628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:52:52.643628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:52:52.643628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:52:52.643628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:52:52.643628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 00:52:52.643628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:52.645701 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 523/1038] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Sep 14 00:52:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:52:52.651484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab012f0d-be3c-44cc-9485-04d3ae3d563a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:52.757154 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab012f0d-be3c-44cc-9485-04d3ae3d563a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:52.779614 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:52.799572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7006ae4-6432-4926-8b66-425eef5ee8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:52.800481 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7006ae4-6432-4926-8b66-425eef5ee8f7 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:52.800969 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7006ae4-6432-4926-8b66-425eef5ee8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:52.801417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7006ae4-6432-4926-8b66-425eef5ee8f7 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:52.802419 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7006ae4-6432-4926-8b66-425eef5ee8f7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:52.802921 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7006ae4-6432-4926-8b66-425eef5ee8f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:52.804521 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7006ae4-6432-4926-8b66-425eef5ee8f7 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:52.823118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 516/1039] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Sep 14 00:52:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:52.830174 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a434b3-9e98-4161-a39b-121842066f3f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:52.863283 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:52.878483 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdf230-9aef-47b1-a1f8-1e45ce802dfc None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:52.878719 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdf230-9aef-47b1-a1f8-1e45ce802dfc None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:52.878954 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdf230-9aef-47b1-a1f8-1e45ce802dfc None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:52.880653 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 517/1040] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:52.886413 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8cede-96a6-4963-b014-e78a66244b14 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:52.886691 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8cede-96a6-4963-b014-e78a66244b14 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:52.886961 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8cede-96a6-4963-b014-e78a66244b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:52.912049 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-68c8cede-96a6-4963-b014-e78a66244b14 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:52.913595 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-68c8cede-96a6-4963-b014-e78a66244b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:52.959510 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a434b3-9e98-4161-a39b-121842066f3f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:52.987778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 518/1041] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 00:52:53.003632 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35bc73-127d-470b-b1cf-3345be005b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:53.004306 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35bc73-127d-470b-b1cf-3345be005b4c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:53.004592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35bc73-127d-470b-b1cf-3345be005b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:53.004865 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35bc73-127d-470b-b1cf-3345be005b4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:53.077362 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35bc73-127d-470b-b1cf-3345be005b4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:53.079779 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35bc73-127d-470b-b1cf-3345be005b4c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:53.107068 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:53.183207 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 524/1042] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:52:52 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 00:52:53.185641 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8cede-96a6-4963-b014-e78a66244b14 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:53.264784 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35bc73-127d-470b-b1cf-3345be005b4c None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:53.291201 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8cede-96a6-4963-b014-e78a66244b14 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:53.299476 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:53.333316 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1109ff-a360-4a89-9312-4a9bab6e0373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:53.334272 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1109ff-a360-4a89-9312-4a9bab6e0373 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:53.334553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1109ff-a360-4a89-9312-4a9bab6e0373 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:53.335253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1109ff-a360-4a89-9312-4a9bab6e0373 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:53.348409 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1109ff-a360-4a89-9312-4a9bab6e0373 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:53.350355 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1109ff-a360-4a89-9312-4a9bab6e0373 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:53.368572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-7a1109ff-a360-4a89-9312-4a9bab6e0373 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:53.368572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:53.368572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:53.368572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:53.368572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:53.368572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:53.368572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:53.368572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:53.368572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:53.368572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:53.368572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:53.368572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:53.368572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:53.368572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:53.368572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:53.368572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:53.369552 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:53.369552 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:53.369552 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:53.369552 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:53.369552 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:53.369552 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:53.369552 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:53.369552 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:53.369552 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:53.369552 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:53.369552 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:53.369552 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:53.369552 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:53.369552 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:53.369552 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:53.369552 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:53.369552 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:53.375547 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:53.375547 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:53.375547 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:53.375547 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 519/1043] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:53.377035 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1109ff-a360-4a89-9312-4a9bab6e0373 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:53.378676 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35bc73-127d-470b-b1cf-3345be005b4c None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:53.407384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:53.415759 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977549f-0c0f-4d75-a08b-1344cdeb9424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:53.416380 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977549f-0c0f-4d75-a08b-1344cdeb9424 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:53.416655 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977549f-0c0f-4d75-a08b-1344cdeb9424 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:53.416918 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977549f-0c0f-4d75-a08b-1344cdeb9424 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:53.427318 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977549f-0c0f-4d75-a08b-1344cdeb9424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:52:53.432197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-1977549f-0c0f-4d75-a08b-1344cdeb9424 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:52:53.432197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:53.432197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:53.432197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:53.432197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:53.432197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:53.432197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:53.432197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:53.432197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:53.432197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:53.432197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:53.432197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:53.432197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:52:53.432197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:52:53.432197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:52:53.432197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:52:53.433155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:52:53.433155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:52:53.433155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:52:53.433155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:52:53.433155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:53.433155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:53.433155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:53.433155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:53.433155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:53.433155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:53.433155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:53.433155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:53.433155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:53.433155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:53.433155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:53.433155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:53.434112 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:53.434112 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:53.434112 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:53.434112 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:53.434112 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:52:53.434112 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:52:53.434112 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:52:53.434112 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:52:53.434112 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:52:53.434112 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:52:53.434112 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:52:53.434112 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:53.438332 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 525/1044] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:52:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:52:53.439540 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612a2b4-fb22-4070-a159-12282baa8fe8 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:53.439827 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612a2b4-fb22-4070-a159-12282baa8fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:53.440101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612a2b4-fb22-4070-a159-12282baa8fe8 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:53.441855 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 526/1045] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:53.442551 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612a2b4-fb22-4070-a159-12282baa8fe8 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:53.480552 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1109ff-a360-4a89-9312-4a9bab6e0373 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:53.512081 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a691ea1-f3c5-4195-a4fe-0122d00145e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:53.512665 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a691ea1-f3c5-4195-a4fe-0122d00145e7 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:53.513465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a691ea1-f3c5-4195-a4fe-0122d00145e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:53.513726 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a691ea1-f3c5-4195-a4fe-0122d00145e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:53.514376 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a691ea1-f3c5-4195-a4fe-0122d00145e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:53.514670 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a691ea1-f3c5-4195-a4fe-0122d00145e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:53.516014 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a691ea1-f3c5-4195-a4fe-0122d00145e7 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:53.527316 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 520/1046] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:53.528610 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518b54c-7415-42e3-80a9-8e1fdae07339 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:53.528862 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518b54c-7415-42e3-80a9-8e1fdae07339 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:53.529135 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518b54c-7415-42e3-80a9-8e1fdae07339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:53.545567 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612a2b4-fb22-4070-a159-12282baa8fe8 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:53.546861 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-8518b54c-7415-42e3-80a9-8e1fdae07339 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:53.548026 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8518b54c-7415-42e3-80a9-8e1fdae07339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:53.561157 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:53.580302 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2fb03-25cb-418d-870e-4bf549b9eccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:53.580899 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2fb03-25cb-418d-870e-4bf549b9eccf None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:53.581180 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2fb03-25cb-418d-870e-4bf549b9eccf None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:53.581455 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2fb03-25cb-418d-870e-4bf549b9eccf None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:53.582145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2fb03-25cb-418d-870e-4bf549b9eccf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:53.582446 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2fb03-25cb-418d-870e-4bf549b9eccf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:53.583794 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2fb03-25cb-418d-870e-4bf549b9eccf None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:53.592355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 527/1047] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:52:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:53.593133 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2fb03-25cb-418d-870e-4bf549b9eccf None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:53.620774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 521/1048] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:52:53.621593 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518b54c-7415-42e3-80a9-8e1fdae07339 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:53.648043 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:53.705221 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2fb03-25cb-418d-870e-4bf549b9eccf None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:53.729340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518b54c-7415-42e3-80a9-8e1fdae07339 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:53.744887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60d5f9-6d49-4925-ba0b-3bbaa3bc1df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:53.745509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60d5f9-6d49-4925-ba0b-3bbaa3bc1df0 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:53.745788 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60d5f9-6d49-4925-ba0b-3bbaa3bc1df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:53.746088 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60d5f9-6d49-4925-ba0b-3bbaa3bc1df0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:53.754452 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60d5f9-6d49-4925-ba0b-3bbaa3bc1df0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:53.756113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60d5f9-6d49-4925-ba0b-3bbaa3bc1df0 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:53.764577 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8b521-26d5-4e8b-afc1-679d5b1c8321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:53.765193 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8b521-26d5-4e8b-afc1-679d5b1c8321 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:53.765468 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8b521-26d5-4e8b-afc1-679d5b1c8321 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:53.765738 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8b521-26d5-4e8b-afc1-679d5b1c8321 None admin] PATH_INFO: `/v3/users/8c093b910f134577a0eab9002c9f8740` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:53.769963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-8a60d5f9-6d49-4925-ba0b-3bbaa3bc1df0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:53.769963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:53.769963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:53.769963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:53.769963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:53.769963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:53.769963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:53.769963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:53.769963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:53.769963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:53.769963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:53.769963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:53.769963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:52:53.769963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:52:53.769963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:52:53.770807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:52:53.770807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:53.770807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:53.770807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:53.770807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:53.770807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:53.770807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:53.770807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:53.770807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:53.770807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:53.770807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:53.770807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:53.770807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:53.770807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:53.770807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:53.770807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:53.770807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:53.771678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:52:53.771678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:52:53.771678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:52:53.771678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:52:53.771678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:52:53.771678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:52:53.771678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:53.771678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:53.771678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 528/1049] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:52:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:53.776869 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60d5f9-6d49-4925-ba0b-3bbaa3bc1df0 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:53.783093 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd8b521-26d5-4e8b-afc1-679d5b1c8321 None admin] RBAC: Authorizing `identity:get_user(user_id=8c093b910f134577a0eab9002c9f8740)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:53.784527 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd8b521-26d5-4e8b-afc1-679d5b1c8321 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:53.790831 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 522/1050] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:52:53 2022] GET /identity/v3/users/8c093b910f134577a0eab9002c9f8740 => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:53.791685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8b521-26d5-4e8b-afc1-679d5b1c8321 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:53.800366 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:53.893994 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8b521-26d5-4e8b-afc1-679d5b1c8321 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:53.903451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60d5f9-6d49-4925-ba0b-3bbaa3bc1df0 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:53.913639 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:53.927602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec606e3-614d-420c-b3be-acf4a808f4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:53.928198 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec606e3-614d-420c-b3be-acf4a808f4cd None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:53.928479 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec606e3-614d-420c-b3be-acf4a808f4cd None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:53.928745 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec606e3-614d-420c-b3be-acf4a808f4cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:53.937793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7f498-e2fc-4ae0-bd8b-463dc96f8c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:53.938407 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7f498-e2fc-4ae0-bd8b-463dc96f8c3c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:53.938682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7f498-e2fc-4ae0-bd8b-463dc96f8c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:53.938948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7f498-e2fc-4ae0-bd8b-463dc96f8c3c None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:53.939626 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7f498-e2fc-4ae0-bd8b-463dc96f8c3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:53.939924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7f498-e2fc-4ae0-bd8b-463dc96f8c3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:53.941344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7f498-e2fc-4ae0-bd8b-463dc96f8c3c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:53.954334 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 529/1051] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:52:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:52:53.955129 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7f498-e2fc-4ae0-bd8b-463dc96f8c3c None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:53.999421 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec606e3-614d-420c-b3be-acf4a808f4cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:54.001943 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec606e3-614d-420c-b3be-acf4a808f4cd None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:54.009983 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:54.054785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7f498-e2fc-4ae0-bd8b-463dc96f8c3c None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:54.088868 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ff3e4-e535-4ee9-a879-9b2b12db2f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:54.089488 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ff3e4-e535-4ee9-a879-9b2b12db2f74 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:54.089767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ff3e4-e535-4ee9-a879-9b2b12db2f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:54.090072 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ff3e4-e535-4ee9-a879-9b2b12db2f74 None admin] PATH_INFO: `/v3/services/image` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:54.090645 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ff3e4-e535-4ee9-a879-9b2b12db2f74 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:54.092049 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ff3e4-e535-4ee9-a879-9b2b12db2f74 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:54.100603 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-b93ff3e4-e535-4ee9-a879-9b2b12db2f74 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 00:52:54.100603 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:54.100603 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 00:52:54.100603 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 00:52:54.100603 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 00:52:54.100603 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 00:52:54.100603 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 00:52:54.100603 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:54.100603 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 00:52:54.100603 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:54.100603 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:52:54.100603 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:54.100603 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:54.100603 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:54.100603 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:54.100603 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:54.100603 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:54.101585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:54.101585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:54.101585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:54.101585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:54.101585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:54.101585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:54.101585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 00:52:54.101585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 00:52:54.101585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 00:52:54.101585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 00:52:54.101585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:54.101585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:54.101585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:54.101585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:54.101585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:54.101585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:54.102465 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:54.102465 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:54.102465 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:54.102465 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:54.102465 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:54.102465 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:54.102465 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:54.102465 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:54.102465 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:54.102465 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:54.102465 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 00:52:54.102465 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:52:54.102465 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 00:52:54.102465 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:54.103227 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 523/1052] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:52:53 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 00:52:54.103301 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 530/1053] 10.222.0.20 () {56 vars in 1105 bytes} [Wed Sep 14 00:52:53 2022] GET /identity/v3/services/image => generated 86 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:54.103377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec606e3-614d-420c-b3be-acf4a808f4cd None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:54.107427 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ff3e4-e535-4ee9-a879-9b2b12db2f74 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:54.142611 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:54.204245 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec606e3-614d-420c-b3be-acf4a808f4cd None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:54.209758 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ff3e4-e535-4ee9-a879-9b2b12db2f74 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:54.211623 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:54.238621 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d19ec1-2394-406c-8994-3af6d3501e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:54.239273 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d19ec1-2394-406c-8994-3af6d3501e07 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:54.239547 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d19ec1-2394-406c-8994-3af6d3501e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:54.239923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d19ec1-2394-406c-8994-3af6d3501e07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:54.240639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d19ec1-2394-406c-8994-3af6d3501e07 None admin] RBAC: Adding query filter params (role.id=021ad4c2b0894799925fdfadbf561b0b, scope.project.id=f37c835c05924364bcd1530d44f024fe, user.id=c05caac9e8b9498583780306887734be) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:54.240940 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d19ec1-2394-406c-8994-3af6d3501e07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:54.242398 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d19ec1-2394-406c-8994-3af6d3501e07 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:54.243655 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984066f0-7d00-4f99-b0cb-1b281dcbe0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:54.244280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984066f0-7d00-4f99-b0cb-1b281dcbe0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:54.244555 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984066f0-7d00-4f99-b0cb-1b281dcbe0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:54.244823 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984066f0-7d00-4f99-b0cb-1b281dcbe0d6 None admin] PATH_INFO: `/v3/projects/bf3119eb501b4453ab8c71fed6cffacd` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:54.245946 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984066f0-7d00-4f99-b0cb-1b281dcbe0d6 None admin] RBAC: Authorizing `identity:get_project(project_id=bf3119eb501b4453ab8c71fed6cffacd)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:54.247914 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984066f0-7d00-4f99-b0cb-1b281dcbe0d6 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:54.248305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 524/1054] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:52:54 2022] GET /identity/v3/role_assignments?user.id=c05caac9e8b9498583780306887734be&scope.project.id=f37c835c05924364bcd1530d44f024fe&role.id=021ad4c2b0894799925fdfadbf561b0b => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:54.249065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d19ec1-2394-406c-8994-3af6d3501e07 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:54.254753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 531/1055] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:52:54 2022] GET /identity/v3/projects/bf3119eb501b4453ab8c71fed6cffacd => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:54.255679 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984066f0-7d00-4f99-b0cb-1b281dcbe0d6 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:54.362800 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d19ec1-2394-406c-8994-3af6d3501e07 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:54.369909 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984066f0-7d00-4f99-b0cb-1b281dcbe0d6 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:54.371678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:54.399822 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7827e4-e100-46ee-9b29-8c0569b2e083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:54.400437 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7827e4-e100-46ee-9b29-8c0569b2e083 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:54.400709 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7827e4-e100-46ee-9b29-8c0569b2e083 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:54.401117 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7827e4-e100-46ee-9b29-8c0569b2e083 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:54.401612 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7827e4-e100-46ee-9b29-8c0569b2e083 None admin] RBAC: Adding query filter params (name=image) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:54.401943 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7827e4-e100-46ee-9b29-8c0569b2e083 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:54.403668 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7827e4-e100-46ee-9b29-8c0569b2e083 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:54.410536 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 525/1056] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:54.415617 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20348da0-ad74-49f8-b375-6049a2db0ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:54.416138 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7827e4-e100-46ee-9b29-8c0569b2e083 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:54.416349 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20348da0-ad74-49f8-b375-6049a2db0ddd None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:54.416788 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20348da0-ad74-49f8-b375-6049a2db0ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:54.417060 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20348da0-ad74-49f8-b375-6049a2db0ddd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:54.417779 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20348da0-ad74-49f8-b375-6049a2db0ddd None admin] RBAC: Adding query filter params (role.id=0d7a36bda723430eae02f10f4c775c96, scope.project.id=bf3119eb501b4453ab8c71fed6cffacd, user.id=8c093b910f134577a0eab9002c9f8740) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:54.418155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20348da0-ad74-49f8-b375-6049a2db0ddd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:54.420112 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20348da0-ad74-49f8-b375-6049a2db0ddd None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:54.425985 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 532/1057] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:52:54 2022] GET /identity/v3/role_assignments?user.id=8c093b910f134577a0eab9002c9f8740&scope.project.id=bf3119eb501b4453ab8c71fed6cffacd&role.id=0d7a36bda723430eae02f10f4c775c96 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:54.473928 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:54.547423 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7827e4-e100-46ee-9b29-8c0569b2e083 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:54.583156 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd34b35-e3dc-4ce6-b1a8-b250cfb6e32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:54.583768 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd34b35-e3dc-4ce6-b1a8-b250cfb6e32d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:54.584038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd34b35-e3dc-4ce6-b1a8-b250cfb6e32d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:54.584304 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd34b35-e3dc-4ce6-b1a8-b250cfb6e32d None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:54.584942 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd34b35-e3dc-4ce6-b1a8-b250cfb6e32d None admin] RBAC: Adding query filter params (type=image) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:54.585237 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd34b35-e3dc-4ce6-b1a8-b250cfb6e32d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:54.586639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd34b35-e3dc-4ce6-b1a8-b250cfb6e32d None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:54.597263 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 526/1058] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:54.598617 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20348da0-ad74-49f8-b375-6049a2db0ddd None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:54.701101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20348da0-ad74-49f8-b375-6049a2db0ddd None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:54.734178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1914fa5-cc60-4d8f-b297-b83317e2594e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:54.734789 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1914fa5-cc60-4d8f-b297-b83317e2594e None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:54.735073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1914fa5-cc60-4d8f-b297-b83317e2594e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:54.735338 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1914fa5-cc60-4d8f-b297-b83317e2594e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:54.736013 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1914fa5-cc60-4d8f-b297-b83317e2594e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:54.737372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1914fa5-cc60-4d8f-b297-b83317e2594e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:54.769846 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 533/1059] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 00:52:54 2022] POST /identity/v3/endpoints => generated 327 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:52:56.420384 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9046a8-aff3-4847-9738-7edb7c1466ba None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:56.420886 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9046a8-aff3-4847-9738-7edb7c1466ba None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:56.420886 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9046a8-aff3-4847-9738-7edb7c1466ba None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:56.422219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 527/1060] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:56.427449 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fad85-bb22-49c4-a017-0dd18dd3f7a6 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:56.427908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fad85-bb22-49c4-a017-0dd18dd3f7a6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:56.427986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fad85-bb22-49c4-a017-0dd18dd3f7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:56.449021 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-4e6fad85-bb22-49c4-a017-0dd18dd3f7a6 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:56.450819 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4e6fad85-bb22-49c4-a017-0dd18dd3f7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:56.471171 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:56.531586 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 534/1061] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:52:56.565963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab47a5b-2732-4dec-a58d-85174fc9a0bd None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:56.566257 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab47a5b-2732-4dec-a58d-85174fc9a0bd None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:56.566655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab47a5b-2732-4dec-a58d-85174fc9a0bd None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:56.568111 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 528/1062] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:56.573188 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46684b0e-b829-4af1-b541-e3b0c9eabce6 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:56.573471 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46684b0e-b829-4af1-b541-e3b0c9eabce6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:56.573737 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46684b0e-b829-4af1-b541-e3b0c9eabce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:56.592811 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-46684b0e-b829-4af1-b541-e3b0c9eabce6 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:56.594014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-46684b0e-b829-4af1-b541-e3b0c9eabce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:56.660543 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 535/1063] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:52:56.798048 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab47a5b-2732-4dec-a58d-85174fc9a0bd None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:56.900700 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:56.907636 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab47a5b-2732-4dec-a58d-85174fc9a0bd None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:56.928836 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46684b0e-b829-4af1-b541-e3b0c9eabce6 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:56.943584 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95021c8a-0d7e-4a53-a12e-5a4a5634717f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:56.944208 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95021c8a-0d7e-4a53-a12e-5a4a5634717f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:56.944535 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95021c8a-0d7e-4a53-a12e-5a4a5634717f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:56.944806 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95021c8a-0d7e-4a53-a12e-5a4a5634717f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:56.955484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95021c8a-0d7e-4a53-a12e-5a4a5634717f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:52:56.960214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-95021c8a-0d7e-4a53-a12e-5a4a5634717f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 00:52:56.960214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:56.960214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:56.960214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:56.960214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:56.960214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:56.960214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:56.960214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:56.960214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:56.960214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:56.960214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:56.960214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:56.960214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:52:56.960214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:52:56.960214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:52:56.960214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:52:56.961232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:52:56.961232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:52:56.961232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:52:56.961232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:52:56.961232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:56.961232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:56.961232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:56.961232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:56.961232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:56.961232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:56.961232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:56.961232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:56.961232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:56.961232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:56.961232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:56.961232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:56.962182 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:56.962182 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:56.962182 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:56.962182 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:56.962182 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:52:56.962182 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:52:56.962182 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:52:56.962182 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:52:56.962182 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:52:56.962182 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:52:56.962182 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 00:52:56.962182 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:56.962182 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 529/1064] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Sep 14 00:52:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:56.967587 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95021c8a-0d7e-4a53-a12e-5a4a5634717f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:57.013437 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:57.035026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46684b0e-b829-4af1-b541-e3b0c9eabce6 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:57.068029 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead21f3-c11f-43ed-a6fd-a53a42b3a31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:57.068190 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95021c8a-0d7e-4a53-a12e-5a4a5634717f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:57.068587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead21f3-c11f-43ed-a6fd-a53a42b3a31e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:57.068867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead21f3-c11f-43ed-a6fd-a53a42b3a31e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:57.069140 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead21f3-c11f-43ed-a6fd-a53a42b3a31e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:57.079449 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead21f3-c11f-43ed-a6fd-a53a42b3a31e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:52:57.084234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-5ead21f3-c11f-43ed-a6fd-a53a42b3a31e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:52:57.084234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:57.084234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:57.084234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:57.084234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:57.084234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:57.084234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:57.084234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:57.084234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:57.084234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:57.084234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:57.084234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:57.084234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:52:57.084234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:52:57.084234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:52:57.084234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:52:57.085144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:52:57.085144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:52:57.085144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:52:57.085144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:52:57.085144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:57.085144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:57.085144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:57.085144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:57.085144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:57.085144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:57.085144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:57.085144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:57.085144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:57.085144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:57.085144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:57.085144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:57.086372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:57.086372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:57.086372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:57.086372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:57.086372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:52:57.086372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:52:57.086372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:52:57.086372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:52:57.086372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:52:57.086372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:52:57.086372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:52:57.086372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:57.086372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 536/1065] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:52:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:52:57.087071 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e818fce-7dba-4450-b3c1-91fc96faaaa2 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:57.087071 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e818fce-7dba-4450-b3c1-91fc96faaaa2 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:57.087071 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e818fce-7dba-4450-b3c1-91fc96faaaa2 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:57.088722 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 537/1066] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:52:57.091520 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e818fce-7dba-4450-b3c1-91fc96faaaa2 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:57.103490 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee93700-ea57-4576-ab3d-7e4177b393b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:57.104086 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee93700-ea57-4576-ab3d-7e4177b393b3 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:57.104358 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee93700-ea57-4576-ab3d-7e4177b393b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:57.104622 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee93700-ea57-4576-ab3d-7e4177b393b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:57.105269 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee93700-ea57-4576-ab3d-7e4177b393b3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:57.105565 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee93700-ea57-4576-ab3d-7e4177b393b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:57.108885 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee93700-ea57-4576-ab3d-7e4177b393b3 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:57.116744 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 530/1067] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Sep 14 00:52:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:52:57.117918 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9550a-3efa-4da9-884f-2caeaa3fc407 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:57.118195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9550a-3efa-4da9-884f-2caeaa3fc407 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:57.118460 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9550a-3efa-4da9-884f-2caeaa3fc407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:57.135769 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-13b9550a-3efa-4da9-884f-2caeaa3fc407 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:52:57.136943 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-13b9550a-3efa-4da9-884f-2caeaa3fc407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:52:57.151507 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:57.195324 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e818fce-7dba-4450-b3c1-91fc96faaaa2 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:57.204331 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 531/1068] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:52:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:52:57.205473 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9550a-3efa-4da9-884f-2caeaa3fc407 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:57.244211 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c2c8a-c772-4d1c-88ae-ef10c2494880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:57.245255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c2c8a-c772-4d1c-88ae-ef10c2494880 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:57.245538 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c2c8a-c772-4d1c-88ae-ef10c2494880 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:57.246011 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c2c8a-c772-4d1c-88ae-ef10c2494880 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:57.246670 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c2c8a-c772-4d1c-88ae-ef10c2494880 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:57.247334 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c2c8a-c772-4d1c-88ae-ef10c2494880 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:57.249089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c2c8a-c772-4d1c-88ae-ef10c2494880 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:57.255449 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:57.260352 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 538/1069] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:52:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:52:57.266245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c2c8a-c772-4d1c-88ae-ef10c2494880 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:57.310103 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9550a-3efa-4da9-884f-2caeaa3fc407 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:57.345539 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65a901-ed88-45b0-9570-16bcaaf7f898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:57.346151 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65a901-ed88-45b0-9570-16bcaaf7f898 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:57.346415 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65a901-ed88-45b0-9570-16bcaaf7f898 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:57.346693 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65a901-ed88-45b0-9570-16bcaaf7f898 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:57.356800 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65a901-ed88-45b0-9570-16bcaaf7f898 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:57.358264 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65a901-ed88-45b0-9570-16bcaaf7f898 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:57.369760 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c2c8a-c772-4d1c-88ae-ef10c2494880 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:57.373024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-cf65a901-ed88-45b0-9570-16bcaaf7f898 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:57.373024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:57.373024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:57.373024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:57.373024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:57.373024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:57.373024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:57.373024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:57.373024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:57.373024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:57.373024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:57.373024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:57.373024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:57.373024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:57.373024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:57.373024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:57.374282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:57.374282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:57.374282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:57.374282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:57.374282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:57.374282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:57.374282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:57.374282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:57.374282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:57.374282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:57.374282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:57.374282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:57.374282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:57.374282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:57.374282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:57.374282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:57.374282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:57.375203 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:57.375203 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:57.375203 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:57.378958 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 532/1070] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:57.379783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65a901-ed88-45b0-9570-16bcaaf7f898 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:57.382529 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:57.407942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545c3c3-b187-4e24-8ec1-499c70f71d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:57.408674 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545c3c3-b187-4e24-8ec1-499c70f71d0c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:57.408957 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545c3c3-b187-4e24-8ec1-499c70f71d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:57.409237 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545c3c3-b187-4e24-8ec1-499c70f71d0c None admin] PATH_INFO: `/v3/users/8c093b910f134577a0eab9002c9f8740` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:57.410365 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545c3c3-b187-4e24-8ec1-499c70f71d0c None admin] RBAC: Authorizing `identity:get_user(user_id=8c093b910f134577a0eab9002c9f8740)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:57.412688 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545c3c3-b187-4e24-8ec1-499c70f71d0c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:57.419397 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 539/1071] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:52:57 2022] GET /identity/v3/users/8c093b910f134577a0eab9002c9f8740 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:52:57.420203 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545c3c3-b187-4e24-8ec1-499c70f71d0c None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:57.485121 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65a901-ed88-45b0-9570-16bcaaf7f898 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:57.491491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:57.517868 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de1219-a847-4340-8490-657a8c25835a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:57.518464 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de1219-a847-4340-8490-657a8c25835a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:57.518740 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de1219-a847-4340-8490-657a8c25835a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:57.519002 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de1219-a847-4340-8490-657a8c25835a None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:57.519629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de1219-a847-4340-8490-657a8c25835a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:57.519923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de1219-a847-4340-8490-657a8c25835a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:57.521275 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de1219-a847-4340-8490-657a8c25835a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:57.524590 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545c3c3-b187-4e24-8ec1-499c70f71d0c None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:57.532924 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 533/1072] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:57.533727 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de1219-a847-4340-8490-657a8c25835a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:57.559258 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c031b-6a9e-42de-8319-c873d2a67ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:57.560498 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c031b-6a9e-42de-8319-c873d2a67ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:57.560777 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c031b-6a9e-42de-8319-c873d2a67ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:57.561048 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c031b-6a9e-42de-8319-c873d2a67ce6 None admin] PATH_INFO: `/v3/projects/bf3119eb501b4453ab8c71fed6cffacd` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:57.562180 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c031b-6a9e-42de-8319-c873d2a67ce6 None admin] RBAC: Authorizing `identity:get_project(project_id=bf3119eb501b4453ab8c71fed6cffacd)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:57.563598 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c031b-6a9e-42de-8319-c873d2a67ce6 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:57.570157 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 540/1073] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:52:57 2022] GET /identity/v3/projects/bf3119eb501b4453ab8c71fed6cffacd => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:52:57.570157 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c031b-6a9e-42de-8319-c873d2a67ce6 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:57.594189 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:57.631257 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de1219-a847-4340-8490-657a8c25835a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:57.664507 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390c2e3-842c-40f6-ab87-50652631fc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:57.664972 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c031b-6a9e-42de-8319-c873d2a67ce6 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:57.665108 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390c2e3-842c-40f6-ab87-50652631fc9f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:57.665374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390c2e3-842c-40f6-ab87-50652631fc9f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:57.665647 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390c2e3-842c-40f6-ab87-50652631fc9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:57.698608 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ac8eb-259e-47f2-959d-2f639cc9640e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:57.699227 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ac8eb-259e-47f2-959d-2f639cc9640e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:57.699501 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ac8eb-259e-47f2-959d-2f639cc9640e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:57.699776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ac8eb-259e-47f2-959d-2f639cc9640e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:57.702650 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:57.708850 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ac8eb-259e-47f2-959d-2f639cc9640e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:57.710345 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ac8eb-259e-47f2-959d-2f639cc9640e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:57.722026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-494ac8eb-259e-47f2-959d-2f639cc9640e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 00:52:57.722026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:57.722026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:57.722026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:57.722026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:57.722026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:57.722026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:57.722026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:57.722026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:57.722026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:57.722026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:57.722026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:57.722026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:52:57.722026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:52:57.722026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:52:57.722026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:52:57.723020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:57.723020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:57.723020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:52:57.723020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:57.723020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:52:57.723020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:52:57.723020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:57.723020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:57.723020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:57.723020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:57.723020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:57.723020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:57.723020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:57.723020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:57.723020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:57.723020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:57.723020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:57.723020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:57.723967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:57.723967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:57.723967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:52:57.723967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:52:57.723967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:52:57.723967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:52:57.723967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:52:57.723967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:52:57.723967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 00:52:57.723967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:57.723967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 541/1074] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Sep 14 00:52:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:57.723967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ac8eb-259e-47f2-959d-2f639cc9640e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:57.739794 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390c2e3-842c-40f6-ab87-50652631fc9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:57.741231 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390c2e3-842c-40f6-ab87-50652631fc9f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:57.798653 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:57.821319 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ac8eb-259e-47f2-959d-2f639cc9640e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:57.836933 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 534/1075] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:52:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 00:52:57.837751 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390c2e3-842c-40f6-ab87-50652631fc9f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:57.854244 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400392e8-d63b-4e35-b88e-1d57d99a2f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:57.854888 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400392e8-d63b-4e35-b88e-1d57d99a2f62 None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:57.855162 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400392e8-d63b-4e35-b88e-1d57d99a2f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:57.855428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400392e8-d63b-4e35-b88e-1d57d99a2f62 None admin] PATH_INFO: `/v3/projects/bf3119eb501b4453ab8c71fed6cffacd/users/8c093b910f134577a0eab9002c9f8740/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:57.857387 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400392e8-d63b-4e35-b88e-1d57d99a2f62 None admin] RBAC: Authorizing `identity:create_grant(project_id=bf3119eb501b4453ab8c71fed6cffacd, user_id=8c093b910f134577a0eab9002c9f8740, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:57.858832 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400392e8-d63b-4e35-b88e-1d57d99a2f62 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:57.871034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 542/1076] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 14 00:52:57 2022] PUT /identity/v3/projects/bf3119eb501b4453ab8c71fed6cffacd/users/8c093b910f134577a0eab9002c9f8740/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 00:52:57.871808 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400392e8-d63b-4e35-b88e-1d57d99a2f62 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:57.935598 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:57.974594 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390c2e3-842c-40f6-ab87-50652631fc9f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:57.989893 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400392e8-d63b-4e35-b88e-1d57d99a2f62 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:58.015500 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5ae47-f6c6-442a-bccd-f86f6fd56164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:58.016111 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5ae47-f6c6-442a-bccd-f86f6fd56164 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:58.016381 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5ae47-f6c6-442a-bccd-f86f6fd56164 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:58.016643 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5ae47-f6c6-442a-bccd-f86f6fd56164 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:58.017934 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5ae47-f6c6-442a-bccd-f86f6fd56164 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:58.018235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5ae47-f6c6-442a-bccd-f86f6fd56164 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:58.019686 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5ae47-f6c6-442a-bccd-f86f6fd56164 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:58.032822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57e6ce-3e6a-4a43-8e89-1d29285448bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:58.033465 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57e6ce-3e6a-4a43-8e89-1d29285448bc None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:58.033747 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57e6ce-3e6a-4a43-8e89-1d29285448bc None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:58.034065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57e6ce-3e6a-4a43-8e89-1d29285448bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:58.040525 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 535/1077] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Sep 14 00:52:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:58.045847 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5ae47-f6c6-442a-bccd-f86f6fd56164 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:58.047488 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57e6ce-3e6a-4a43-8e89-1d29285448bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:58.049111 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57e6ce-3e6a-4a43-8e89-1d29285448bc None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:58.067046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-2f57e6ce-3e6a-4a43-8e89-1d29285448bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:58.067046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:58.067046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:58.067046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:58.067046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:58.067046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:58.067046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:58.067046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:58.067046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:58.067046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:58.067046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:58.067046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:58.067046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:58.067046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:58.067046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:58.067046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:58.068035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:58.068035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:58.068035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:58.068035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:58.068035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:58.068035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:58.068035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:58.068035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:58.068035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:58.068035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:58.068035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:58.068035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:58.068035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:58.068035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:58.068035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:58.068035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:58.068035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:58.068919 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:58.068919 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:58.068919 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:58.068919 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 543/1078] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:58.072688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:58.074938 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57e6ce-3e6a-4a43-8e89-1d29285448bc None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:58.156025 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5ae47-f6c6-442a-bccd-f86f6fd56164 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:58.187710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57e6ce-3e6a-4a43-8e89-1d29285448bc None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:58.192077 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bff3e2-a6ab-4a76-9c33-fddeafa2c154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:58.192704 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bff3e2-a6ab-4a76-9c33-fddeafa2c154 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:58.192978 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bff3e2-a6ab-4a76-9c33-fddeafa2c154 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:58.193247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bff3e2-a6ab-4a76-9c33-fddeafa2c154 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:58.197610 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:58.205284 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bff3e2-a6ab-4a76-9c33-fddeafa2c154 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:58.206755 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bff3e2-a6ab-4a76-9c33-fddeafa2c154 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:58.224277 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-99bff3e2-a6ab-4a76-9c33-fddeafa2c154 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:58.224277 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:58.224277 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:58.224277 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:58.224277 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:58.224277 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:58.224277 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:58.224277 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:58.224277 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:58.224277 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:58.224277 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:58.224277 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:58.224277 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:52:58.224277 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:52:58.224277 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:52:58.224277 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:52:58.225482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:58.225482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:58.225482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:58.225482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:58.225482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:58.225482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:58.225482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:58.225482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:58.225482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:58.225482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:58.225482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:58.225482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:58.225482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:58.225482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:58.225482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:58.225482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:58.225482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:52:58.226660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:52:58.226660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:52:58.226660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:52:58.226879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9134ad-4a51-4b66-88f2-d76721996260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:58.226879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9134ad-4a51-4b66-88f2-d76721996260 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:58.226879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9134ad-4a51-4b66-88f2-d76721996260 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:58.226879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9134ad-4a51-4b66-88f2-d76721996260 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:58.227227 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9134ad-4a51-4b66-88f2-d76721996260 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:58.227227 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9134ad-4a51-4b66-88f2-d76721996260 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:58.228272 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9134ad-4a51-4b66-88f2-d76721996260 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:58.230035 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 536/1079] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:58.235766 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bff3e2-a6ab-4a76-9c33-fddeafa2c154 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:58.253901 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 544/1080] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:52:58.323301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:58.359444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bff3e2-a6ab-4a76-9c33-fddeafa2c154 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:58.395255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146ee5e-7bbf-4f0b-a226-b0f013a3babf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:58.395868 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146ee5e-7bbf-4f0b-a226-b0f013a3babf None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:58.396144 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146ee5e-7bbf-4f0b-a226-b0f013a3babf None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:58.396416 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146ee5e-7bbf-4f0b-a226-b0f013a3babf None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:58.397056 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146ee5e-7bbf-4f0b-a226-b0f013a3babf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:58.397355 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146ee5e-7bbf-4f0b-a226-b0f013a3babf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:58.398768 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146ee5e-7bbf-4f0b-a226-b0f013a3babf None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:58.412395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 537/1081] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:52:58.418313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9134ad-4a51-4b66-88f2-d76721996260 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:58.530217 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9134ad-4a51-4b66-88f2-d76721996260 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:58.568008 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae429c3e-08b6-43d6-b32f-c29302f0bff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:58.568651 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae429c3e-08b6-43d6-b32f-c29302f0bff7 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:58.568927 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae429c3e-08b6-43d6-b32f-c29302f0bff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:58.569198 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae429c3e-08b6-43d6-b32f-c29302f0bff7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:58.577257 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae429c3e-08b6-43d6-b32f-c29302f0bff7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:58.578742 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae429c3e-08b6-43d6-b32f-c29302f0bff7 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:58.590219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-ae429c3e-08b6-43d6-b32f-c29302f0bff7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:58.590219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:52:58.590219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:52:58.590219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:52:58.590219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:52:58.590219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:52:58.590219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:52:58.590219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:52:58.590219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:52:58.590219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:52:58.590219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:52:58.590219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:52:58.590219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:52:58.590219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:52:58.590219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:52:58.591928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:52:58.591928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:52:58.591928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:52:58.591928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:52:58.591928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:52:58.591928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:52:58.591928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:52:58.591928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:52:58.591928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:52:58.591928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:52:58.591928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:52:58.591928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:52:58.591928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:52:58.591928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:52:58.591928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:52:58.591928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:52:58.591928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:52:58.592842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:52:58.592842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:52:58.592842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:52:58.592842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:52:58.592842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:52:58.592842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:52:58.592842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:52:58.592842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:52:58.592842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 545/1082] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:52:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:52:58.597712 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146ee5e-7bbf-4f0b-a226-b0f013a3babf None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:58.694659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146ee5e-7bbf-4f0b-a226-b0f013a3babf None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:58.723934 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:58.729682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e7385-ba2e-4efd-8804-22d1035158f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:58.730307 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e7385-ba2e-4efd-8804-22d1035158f5 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:58.730586 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e7385-ba2e-4efd-8804-22d1035158f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:58.730887 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e7385-ba2e-4efd-8804-22d1035158f5 None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:58.732117 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e7385-ba2e-4efd-8804-22d1035158f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:52:58.732445 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e7385-ba2e-4efd-8804-22d1035158f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:58.733889 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e7385-ba2e-4efd-8804-22d1035158f5 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:58.745469 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 538/1083] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:52:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:52:58.752797 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae429c3e-08b6-43d6-b32f-c29302f0bff7 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:52:58.782279 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:52:58.857428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae429c3e-08b6-43d6-b32f-c29302f0bff7 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:52:58.892077 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062cb184-d5f9-4f8e-8308-7a2eba1aeb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:52:58.892775 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062cb184-d5f9-4f8e-8308-7a2eba1aeb96 None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:52:58.893058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062cb184-d5f9-4f8e-8308-7a2eba1aeb96 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:52:58.893330 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062cb184-d5f9-4f8e-8308-7a2eba1aeb96 None admin] PATH_INFO: `/v3/projects/f37c835c05924364bcd1530d44f024fe/users/c05caac9e8b9498583780306887734be/roles/021ad4c2b0894799925fdfadbf561b0b` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:52:58.895498 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062cb184-d5f9-4f8e-8308-7a2eba1aeb96 None admin] RBAC: Authorizing `identity:create_grant(project_id=f37c835c05924364bcd1530d44f024fe, user_id=c05caac9e8b9498583780306887734be, role_id=021ad4c2b0894799925fdfadbf561b0b)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:52:58.896925 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062cb184-d5f9-4f8e-8308-7a2eba1aeb96 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:52:58.910192 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 546/1084] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 14 00:52:58 2022] PUT /identity/v3/projects/f37c835c05924364bcd1530d44f024fe/users/c05caac9e8b9498583780306887734be/roles/021ad4c2b0894799925fdfadbf561b0b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 00:53:00.020962 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf98fa-c4de-42b5-b6d4-1d518ba51ffc None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:00.021409 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf98fa-c4de-42b5-b6d4-1d518ba51ffc None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:00.021530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf98fa-c4de-42b5-b6d4-1d518ba51ffc None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:00.022891 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 539/1085] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:53:00.028070 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57707b18-c76f-478f-8e92-f51694c51e8f None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:00.028502 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57707b18-c76f-478f-8e92-f51694c51e8f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:00.028612 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57707b18-c76f-478f-8e92-f51694c51e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:00.046490 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-57707b18-c76f-478f-8e92-f51694c51e8f None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:53:00.047655 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-57707b18-c76f-478f-8e92-f51694c51e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:53:00.110750 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 547/1086] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:53:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:53:00.380644 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf98fa-c4de-42b5-b6d4-1d518ba51ffc None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:00.478447 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf98fa-c4de-42b5-b6d4-1d518ba51ffc None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:00.509680 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5e434-009d-480f-b70e-3233195f1ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:00.510317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5e434-009d-480f-b70e-3233195f1ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:00.510591 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5e434-009d-480f-b70e-3233195f1ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:00.510856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5e434-009d-480f-b70e-3233195f1ff6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:00.521357 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5e434-009d-480f-b70e-3233195f1ff6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:53:00.526101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-80a5e434-009d-480f-b70e-3233195f1ff6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:53:00.526101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:53:00.526101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:53:00.526101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:53:00.526101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:53:00.526101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:53:00.526101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:53:00.526101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:53:00.526101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:53:00.526101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:53:00.526101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:53:00.526101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:53:00.526101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:53:00.526101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:53:00.526101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:53:00.526101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:53:00.527027 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:53:00.527027 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:53:00.527027 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:53:00.527027 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:53:00.527027 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:53:00.527027 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:53:00.527027 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:53:00.527027 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:53:00.527027 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:53:00.527027 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:53:00.527027 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:53:00.527027 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:53:00.527027 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:53:00.527027 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:53:00.527027 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:53:00.527027 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:53:00.527912 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:53:00.527912 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:53:00.527912 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:53:00.527912 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:53:00.527912 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:53:00.527912 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:53:00.527912 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:53:00.527912 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:53:00.527912 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:53:00.527912 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:53:00.527912 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:53:00.527912 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:53:00.527912 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 540/1087] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:53:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:53:00.534059 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57707b18-c76f-478f-8e92-f51694c51e8f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:00.551761 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:00.630301 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57707b18-c76f-478f-8e92-f51694c51e8f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:00.663021 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c886a85-dfbe-4d5e-856a-e016dc743b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:00.663550 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c886a85-dfbe-4d5e-856a-e016dc743b05 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:00.663826 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c886a85-dfbe-4d5e-856a-e016dc743b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:00.664094 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c886a85-dfbe-4d5e-856a-e016dc743b05 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:00.664743 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c886a85-dfbe-4d5e-856a-e016dc743b05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:53:00.665040 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c886a85-dfbe-4d5e-856a-e016dc743b05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:00.666421 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c886a85-dfbe-4d5e-856a-e016dc743b05 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:00.674185 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 548/1088] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:53:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:00.679983 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5e434-009d-480f-b70e-3233195f1ff6 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:00.732379 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:00.778072 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5e434-009d-480f-b70e-3233195f1ff6 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:00.810169 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48813107-9b37-4961-b25b-bf5b9e127d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:00.810780 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48813107-9b37-4961-b25b-bf5b9e127d1c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:00.811050 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48813107-9b37-4961-b25b-bf5b9e127d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:00.811311 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48813107-9b37-4961-b25b-bf5b9e127d1c None admin] PATH_INFO: `/v3/users/8c093b910f134577a0eab9002c9f8740` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:00.812405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48813107-9b37-4961-b25b-bf5b9e127d1c None admin] RBAC: Authorizing `identity:get_user(user_id=8c093b910f134577a0eab9002c9f8740)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:00.813847 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48813107-9b37-4961-b25b-bf5b9e127d1c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:00.815389 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 541/1089] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:53:00 2022] GET /identity/v3/users/8c093b910f134577a0eab9002c9f8740 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:00.821017 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c886a85-dfbe-4d5e-856a-e016dc743b05 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:00.897623 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:00.916798 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c886a85-dfbe-4d5e-856a-e016dc743b05 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:00.949712 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3342497-2d31-4f2d-b76c-20733fd2bdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:00.950388 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3342497-2d31-4f2d-b76c-20733fd2bdf0 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:00.950664 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3342497-2d31-4f2d-b76c-20733fd2bdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:00.950934 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3342497-2d31-4f2d-b76c-20733fd2bdf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:01.019297 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3342497-2d31-4f2d-b76c-20733fd2bdf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:01.020736 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3342497-2d31-4f2d-b76c-20733fd2bdf0 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:01.064565 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16040700-9ae0-497f-b607-ef086af24067 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:01.065099 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16040700-9ae0-497f-b607-ef086af24067 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:01.065099 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16040700-9ae0-497f-b607-ef086af24067 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:01.066444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 542/1090] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 00:53:01.071255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3829bfb-b38f-4ed0-8de4-560cfe48274d None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:01.071538 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3829bfb-b38f-4ed0-8de4-560cfe48274d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:01.071807 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3829bfb-b38f-4ed0-8de4-560cfe48274d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:01.091952 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-e3829bfb-b38f-4ed0-8de4-560cfe48274d None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:53:01.093122 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e3829bfb-b38f-4ed0-8de4-560cfe48274d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:53:01.096891 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:01.117682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 549/1091] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:53:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 14 00:53:01.123459 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3342497-2d31-4f2d-b76c-20733fd2bdf0 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:01.157040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 543/1092] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:53:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 00:53:01.221785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3342497-2d31-4f2d-b76c-20733fd2bdf0 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:01.258682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a19f3-855d-4531-a6df-9808e085f5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:01.259303 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a19f3-855d-4531-a6df-9808e085f5d6 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:01.259583 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a19f3-855d-4531-a6df-9808e085f5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:01.259857 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a19f3-855d-4531-a6df-9808e085f5d6 None admin] PATH_INFO: `/v3/projects/bf3119eb501b4453ab8c71fed6cffacd` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:01.260962 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a19f3-855d-4531-a6df-9808e085f5d6 None admin] RBAC: Authorizing `identity:get_project(project_id=bf3119eb501b4453ab8c71fed6cffacd)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:01.262481 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a19f3-855d-4531-a6df-9808e085f5d6 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:01.264095 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 550/1093] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:53:01 2022] GET /identity/v3/projects/bf3119eb501b4453ab8c71fed6cffacd => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:01.270195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3829bfb-b38f-4ed0-8de4-560cfe48274d None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:01.318647 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:01.367762 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3829bfb-b38f-4ed0-8de4-560cfe48274d None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:01.400833 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2548b4-2b85-45b7-ac5f-2770aeceed2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:01.401420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2548b4-2b85-45b7-ac5f-2770aeceed2f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:01.401695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2548b4-2b85-45b7-ac5f-2770aeceed2f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:01.401988 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2548b4-2b85-45b7-ac5f-2770aeceed2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:01.402698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2548b4-2b85-45b7-ac5f-2770aeceed2f None admin] RBAC: Adding query filter params (role.id=0d7a36bda723430eae02f10f4c775c96, scope.project.id=bf3119eb501b4453ab8c71fed6cffacd, user.id=8c093b910f134577a0eab9002c9f8740) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:53:01.403000 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2548b4-2b85-45b7-ac5f-2770aeceed2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:01.404435 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2548b4-2b85-45b7-ac5f-2770aeceed2f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:01.410301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 544/1094] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:53:01 2022] GET /identity/v3/role_assignments?user.id=8c093b910f134577a0eab9002c9f8740&scope.project.id=bf3119eb501b4453ab8c71fed6cffacd&role.id=0d7a36bda723430eae02f10f4c775c96 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:01.428229 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a19f3-855d-4531-a6df-9808e085f5d6 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:01.480972 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:01.535353 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a19f3-855d-4531-a6df-9808e085f5d6 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:01.576161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444de676-70a5-46fb-9ded-01d58990e0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:01.576790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444de676-70a5-46fb-9ded-01d58990e0fc None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:01.577063 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444de676-70a5-46fb-9ded-01d58990e0fc None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:01.577327 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444de676-70a5-46fb-9ded-01d58990e0fc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:01.587632 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444de676-70a5-46fb-9ded-01d58990e0fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:53:01.592422 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-444de676-70a5-46fb-9ded-01d58990e0fc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 00:53:01.592422 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:53:01.592422 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:53:01.592422 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:53:01.592422 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:53:01.592422 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:53:01.592422 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:53:01.592422 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:53:01.592422 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:53:01.592422 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:53:01.592422 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:53:01.592422 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:53:01.592422 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:53:01.592422 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:53:01.592422 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:53:01.592422 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:53:01.593404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:53:01.593404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:53:01.593404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:53:01.593404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:53:01.593404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:53:01.593404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:53:01.593404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:53:01.593404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:53:01.593404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:53:01.593404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:53:01.593404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:53:01.593404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:53:01.593404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:53:01.593404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:53:01.593404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:53:01.593404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:53:01.594282 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:53:01.594282 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:53:01.594282 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:53:01.594282 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:53:01.594282 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:53:01.594282 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:53:01.594282 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:53:01.594282 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:53:01.594282 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:53:01.594282 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:53:01.594282 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 00:53:01.594282 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:53:01.594282 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 551/1095] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Sep 14 00:53:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:53:01.599531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2548b4-2b85-45b7-ac5f-2770aeceed2f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:01.698859 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2548b4-2b85-45b7-ac5f-2770aeceed2f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:01.712105 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:01.732410 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588bf36-aa43-4bb8-9744-44b2014b2e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:01.732929 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588bf36-aa43-4bb8-9744-44b2014b2e75 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:01.733199 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588bf36-aa43-4bb8-9744-44b2014b2e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:01.733460 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588bf36-aa43-4bb8-9744-44b2014b2e75 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:01.734142 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588bf36-aa43-4bb8-9744-44b2014b2e75 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:53:01.734437 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588bf36-aa43-4bb8-9744-44b2014b2e75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:01.735792 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588bf36-aa43-4bb8-9744-44b2014b2e75 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:01.743396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 545/1096] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Sep 14 00:53:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:01.749250 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444de676-70a5-46fb-9ded-01d58990e0fc None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:01.846805 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444de676-70a5-46fb-9ded-01d58990e0fc None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:01.856007 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:01.879856 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101f99c-a526-484c-bec3-680a0422c324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:01.880474 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101f99c-a526-484c-bec3-680a0422c324 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:01.880750 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101f99c-a526-484c-bec3-680a0422c324 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:01.881037 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101f99c-a526-484c-bec3-680a0422c324 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:01.891365 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101f99c-a526-484c-bec3-680a0422c324 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:01.892806 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101f99c-a526-484c-bec3-680a0422c324 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:01.907533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-5101f99c-a526-484c-bec3-680a0422c324 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:53:01.907533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:53:01.907533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:53:01.907533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:53:01.907533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:53:01.907533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:53:01.907533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:53:01.907533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:53:01.907533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:53:01.907533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:53:01.907533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:53:01.907533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:53:01.907533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:53:01.907533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:53:01.907533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:53:01.907533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:53:01.908636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:53:01.908636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:53:01.908636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:53:01.908636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:53:01.908636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:53:01.908636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:53:01.908636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:53:01.908636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:53:01.908636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:53:01.908636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:53:01.908636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:53:01.908636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:53:01.908636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:53:01.908636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:53:01.908636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:53:01.908636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:53:01.908636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:53:01.910032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:53:01.910032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:53:01.910032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:53:01.910032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 552/1097] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:53:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:53:01.914285 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588bf36-aa43-4bb8-9744-44b2014b2e75 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:02.011444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588bf36-aa43-4bb8-9744-44b2014b2e75 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:02.045187 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4da5b-fefa-464f-be41-a86ff341131a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:02.045770 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4da5b-fefa-464f-be41-a86ff341131a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:02.046071 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4da5b-fefa-464f-be41-a86ff341131a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:02.046336 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4da5b-fefa-464f-be41-a86ff341131a None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:02.046954 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4da5b-fefa-464f-be41-a86ff341131a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:53:02.047248 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4da5b-fefa-464f-be41-a86ff341131a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:02.048593 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4da5b-fefa-464f-be41-a86ff341131a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:02.060247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 546/1098] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:02.065927 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101f99c-a526-484c-bec3-680a0422c324 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:02.160956 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101f99c-a526-484c-bec3-680a0422c324 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:02.194891 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04c0d0-d45b-4103-919d-5293e2d55d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:02.195517 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04c0d0-d45b-4103-919d-5293e2d55d82 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:02.195795 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04c0d0-d45b-4103-919d-5293e2d55d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:02.196093 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04c0d0-d45b-4103-919d-5293e2d55d82 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:02.204060 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04c0d0-d45b-4103-919d-5293e2d55d82 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:02.205491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04c0d0-d45b-4103-919d-5293e2d55d82 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:02.216304 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-8e04c0d0-d45b-4103-919d-5293e2d55d82 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 00:53:02.216304 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:53:02.216304 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:53:02.216304 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:53:02.216304 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:53:02.216304 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:53:02.216304 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:53:02.216304 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:53:02.216304 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:53:02.216304 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:53:02.216304 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:53:02.216304 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:53:02.216304 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:53:02.216304 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:53:02.216304 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:53:02.216304 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:53:02.222056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:53:02.222056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:53:02.222056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:53:02.222056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:53:02.222056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:53:02.222056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:53:02.222056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:53:02.222056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:53:02.222056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:53:02.222056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:53:02.222056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:53:02.222056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:53:02.222056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:53:02.222056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:53:02.222056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:53:02.222056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:53:02.222056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:53:02.222056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:53:02.223050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:53:02.223050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:53:02.223050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:53:02.223050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:53:02.223050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:53:02.223050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:53:02.223050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:53:02.223050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:53:02.223050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 00:53:02.223050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:53:02.223050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 553/1099] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Sep 14 00:53:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:53:02.223657 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4da5b-fefa-464f-be41-a86ff341131a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:02.259587 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:02.325953 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4da5b-fefa-464f-be41-a86ff341131a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:02.358780 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2baed-afa1-417d-8f8d-ee52f51dff7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:02.359364 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2baed-afa1-417d-8f8d-ee52f51dff7c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:02.359631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2baed-afa1-417d-8f8d-ee52f51dff7c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:02.359892 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2baed-afa1-417d-8f8d-ee52f51dff7c None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:02.360596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2baed-afa1-417d-8f8d-ee52f51dff7c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:53:02.360892 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2baed-afa1-417d-8f8d-ee52f51dff7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:02.362325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2baed-afa1-417d-8f8d-ee52f51dff7c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:02.379030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 547/1100] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Sep 14 00:53:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:02.384895 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04c0d0-d45b-4103-919d-5293e2d55d82 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:02.406844 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:02.482135 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04c0d0-d45b-4103-919d-5293e2d55d82 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:02.514355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a49e6-684a-4e59-9fd0-239464df6e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:02.514879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a49e6-684a-4e59-9fd0-239464df6e92 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:02.515157 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a49e6-684a-4e59-9fd0-239464df6e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:02.515427 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a49e6-684a-4e59-9fd0-239464df6e92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:02.580429 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a49e6-684a-4e59-9fd0-239464df6e92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:02.581871 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a49e6-684a-4e59-9fd0-239464df6e92 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:02.601042 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:02.677358 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 554/1101] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:53:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 14 00:53:02.683108 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2baed-afa1-417d-8f8d-ee52f51dff7c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:02.775375 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:02.782566 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2baed-afa1-417d-8f8d-ee52f51dff7c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:02.815642 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447543e-7cf9-477d-bd55-e14ca92bc99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:02.816248 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447543e-7cf9-477d-bd55-e14ca92bc99d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:02.816518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447543e-7cf9-477d-bd55-e14ca92bc99d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:02.816781 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447543e-7cf9-477d-bd55-e14ca92bc99d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:02.826245 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447543e-7cf9-477d-bd55-e14ca92bc99d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:02.827737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447543e-7cf9-477d-bd55-e14ca92bc99d None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:02.842170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-f447543e-7cf9-477d-bd55-e14ca92bc99d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:53:02.842170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:53:02.842170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:53:02.842170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:53:02.842170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:53:02.842170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:53:02.842170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:53:02.842170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:53:02.842170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:53:02.842170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:53:02.842170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:53:02.842170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:53:02.842170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:53:02.842170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:53:02.842170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:53:02.842170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:53:02.843169 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:53:02.843169 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:53:02.843169 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:53:02.843169 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:53:02.843169 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:53:02.843169 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:53:02.843169 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:53:02.843169 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:53:02.843169 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:53:02.843169 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:53:02.843169 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:53:02.843169 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:53:02.843169 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:53:02.843169 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:53:02.843169 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:53:02.843169 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:53:02.843169 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:53:02.844526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:53:02.844526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:53:02.844526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:53:02.844526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 548/1102] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:53:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:53:02.848919 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a49e6-684a-4e59-9fd0-239464df6e92 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:02.954614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a49e6-684a-4e59-9fd0-239464df6e92 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:02.973558 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:02.988050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fe913-6842-4698-947f-9f5fc05a2404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:02.988654 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fe913-6842-4698-947f-9f5fc05a2404 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:02.988933 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fe913-6842-4698-947f-9f5fc05a2404 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:02.989205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fe913-6842-4698-947f-9f5fc05a2404 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:02.989865 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fe913-6842-4698-947f-9f5fc05a2404 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:53:02.990172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fe913-6842-4698-947f-9f5fc05a2404 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:02.991556 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fe913-6842-4698-947f-9f5fc05a2404 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:03.004450 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 555/1103] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:03.010123 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447543e-7cf9-477d-bd55-e14ca92bc99d None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:03.107629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447543e-7cf9-477d-bd55-e14ca92bc99d None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:03.141146 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dab7af-5db6-44c7-b805-f26acbec7c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:03.141763 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dab7af-5db6-44c7-b805-f26acbec7c45 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:03.142069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dab7af-5db6-44c7-b805-f26acbec7c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:03.142340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dab7af-5db6-44c7-b805-f26acbec7c45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:03.148815 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dab7af-5db6-44c7-b805-f26acbec7c45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:03.150363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dab7af-5db6-44c7-b805-f26acbec7c45 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:03.161783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-c8dab7af-5db6-44c7-b805-f26acbec7c45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:53:03.161783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:53:03.161783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:53:03.161783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:53:03.161783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:53:03.161783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:53:03.161783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:53:03.161783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:53:03.161783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:53:03.161783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:53:03.161783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:53:03.161783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:53:03.161783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:53:03.161783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:53:03.161783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:53:03.162839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:53:03.162839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:53:03.162839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:53:03.162839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:53:03.162839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:53:03.162839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:53:03.162839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:53:03.162839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:53:03.162839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:53:03.162839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:53:03.162839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:53:03.162839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:53:03.162839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:53:03.162839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:53:03.162839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:53:03.162839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:53:03.162839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:53:03.163761 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:53:03.163761 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:53:03.163761 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:53:03.163761 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:53:03.163761 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:53:03.163761 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:53:03.163761 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:53:03.163761 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:53:03.163761 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 549/1104] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:53:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:53:03.169174 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fe913-6842-4698-947f-9f5fc05a2404 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:03.271295 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fe913-6842-4698-947f-9f5fc05a2404 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:03.304300 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10e448-8a17-4a3d-88d6-dc054253c6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:03.304906 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10e448-8a17-4a3d-88d6-dc054253c6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:03.305184 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10e448-8a17-4a3d-88d6-dc054253c6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:03.305456 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10e448-8a17-4a3d-88d6-dc054253c6c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:03.306168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10e448-8a17-4a3d-88d6-dc054253c6c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:53:03.306474 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10e448-8a17-4a3d-88d6-dc054253c6c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:03.307880 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10e448-8a17-4a3d-88d6-dc054253c6c3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:03.320366 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 556/1105] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:53:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:03.326501 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dab7af-5db6-44c7-b805-f26acbec7c45 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:03.335771 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:03.427261 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dab7af-5db6-44c7-b805-f26acbec7c45 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:03.459971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08f004-b04a-4dcf-bc84-fec767940156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:03.460592 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08f004-b04a-4dcf-bc84-fec767940156 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:03.461038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08f004-b04a-4dcf-bc84-fec767940156 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:03.461285 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08f004-b04a-4dcf-bc84-fec767940156 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:03.462117 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08f004-b04a-4dcf-bc84-fec767940156 None admin] RBAC: Adding query filter params (role.id=021ad4c2b0894799925fdfadbf561b0b, scope.project.id=f37c835c05924364bcd1530d44f024fe, user.id=c05caac9e8b9498583780306887734be) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:53:03.462508 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08f004-b04a-4dcf-bc84-fec767940156 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:03.464049 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08f004-b04a-4dcf-bc84-fec767940156 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:03.470960 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 550/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:53:03 2022] GET /identity/v3/role_assignments?user.id=c05caac9e8b9498583780306887734be&scope.project.id=f37c835c05924364bcd1530d44f024fe&role.id=021ad4c2b0894799925fdfadbf561b0b => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:03.590153 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df64e05-2769-40b1-840b-0f9c9f37f474 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:03.590435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df64e05-2769-40b1-840b-0f9c9f37f474 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:03.591223 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df64e05-2769-40b1-840b-0f9c9f37f474 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:03.592615 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 557/1107] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:53:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:53:03.598493 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc40180-8ecd-44a6-9c8f-3e6895f0f309 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:03.598858 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc40180-8ecd-44a6-9c8f-3e6895f0f309 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:03.599199 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc40180-8ecd-44a6-9c8f-3e6895f0f309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:03.618716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-bcc40180-8ecd-44a6-9c8f-3e6895f0f309 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:53:03.619938 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-bcc40180-8ecd-44a6-9c8f-3e6895f0f309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:53:03.685617 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:03.691576 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 551/1108] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:53:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:53:03.956283 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df64e05-2769-40b1-840b-0f9c9f37f474 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:04.001914 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:04.063771 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df64e05-2769-40b1-840b-0f9c9f37f474 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:04.097308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e76f2-46ae-4603-ba12-9c1e2c6b82e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:04.098038 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e76f2-46ae-4603-ba12-9c1e2c6b82e7 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:04.098349 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e76f2-46ae-4603-ba12-9c1e2c6b82e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:04.098631 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e76f2-46ae-4603-ba12-9c1e2c6b82e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:04.099750 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e76f2-46ae-4603-ba12-9c1e2c6b82e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:04.101190 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e76f2-46ae-4603-ba12-9c1e2c6b82e7 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:04.102812 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 558/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:53:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:04.109126 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc40180-8ecd-44a6-9c8f-3e6895f0f309 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:04.213980 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc40180-8ecd-44a6-9c8f-3e6895f0f309 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:04.248454 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbbcd6-0964-4b76-825e-b930454a6337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:04.249057 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbbcd6-0964-4b76-825e-b930454a6337 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:04.249335 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbbcd6-0964-4b76-825e-b930454a6337 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:04.249604 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbbcd6-0964-4b76-825e-b930454a6337 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:04.250394 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbbcd6-0964-4b76-825e-b930454a6337 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:04.251842 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbbcd6-0964-4b76-825e-b930454a6337 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:04.273763 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 552/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 14 00:53:04 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 00:53:06.456753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecb913-7b4e-4f81-a51a-d684d31e3ef2 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:06.457252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecb913-7b4e-4f81-a51a-d684d31e3ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:06.457252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecb913-7b4e-4f81-a51a-d684d31e3ef2 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:06.458585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 559/1111] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:53:06.463843 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b19a3a-a72b-4517-b24d-d2f91e5d2328 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:06.464233 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b19a3a-a72b-4517-b24d-d2f91e5d2328 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:06.464379 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b19a3a-a72b-4517-b24d-d2f91e5d2328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:06.483140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-d4b19a3a-a72b-4517-b24d-d2f91e5d2328 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:53:06.484296 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d4b19a3a-a72b-4517-b24d-d2f91e5d2328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:53:06.531794 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:06.548864 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 553/1112] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:53:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:53:06.820758 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecb913-7b4e-4f81-a51a-d684d31e3ef2 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:06.926978 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecb913-7b4e-4f81-a51a-d684d31e3ef2 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:06.936226 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:06.959575 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3a2bf-2e68-4919-97eb-77cae3219957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:06.960195 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3a2bf-2e68-4919-97eb-77cae3219957 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:06.960474 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3a2bf-2e68-4919-97eb-77cae3219957 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:06.960744 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3a2bf-2e68-4919-97eb-77cae3219957 None admin] PATH_INFO: `/v3/roles/8373a23ee4ff4c7d94e82480d85b586b` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:06.962120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3a2bf-2e68-4919-97eb-77cae3219957 None admin] RBAC: Authorizing `identity:get_role(role_id=8373a23ee4ff4c7d94e82480d85b586b)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:06.963473 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3a2bf-2e68-4919-97eb-77cae3219957 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:06.964771 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 560/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:53:06 2022] GET /identity/v3/roles/8373a23ee4ff4c7d94e82480d85b586b => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:06.970546 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b19a3a-a72b-4517-b24d-d2f91e5d2328 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:07.068329 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b19a3a-a72b-4517-b24d-d2f91e5d2328 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:07.100739 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfe915-f53f-48df-a0be-9a66bfa0364b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:07.101294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfe915-f53f-48df-a0be-9a66bfa0364b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:07.101573 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfe915-f53f-48df-a0be-9a66bfa0364b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:07.101866 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfe915-f53f-48df-a0be-9a66bfa0364b None admin] PATH_INFO: `/v3/users/d3edbf6969df4db5a571a295b4e194e3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:07.115148 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cfe915-f53f-48df-a0be-9a66bfa0364b None admin] RBAC: Authorizing `identity:get_user(user_id=d3edbf6969df4db5a571a295b4e194e3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:07.116582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cfe915-f53f-48df-a0be-9a66bfa0364b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:07.118184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 554/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:53:06 2022] GET /identity/v3/users/d3edbf6969df4db5a571a295b4e194e3 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:07.124435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3a2bf-2e68-4919-97eb-77cae3219957 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:07.221392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3a2bf-2e68-4919-97eb-77cae3219957 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:07.253497 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e3475-3947-42c9-84c2-738bdbb58c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:07.254114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3475-3947-42c9-84c2-738bdbb58c1e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:07.254388 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3475-3947-42c9-84c2-738bdbb58c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:07.254655 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3475-3947-42c9-84c2-738bdbb58c1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:07.297309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:07.319237 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e3475-3947-42c9-84c2-738bdbb58c1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:07.320665 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e3475-3947-42c9-84c2-738bdbb58c1e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:07.412326 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 561/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:53:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 00:53:07.418172 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfe915-f53f-48df-a0be-9a66bfa0364b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:07.462028 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:07.515557 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfe915-f53f-48df-a0be-9a66bfa0364b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:07.549270 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812accd0-598a-4e6a-9351-0e68f15245dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:07.549916 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812accd0-598a-4e6a-9351-0e68f15245dd None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:07.550199 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812accd0-598a-4e6a-9351-0e68f15245dd None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:07.550470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812accd0-598a-4e6a-9351-0e68f15245dd None admin] PATH_INFO: `/v3/projects/bf3119eb501b4453ab8c71fed6cffacd` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:07.551574 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812accd0-598a-4e6a-9351-0e68f15245dd None admin] RBAC: Authorizing `identity:get_project(project_id=bf3119eb501b4453ab8c71fed6cffacd)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:07.552995 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812accd0-598a-4e6a-9351-0e68f15245dd None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:07.554617 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 555/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:53:07 2022] GET /identity/v3/projects/bf3119eb501b4453ab8c71fed6cffacd => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:07.560799 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e3475-3947-42c9-84c2-738bdbb58c1e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:07.633440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:07.656650 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e3475-3947-42c9-84c2-738bdbb58c1e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:07.689241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55944993-ecf2-4018-b3b4-fe355e6afb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:07.689772 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55944993-ecf2-4018-b3b4-fe355e6afb97 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:07.690106 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55944993-ecf2-4018-b3b4-fe355e6afb97 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:07.690378 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55944993-ecf2-4018-b3b4-fe355e6afb97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:07.691083 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55944993-ecf2-4018-b3b4-fe355e6afb97 None admin] RBAC: Adding query filter params (role.id=8373a23ee4ff4c7d94e82480d85b586b, scope.project.id=bf3119eb501b4453ab8c71fed6cffacd, user.id=d3edbf6969df4db5a571a295b4e194e3) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:53:07.691390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55944993-ecf2-4018-b3b4-fe355e6afb97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:07.692799 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55944993-ecf2-4018-b3b4-fe355e6afb97 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:07.698099 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 562/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:53:07 2022] GET /identity/v3/role_assignments?user.id=d3edbf6969df4db5a571a295b4e194e3&scope.project.id=bf3119eb501b4453ab8c71fed6cffacd&role.id=8373a23ee4ff4c7d94e82480d85b586b => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:09.829325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd07a5-fb22-4046-986d-93143970373c None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:09.829878 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd07a5-fb22-4046-986d-93143970373c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:09.829878 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd07a5-fb22-4046-986d-93143970373c None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:09.831208 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 556/1118] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:53:09.836390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecba22c-b19e-4b10-9801-2e859b768964 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:09.836793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecba22c-b19e-4b10-9801-2e859b768964 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:09.836938 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecba22c-b19e-4b10-9801-2e859b768964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:09.854553 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-aecba22c-b19e-4b10-9801-2e859b768964 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:53:09.855743 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-aecba22c-b19e-4b10-9801-2e859b768964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:53:09.919715 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 563/1119] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:53:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:53:10.186582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd07a5-fb22-4046-986d-93143970373c None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:10.284369 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd07a5-fb22-4046-986d-93143970373c None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:10.296741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:10.319289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502e544-733b-4e52-aa67-0474c5e54dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:10.319894 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502e544-733b-4e52-aa67-0474c5e54dac None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:10.320165 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502e544-733b-4e52-aa67-0474c5e54dac None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:10.320430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502e544-733b-4e52-aa67-0474c5e54dac None admin] PATH_INFO: `/v3/roles/8373a23ee4ff4c7d94e82480d85b586b` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:10.321780 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502e544-733b-4e52-aa67-0474c5e54dac None admin] RBAC: Authorizing `identity:get_role(role_id=8373a23ee4ff4c7d94e82480d85b586b)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:10.323357 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502e544-733b-4e52-aa67-0474c5e54dac None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:10.324652 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 557/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:53:10 2022] GET /identity/v3/roles/8373a23ee4ff4c7d94e82480d85b586b => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:10.331056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecba22c-b19e-4b10-9801-2e859b768964 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:10.396024 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:10.425425 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecba22c-b19e-4b10-9801-2e859b768964 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:10.457852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bf74d-a0ad-496b-ba37-9ce6df19fc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:10.458414 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bf74d-a0ad-496b-ba37-9ce6df19fc0f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:10.458694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bf74d-a0ad-496b-ba37-9ce6df19fc0f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:10.458965 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bf74d-a0ad-496b-ba37-9ce6df19fc0f None admin] PATH_INFO: `/v3/users/d3edbf6969df4db5a571a295b4e194e3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:10.460060 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bf74d-a0ad-496b-ba37-9ce6df19fc0f None admin] RBAC: Authorizing `identity:get_user(user_id=d3edbf6969df4db5a571a295b4e194e3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:10.461470 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bf74d-a0ad-496b-ba37-9ce6df19fc0f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:10.463029 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 564/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:53:10 2022] GET /identity/v3/users/d3edbf6969df4db5a571a295b4e194e3 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:10.468703 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502e544-733b-4e52-aa67-0474c5e54dac None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:10.570106 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502e544-733b-4e52-aa67-0474c5e54dac None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:10.602403 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262501e-3d4f-4be2-877a-647c82cfb759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:10.603025 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262501e-3d4f-4be2-877a-647c82cfb759 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:10.603304 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262501e-3d4f-4be2-877a-647c82cfb759 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:10.603576 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262501e-3d4f-4be2-877a-647c82cfb759 None admin] PATH_INFO: `/v3/projects/bf3119eb501b4453ab8c71fed6cffacd` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:10.604684 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262501e-3d4f-4be2-877a-647c82cfb759 None admin] RBAC: Authorizing `identity:get_project(project_id=bf3119eb501b4453ab8c71fed6cffacd)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:10.606144 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262501e-3d4f-4be2-877a-647c82cfb759 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:10.607752 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 558/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:53:10 2022] GET /identity/v3/projects/bf3119eb501b4453ab8c71fed6cffacd => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:10.613726 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bf74d-a0ad-496b-ba37-9ce6df19fc0f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:10.709654 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bf74d-a0ad-496b-ba37-9ce6df19fc0f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:10.741149 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe35c71-7b53-4589-ac03-8b73e390e51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:10.741779 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe35c71-7b53-4589-ac03-8b73e390e51c None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:10.742093 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe35c71-7b53-4589-ac03-8b73e390e51c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:10.742364 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe35c71-7b53-4589-ac03-8b73e390e51c None admin] PATH_INFO: `/v3/projects/bf3119eb501b4453ab8c71fed6cffacd/users/d3edbf6969df4db5a571a295b4e194e3/roles/8373a23ee4ff4c7d94e82480d85b586b` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:10.744439 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe35c71-7b53-4589-ac03-8b73e390e51c None admin] RBAC: Authorizing `identity:create_grant(project_id=bf3119eb501b4453ab8c71fed6cffacd, user_id=d3edbf6969df4db5a571a295b4e194e3, role_id=8373a23ee4ff4c7d94e82480d85b586b)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:10.745873 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe35c71-7b53-4589-ac03-8b73e390e51c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:10.754075 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:10.759623 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 565/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 14 00:53:10 2022] PUT /identity/v3/projects/bf3119eb501b4453ab8c71fed6cffacd/users/d3edbf6969df4db5a571a295b4e194e3/roles/8373a23ee4ff4c7d94e82480d85b586b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 00:53:12.843695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c203c2-19b8-40ad-b3d8-8129714b2d10 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:12.844223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c203c2-19b8-40ad-b3d8-8129714b2d10 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:12.844223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c203c2-19b8-40ad-b3d8-8129714b2d10 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:12.845525 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 559/1124] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:53:12.850790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59c51a-7026-443c-9157-19c8f616771a None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:12.851210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59c51a-7026-443c-9157-19c8f616771a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:12.851316 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59c51a-7026-443c-9157-19c8f616771a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:12.869588 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ae59c51a-7026-443c-9157-19c8f616771a None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:53:12.870824 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ae59c51a-7026-443c-9157-19c8f616771a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:53:12.933078 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 566/1125] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:53:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:53:13.201311 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c203c2-19b8-40ad-b3d8-8129714b2d10 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:13.249707 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:13.299065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c203c2-19b8-40ad-b3d8-8129714b2d10 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:13.331780 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1fefd-5f3b-4f7d-af63-c9fbc3ed67de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:13.332380 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1fefd-5f3b-4f7d-af63-c9fbc3ed67de None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:13.332650 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1fefd-5f3b-4f7d-af63-c9fbc3ed67de None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:13.332911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1fefd-5f3b-4f7d-af63-c9fbc3ed67de None admin] PATH_INFO: `/v3/roles/8373a23ee4ff4c7d94e82480d85b586b` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:13.334279 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1fefd-5f3b-4f7d-af63-c9fbc3ed67de None admin] RBAC: Authorizing `identity:get_role(role_id=8373a23ee4ff4c7d94e82480d85b586b)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:13.335622 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1fefd-5f3b-4f7d-af63-c9fbc3ed67de None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:13.336885 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 560/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:53:13 2022] GET /identity/v3/roles/8373a23ee4ff4c7d94e82480d85b586b => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:13.343197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59c51a-7026-443c-9157-19c8f616771a None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:13.438573 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59c51a-7026-443c-9157-19c8f616771a None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:13.463982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:13.472346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c46ac-c08d-4dc7-99e8-689690727062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:13.472964 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c46ac-c08d-4dc7-99e8-689690727062 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:13.473243 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c46ac-c08d-4dc7-99e8-689690727062 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:13.473517 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c46ac-c08d-4dc7-99e8-689690727062 None admin] PATH_INFO: `/v3/users/d3edbf6969df4db5a571a295b4e194e3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:13.474656 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c46ac-c08d-4dc7-99e8-689690727062 None admin] RBAC: Authorizing `identity:get_user(user_id=d3edbf6969df4db5a571a295b4e194e3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:13.476073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c46ac-c08d-4dc7-99e8-689690727062 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:13.477621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 567/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:53:13 2022] GET /identity/v3/users/d3edbf6969df4db5a571a295b4e194e3 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:13.483283 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1fefd-5f3b-4f7d-af63-c9fbc3ed67de None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:13.578192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1fefd-5f3b-4f7d-af63-c9fbc3ed67de None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:13.593435 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:13.610485 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e511aa5-51b1-487e-b2b6-691ef4f09fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:13.611063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e511aa5-51b1-487e-b2b6-691ef4f09fcb None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:13.611334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e511aa5-51b1-487e-b2b6-691ef4f09fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:13.611598 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e511aa5-51b1-487e-b2b6-691ef4f09fcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:13.675590 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e511aa5-51b1-487e-b2b6-691ef4f09fcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:13.677016 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e511aa5-51b1-487e-b2b6-691ef4f09fcb None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:13.769933 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 561/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:53:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 00:53:13.775806 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c46ac-c08d-4dc7-99e8-689690727062 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:13.880585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c46ac-c08d-4dc7-99e8-689690727062 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:13.913833 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c04ecd-0ca5-401a-85b8-5702f3c529ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:13.914462 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c04ecd-0ca5-401a-85b8-5702f3c529ff None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:13.914742 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c04ecd-0ca5-401a-85b8-5702f3c529ff None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:13.915014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c04ecd-0ca5-401a-85b8-5702f3c529ff None admin] PATH_INFO: `/v3/projects/bf3119eb501b4453ab8c71fed6cffacd` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:13.916117 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c04ecd-0ca5-401a-85b8-5702f3c529ff None admin] RBAC: Authorizing `identity:get_project(project_id=bf3119eb501b4453ab8c71fed6cffacd)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:13.917538 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c04ecd-0ca5-401a-85b8-5702f3c529ff None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:13.919967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 568/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:53:13 2022] GET /identity/v3/projects/bf3119eb501b4453ab8c71fed6cffacd => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:13.926285 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e511aa5-51b1-487e-b2b6-691ef4f09fcb None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:13.942970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:14.021263 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e511aa5-51b1-487e-b2b6-691ef4f09fcb None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:14.054072 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299857f-d0ed-4fdc-96c7-f1f7b9b00534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:14.054687 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299857f-d0ed-4fdc-96c7-f1f7b9b00534 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:14.054961 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299857f-d0ed-4fdc-96c7-f1f7b9b00534 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:14.055228 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299857f-d0ed-4fdc-96c7-f1f7b9b00534 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:14.055940 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299857f-d0ed-4fdc-96c7-f1f7b9b00534 None admin] RBAC: Adding query filter params (role.id=8373a23ee4ff4c7d94e82480d85b586b, scope.project.id=bf3119eb501b4453ab8c71fed6cffacd, user.id=d3edbf6969df4db5a571a295b4e194e3) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:53:14.056246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299857f-d0ed-4fdc-96c7-f1f7b9b00534 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:14.057711 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299857f-d0ed-4fdc-96c7-f1f7b9b00534 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:14.063789 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 562/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:53:13 2022] GET /identity/v3/role_assignments?user.id=d3edbf6969df4db5a571a295b4e194e3&scope.project.id=bf3119eb501b4453ab8c71fed6cffacd&role.id=8373a23ee4ff4c7d94e82480d85b586b => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:16.209841 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c0aed-b8c2-4aba-a27d-0b933ffc8566 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:16.210361 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c0aed-b8c2-4aba-a27d-0b933ffc8566 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:16.210361 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c0aed-b8c2-4aba-a27d-0b933ffc8566 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:16.211707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 569/1131] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:53:16.216901 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96089426-33ce-4876-a1d3-bab89d0128ab None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:16.217323 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96089426-33ce-4876-a1d3-bab89d0128ab None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:16.217425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96089426-33ce-4876-a1d3-bab89d0128ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:16.236038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-96089426-33ce-4876-a1d3-bab89d0128ab None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:53:16.237219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-96089426-33ce-4876-a1d3-bab89d0128ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:53:16.301027 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 563/1132] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:53:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:53:16.570605 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c0aed-b8c2-4aba-a27d-0b933ffc8566 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:16.646091 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:16.684608 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c0aed-b8c2-4aba-a27d-0b933ffc8566 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:16.716674 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78eecf-46c9-4a12-b108-15fa723ecc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:16.717286 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78eecf-46c9-4a12-b108-15fa723ecc80 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:16.717565 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78eecf-46c9-4a12-b108-15fa723ecc80 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:16.717858 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78eecf-46c9-4a12-b108-15fa723ecc80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:16.718952 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78eecf-46c9-4a12-b108-15fa723ecc80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:16.720363 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78eecf-46c9-4a12-b108-15fa723ecc80 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:16.722090 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 570/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:53:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:16.727889 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96089426-33ce-4876-a1d3-bab89d0128ab None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:16.739459 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:16.822538 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96089426-33ce-4876-a1d3-bab89d0128ab None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:16.854518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c1fc3-9711-445c-a57b-24031c8072f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:16.855095 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c1fc3-9711-445c-a57b-24031c8072f2 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:16.855367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c1fc3-9711-445c-a57b-24031c8072f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:16.855633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c1fc3-9711-445c-a57b-24031c8072f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:16.856804 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c1fc3-9711-445c-a57b-24031c8072f2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:16.858232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c1fc3-9711-445c-a57b-24031c8072f2 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:16.883228 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 564/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Sep 14 00:53:16 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:53:19.139688 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdcdc2-e57a-402e-ae11-0ce5090044c0 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:19.140229 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdcdc2-e57a-402e-ae11-0ce5090044c0 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:19.140229 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdcdc2-e57a-402e-ae11-0ce5090044c0 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:19.141549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 571/1135] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:53:19.146850 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2853f1-33c3-44a5-9b2a-b13b1de2e729 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:19.147227 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2853f1-33c3-44a5-9b2a-b13b1de2e729 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:19.147396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2853f1-33c3-44a5-9b2a-b13b1de2e729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:19.166037 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-bf2853f1-33c3-44a5-9b2a-b13b1de2e729 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:53:19.167207 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-bf2853f1-33c3-44a5-9b2a-b13b1de2e729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:53:19.221307 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:19.232767 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 565/1136] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:53:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:53:19.498964 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fdcdc2-e57a-402e-ae11-0ce5090044c0 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:19.594732 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fdcdc2-e57a-402e-ae11-0ce5090044c0 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:19.623343 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:19.628456 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb14f8-264e-47d5-8578-680aae557636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:19.629058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb14f8-264e-47d5-8578-680aae557636 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:19.629330 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb14f8-264e-47d5-8578-680aae557636 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:19.629596 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb14f8-264e-47d5-8578-680aae557636 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:19.630707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb14f8-264e-47d5-8578-680aae557636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:19.632140 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb14f8-264e-47d5-8578-680aae557636 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:19.633649 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 572/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:53:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:19.639854 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2853f1-33c3-44a5-9b2a-b13b1de2e729 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:19.735920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2853f1-33c3-44a5-9b2a-b13b1de2e729 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:19.769531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be50941-e631-4d5f-9041-b76ff598f985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:19.770095 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be50941-e631-4d5f-9041-b76ff598f985 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:19.770369 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be50941-e631-4d5f-9041-b76ff598f985 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:19.770634 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be50941-e631-4d5f-9041-b76ff598f985 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:19.771273 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be50941-e631-4d5f-9041-b76ff598f985 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:19.772709 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be50941-e631-4d5f-9041-b76ff598f985 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:19.793036 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 566/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 14 00:53:19 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:53:21.933847 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b85b20-7e0a-4e75-b6b2-9ac692a4d0a1 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:21.934400 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b85b20-7e0a-4e75-b6b2-9ac692a4d0a1 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:21.934400 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b85b20-7e0a-4e75-b6b2-9ac692a4d0a1 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:21.935700 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 573/1139] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:53:21.940869 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fab5d4-876f-42fd-a025-f7716fa6fa21 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:21.941285 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fab5d4-876f-42fd-a025-f7716fa6fa21 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:21.941391 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fab5d4-876f-42fd-a025-f7716fa6fa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:21.959601 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-25fab5d4-876f-42fd-a025-f7716fa6fa21 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:53:21.960809 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-25fab5d4-876f-42fd-a025-f7716fa6fa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:53:22.002871 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:22.026568 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 567/1140] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:53:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:53:22.295065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b85b20-7e0a-4e75-b6b2-9ac692a4d0a1 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:22.392480 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b85b20-7e0a-4e75-b6b2-9ac692a4d0a1 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:22.424979 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fe20e-1116-4e92-811f-d75f55c45589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:22.425589 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fe20e-1116-4e92-811f-d75f55c45589 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:22.425894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fe20e-1116-4e92-811f-d75f55c45589 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:22.426166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fe20e-1116-4e92-811f-d75f55c45589 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:22.436212 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fe20e-1116-4e92-811f-d75f55c45589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:53:22.440941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-fa4fe20e-1116-4e92-811f-d75f55c45589 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:53:22.440941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:53:22.440941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:53:22.440941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:53:22.440941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:53:22.440941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:53:22.440941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:53:22.440941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:53:22.440941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:53:22.440941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:53:22.440941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:53:22.440941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:53:22.440941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:53:22.440941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:53:22.440941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:53:22.440941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:53:22.442023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:53:22.442023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:53:22.442023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:53:22.442023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:53:22.442023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:53:22.442023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:53:22.442023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:53:22.442023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:53:22.442023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:53:22.442023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:53:22.442023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:53:22.442023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:53:22.442023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:53:22.442023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:53:22.442023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:53:22.442023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:53:22.443065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:53:22.443065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:53:22.443065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:53:22.443065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:53:22.443065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:53:22.443065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:53:22.443065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:53:22.443065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:53:22.443065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:53:22.443065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:53:22.443065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:53:22.443065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:53:22.443065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 574/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:53:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:53:22.448051 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fab5d4-876f-42fd-a025-f7716fa6fa21 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:22.542616 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fab5d4-876f-42fd-a025-f7716fa6fa21 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:22.577362 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd523ac-5c39-443a-bcb2-c6d96030bfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:22.577892 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd523ac-5c39-443a-bcb2-c6d96030bfe1 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:22.578172 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd523ac-5c39-443a-bcb2-c6d96030bfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:22.578435 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd523ac-5c39-443a-bcb2-c6d96030bfe1 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:22.579085 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd523ac-5c39-443a-bcb2-c6d96030bfe1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:53:22.579380 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd523ac-5c39-443a-bcb2-c6d96030bfe1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:22.580725 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd523ac-5c39-443a-bcb2-c6d96030bfe1 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:22.588549 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 568/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:53:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:22.594554 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fe20e-1116-4e92-811f-d75f55c45589 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:22.651172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:22.690552 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fe20e-1116-4e92-811f-d75f55c45589 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:22.723102 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1a484-8d4b-42b3-99f6-a857b6af27e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:22.723712 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1a484-8d4b-42b3-99f6-a857b6af27e8 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:22.723988 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1a484-8d4b-42b3-99f6-a857b6af27e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:22.724256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1a484-8d4b-42b3-99f6-a857b6af27e8 None admin] PATH_INFO: `/v3/users/37da5d9237a9439eabe9d8e4c6a177c7` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:22.737346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1a484-8d4b-42b3-99f6-a857b6af27e8 None admin] RBAC: Authorizing `identity:get_user(user_id=37da5d9237a9439eabe9d8e4c6a177c7)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:22.738778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1a484-8d4b-42b3-99f6-a857b6af27e8 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:22.740337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 575/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:53:22 2022] GET /identity/v3/users/37da5d9237a9439eabe9d8e4c6a177c7 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:22.746148 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd523ac-5c39-443a-bcb2-c6d96030bfe1 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:22.786500 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:22.845184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd523ac-5c39-443a-bcb2-c6d96030bfe1 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:22.880002 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b851e-6074-4536-b7b8-3576e94805aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:22.880589 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b851e-6074-4536-b7b8-3576e94805aa None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:22.880865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b851e-6074-4536-b7b8-3576e94805aa None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:22.881133 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b851e-6074-4536-b7b8-3576e94805aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:22.945828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b851e-6074-4536-b7b8-3576e94805aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:22.947268 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b851e-6074-4536-b7b8-3576e94805aa None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:22.985239 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:23.042308 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 569/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:53:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 00:53:23.048853 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1a484-8d4b-42b3-99f6-a857b6af27e8 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:23.141981 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1a484-8d4b-42b3-99f6-a857b6af27e8 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:23.158804 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:23.174834 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d1b6d-c8be-489d-b5b0-df8497eefc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:23.175445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d1b6d-c8be-489d-b5b0-df8497eefc64 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:23.175722 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d1b6d-c8be-489d-b5b0-df8497eefc64 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:23.175992 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d1b6d-c8be-489d-b5b0-df8497eefc64 None admin] PATH_INFO: `/v3/projects/9a2f35850d204b1ba40a6c9d95b379ed` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:23.177076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d1b6d-c8be-489d-b5b0-df8497eefc64 None admin] RBAC: Authorizing `identity:get_project(project_id=9a2f35850d204b1ba40a6c9d95b379ed)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:23.178512 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d1b6d-c8be-489d-b5b0-df8497eefc64 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:23.180089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 576/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:53:23 2022] GET /identity/v3/projects/9a2f35850d204b1ba40a6c9d95b379ed => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:23.186894 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b851e-6074-4536-b7b8-3576e94805aa None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:23.279806 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b851e-6074-4536-b7b8-3576e94805aa None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:23.312143 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc57b97-fac1-47b6-ab55-afa2dd76282c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:23.312716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc57b97-fac1-47b6-ab55-afa2dd76282c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:23.312987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc57b97-fac1-47b6-ab55-afa2dd76282c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:23.313250 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc57b97-fac1-47b6-ab55-afa2dd76282c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:23.313978 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc57b97-fac1-47b6-ab55-afa2dd76282c None admin] RBAC: Adding query filter params (role.id=0d7a36bda723430eae02f10f4c775c96, scope.project.id=9a2f35850d204b1ba40a6c9d95b379ed, user.id=37da5d9237a9439eabe9d8e4c6a177c7) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:53:23.314278 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc57b97-fac1-47b6-ab55-afa2dd76282c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:23.315684 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc57b97-fac1-47b6-ab55-afa2dd76282c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:23.320780 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 570/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:53:23 2022] GET /identity/v3/role_assignments?user.id=37da5d9237a9439eabe9d8e4c6a177c7&scope.project.id=9a2f35850d204b1ba40a6c9d95b379ed&role.id=0d7a36bda723430eae02f10f4c775c96 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:25.442249 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedef56-88d9-4a62-b17c-21afcf59e319 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:25.442747 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedef56-88d9-4a62-b17c-21afcf59e319 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:25.442747 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedef56-88d9-4a62-b17c-21afcf59e319 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:25.444040 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 577/1147] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:53:25.449183 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9726db-b5cd-4f86-b0a1-056e666b1a62 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:25.450286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9726db-b5cd-4f86-b0a1-056e666b1a62 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:25.450286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9726db-b5cd-4f86-b0a1-056e666b1a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:25.457317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:25.468173 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-df9726db-b5cd-4f86-b0a1-056e666b1a62 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:53:25.469349 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-df9726db-b5cd-4f86-b0a1-056e666b1a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:53:25.533382 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 571/1148] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:53:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:53:25.800990 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedef56-88d9-4a62-b17c-21afcf59e319 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:25.898485 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedef56-88d9-4a62-b17c-21afcf59e319 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:25.931055 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc7f5d-35b7-4b8e-9838-67cea69e85b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:25.931663 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc7f5d-35b7-4b8e-9838-67cea69e85b6 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:25.931947 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc7f5d-35b7-4b8e-9838-67cea69e85b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:25.932221 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc7f5d-35b7-4b8e-9838-67cea69e85b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:25.942887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc7f5d-35b7-4b8e-9838-67cea69e85b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:53:25.947815 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-36cc7f5d-35b7-4b8e-9838-67cea69e85b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:53:25.947815 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:53:25.947815 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:53:25.947815 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:53:25.947815 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:53:25.947815 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:53:25.947815 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:53:25.947815 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:53:25.947815 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:53:25.947815 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:53:25.947815 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:53:25.947815 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:53:25.947815 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:53:25.947815 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:53:25.947815 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:53:25.947815 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:53:25.948924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:53:25.948924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:53:25.948924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:53:25.948924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:53:25.948924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:53:25.948924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:53:25.948924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:53:25.948924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:53:25.948924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:53:25.948924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:53:25.948924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:53:25.948924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:53:25.948924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:53:25.948924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:53:25.948924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:53:25.948924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:53:25.949963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:53:25.949963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:53:25.949963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:53:25.949963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:53:25.949963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:53:25.949963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:53:25.949963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:53:25.949963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:53:25.949963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:53:25.949963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:53:25.949963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:53:25.949963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:53:25.949963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 578/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:53:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:53:25.955584 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9726db-b5cd-4f86-b0a1-056e666b1a62 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:26.050979 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9726db-b5cd-4f86-b0a1-056e666b1a62 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:26.083301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426775a-75f1-4ae8-bf92-8e2dc278d343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:26.083826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426775a-75f1-4ae8-bf92-8e2dc278d343 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:26.084097 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426775a-75f1-4ae8-bf92-8e2dc278d343 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:26.084364 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426775a-75f1-4ae8-bf92-8e2dc278d343 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:26.085005 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426775a-75f1-4ae8-bf92-8e2dc278d343 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:53:26.085296 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426775a-75f1-4ae8-bf92-8e2dc278d343 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:26.086665 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426775a-75f1-4ae8-bf92-8e2dc278d343 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:26.087946 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:26.095534 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 572/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:53:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:26.101320 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc7f5d-35b7-4b8e-9838-67cea69e85b6 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:26.146951 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:26.198191 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc7f5d-35b7-4b8e-9838-67cea69e85b6 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:26.230080 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b1509-f87a-45ba-8d50-e1c801a3b896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:26.230756 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b1509-f87a-45ba-8d50-e1c801a3b896 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:26.231031 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b1509-f87a-45ba-8d50-e1c801a3b896 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:26.231300 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b1509-f87a-45ba-8d50-e1c801a3b896 None admin] PATH_INFO: `/v3/users/37da5d9237a9439eabe9d8e4c6a177c7` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:26.232405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b1509-f87a-45ba-8d50-e1c801a3b896 None admin] RBAC: Authorizing `identity:get_user(user_id=37da5d9237a9439eabe9d8e4c6a177c7)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:26.233868 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b1509-f87a-45ba-8d50-e1c801a3b896 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:26.235410 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 579/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:53:26 2022] GET /identity/v3/users/37da5d9237a9439eabe9d8e4c6a177c7 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:26.241070 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426775a-75f1-4ae8-bf92-8e2dc278d343 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:26.338220 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426775a-75f1-4ae8-bf92-8e2dc278d343 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:26.369744 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c9365-6760-40ec-8a22-d38893904bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:26.370376 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c9365-6760-40ec-8a22-d38893904bdd None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:26.370649 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c9365-6760-40ec-8a22-d38893904bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:26.370915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c9365-6760-40ec-8a22-d38893904bdd None admin] PATH_INFO: `/v3/projects/9a2f35850d204b1ba40a6c9d95b379ed` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:26.372530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c9365-6760-40ec-8a22-d38893904bdd None admin] RBAC: Authorizing `identity:get_project(project_id=9a2f35850d204b1ba40a6c9d95b379ed)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:26.373980 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c9365-6760-40ec-8a22-d38893904bdd None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:26.375547 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 573/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:53:26 2022] GET /identity/v3/projects/9a2f35850d204b1ba40a6c9d95b379ed => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:26.381239 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b1509-f87a-45ba-8d50-e1c801a3b896 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:26.478835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b1509-f87a-45ba-8d50-e1c801a3b896 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:26.492209 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:26.512543 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac05d6a-c47a-4de2-a491-3b2a61fb953a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:26.513184 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac05d6a-c47a-4de2-a491-3b2a61fb953a None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:26.513466 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac05d6a-c47a-4de2-a491-3b2a61fb953a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:26.513738 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac05d6a-c47a-4de2-a491-3b2a61fb953a None admin] PATH_INFO: `/v3/projects/9a2f35850d204b1ba40a6c9d95b379ed/users/37da5d9237a9439eabe9d8e4c6a177c7/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:26.515620 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac05d6a-c47a-4de2-a491-3b2a61fb953a None admin] RBAC: Authorizing `identity:create_grant(project_id=9a2f35850d204b1ba40a6c9d95b379ed, user_id=37da5d9237a9439eabe9d8e4c6a177c7, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:26.517033 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac05d6a-c47a-4de2-a491-3b2a61fb953a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:26.529435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 580/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 14 00:53:26 2022] PUT /identity/v3/projects/9a2f35850d204b1ba40a6c9d95b379ed/users/37da5d9237a9439eabe9d8e4c6a177c7/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 00:53:28.628347 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca65514-c18a-4809-b671-c87d589cc5cb None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:28.628940 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca65514-c18a-4809-b671-c87d589cc5cb None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:28.628940 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca65514-c18a-4809-b671-c87d589cc5cb None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:28.630235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 574/1154] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:53:28.635410 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf509f5-871a-4b1c-bbeb-f5522406bac7 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:28.635800 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf509f5-871a-4b1c-bbeb-f5522406bac7 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:28.635955 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf509f5-871a-4b1c-bbeb-f5522406bac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:28.653975 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-7cf509f5-871a-4b1c-bbeb-f5522406bac7 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:53:28.655392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7cf509f5-871a-4b1c-bbeb-f5522406bac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:53:28.719859 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 581/1155] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:53:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:53:28.988923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca65514-c18a-4809-b671-c87d589cc5cb None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:29.050240 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:29.088296 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca65514-c18a-4809-b671-c87d589cc5cb None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:29.119803 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565bd23-8813-4cef-84b4-a0fa7d076e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:29.120413 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565bd23-8813-4cef-84b4-a0fa7d076e0b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:29.120689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565bd23-8813-4cef-84b4-a0fa7d076e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:29.120956 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565bd23-8813-4cef-84b4-a0fa7d076e0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:29.131625 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565bd23-8813-4cef-84b4-a0fa7d076e0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:53:29.136405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-e565bd23-8813-4cef-84b4-a0fa7d076e0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:53:29.136405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:53:29.136405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:53:29.136405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:53:29.136405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:53:29.136405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:53:29.136405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:53:29.136405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:53:29.136405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:53:29.136405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:53:29.136405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:53:29.136405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:53:29.136405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:53:29.136405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:53:29.136405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:53:29.136405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:53:29.138204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:53:29.138204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:53:29.138204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:53:29.138204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:53:29.138204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:53:29.138204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:53:29.138204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:53:29.138204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:53:29.138204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:53:29.138204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:53:29.138204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:53:29.138204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:53:29.138204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:53:29.138204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:53:29.138204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:53:29.138204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:53:29.139140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:53:29.139140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:53:29.139140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:53:29.139140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:53:29.139140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:53:29.139140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:53:29.139140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:53:29.139140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:53:29.139140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:53:29.139140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:53:29.139140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:53:29.139140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:53:29.139140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 575/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:53:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:53:29.144147 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf509f5-871a-4b1c-bbeb-f5522406bac7 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:29.236191 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf509f5-871a-4b1c-bbeb-f5522406bac7 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:29.238393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:29.270760 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1c247-cc70-4b75-a006-e26a929e6fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:29.271295 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1c247-cc70-4b75-a006-e26a929e6fda None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:29.271573 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1c247-cc70-4b75-a006-e26a929e6fda None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:29.271881 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1c247-cc70-4b75-a006-e26a929e6fda None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:29.272529 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1c247-cc70-4b75-a006-e26a929e6fda None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:53:29.272833 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1c247-cc70-4b75-a006-e26a929e6fda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:29.274231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1c247-cc70-4b75-a006-e26a929e6fda None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:29.282228 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 582/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:53:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:29.288547 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565bd23-8813-4cef-84b4-a0fa7d076e0b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:29.387654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565bd23-8813-4cef-84b4-a0fa7d076e0b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:29.409404 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:29.420514 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40cf6d-7b36-4d06-94fd-022dcf7570da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:29.421121 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40cf6d-7b36-4d06-94fd-022dcf7570da None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:29.421392 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40cf6d-7b36-4d06-94fd-022dcf7570da None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:29.421654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40cf6d-7b36-4d06-94fd-022dcf7570da None admin] PATH_INFO: `/v3/users/37da5d9237a9439eabe9d8e4c6a177c7` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:29.422769 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40cf6d-7b36-4d06-94fd-022dcf7570da None admin] RBAC: Authorizing `identity:get_user(user_id=37da5d9237a9439eabe9d8e4c6a177c7)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:29.424175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40cf6d-7b36-4d06-94fd-022dcf7570da None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:29.425706 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 576/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:53:29 2022] GET /identity/v3/users/37da5d9237a9439eabe9d8e4c6a177c7 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:29.431608 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1c247-cc70-4b75-a006-e26a929e6fda None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:29.525555 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1c247-cc70-4b75-a006-e26a929e6fda None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:29.557465 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e578838-c290-4f69-9299-064e35435924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:29.558079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e578838-c290-4f69-9299-064e35435924 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:29.558356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e578838-c290-4f69-9299-064e35435924 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:29.559167 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e578838-c290-4f69-9299-064e35435924 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:29.590048 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:29.625084 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e578838-c290-4f69-9299-064e35435924 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:29.626563 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e578838-c290-4f69-9299-064e35435924 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:29.723907 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 583/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:53:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 00:53:29.729921 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40cf6d-7b36-4d06-94fd-022dcf7570da None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:29.826488 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40cf6d-7b36-4d06-94fd-022dcf7570da None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:29.858525 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e044ffb-6817-458d-bec6-c55c2391e6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:29.859125 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e044ffb-6817-458d-bec6-c55c2391e6e1 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:29.859397 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e044ffb-6817-458d-bec6-c55c2391e6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:29.859662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e044ffb-6817-458d-bec6-c55c2391e6e1 None admin] PATH_INFO: `/v3/projects/9a2f35850d204b1ba40a6c9d95b379ed` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:29.860739 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e044ffb-6817-458d-bec6-c55c2391e6e1 None admin] RBAC: Authorizing `identity:get_project(project_id=9a2f35850d204b1ba40a6c9d95b379ed)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:29.862172 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e044ffb-6817-458d-bec6-c55c2391e6e1 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:29.863737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 577/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:53:29 2022] GET /identity/v3/projects/9a2f35850d204b1ba40a6c9d95b379ed => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:29.869719 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e578838-c290-4f69-9299-064e35435924 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:29.931688 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:29.965663 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e578838-c290-4f69-9299-064e35435924 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:29.998760 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59648767-b83b-4673-a2a8-fecfc2f27097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:29.999353 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59648767-b83b-4673-a2a8-fecfc2f27097 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:29.999625 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59648767-b83b-4673-a2a8-fecfc2f27097 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:30.000436 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59648767-b83b-4673-a2a8-fecfc2f27097 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:30.000602 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59648767-b83b-4673-a2a8-fecfc2f27097 None admin] RBAC: Adding query filter params (role.id=0d7a36bda723430eae02f10f4c775c96, scope.project.id=9a2f35850d204b1ba40a6c9d95b379ed, user.id=37da5d9237a9439eabe9d8e4c6a177c7) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:53:30.000898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59648767-b83b-4673-a2a8-fecfc2f27097 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:30.002342 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59648767-b83b-4673-a2a8-fecfc2f27097 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:30.007918 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 584/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:53:29 2022] GET /identity/v3/role_assignments?user.id=37da5d9237a9439eabe9d8e4c6a177c7&scope.project.id=9a2f35850d204b1ba40a6c9d95b379ed&role.id=0d7a36bda723430eae02f10f4c775c96 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:32.131231 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19d262-cd06-49a2-a6d6-64feee538b0e None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:32.131748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19d262-cd06-49a2-a6d6-64feee538b0e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:32.131748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19d262-cd06-49a2-a6d6-64feee538b0e None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:32.133096 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 578/1162] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:53:32.138993 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4b998-de2c-4a33-9cd0-9bb5936df087 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:32.139392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4b998-de2c-4a33-9cd0-9bb5936df087 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:32.139538 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4b998-de2c-4a33-9cd0-9bb5936df087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:32.157275 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-88d4b998-de2c-4a33-9cd0-9bb5936df087 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:53:32.158485 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-88d4b998-de2c-4a33-9cd0-9bb5936df087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:53:32.221333 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 585/1163] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:53:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:53:32.487989 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19d262-cd06-49a2-a6d6-64feee538b0e None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:32.546009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:32.586019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19d262-cd06-49a2-a6d6-64feee538b0e None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:32.617763 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12005f8b-7520-410c-a39e-ec69a35fc912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:32.618373 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12005f8b-7520-410c-a39e-ec69a35fc912 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:32.618646 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12005f8b-7520-410c-a39e-ec69a35fc912 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:32.618909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12005f8b-7520-410c-a39e-ec69a35fc912 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:32.684212 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12005f8b-7520-410c-a39e-ec69a35fc912 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:32.685640 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12005f8b-7520-410c-a39e-ec69a35fc912 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:32.739838 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:32.779374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 579/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:53:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 00:53:32.785614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4b998-de2c-4a33-9cd0-9bb5936df087 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:32.841495 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:32.880572 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4b998-de2c-4a33-9cd0-9bb5936df087 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:32.912981 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6f8df-b0b1-4e37-be37-6d01e8e4c0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:32.913592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6f8df-b0b1-4e37-be37-6d01e8e4c0df None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:32.913895 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6f8df-b0b1-4e37-be37-6d01e8e4c0df None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:32.914168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6f8df-b0b1-4e37-be37-6d01e8e4c0df None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:32.920585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6f8df-b0b1-4e37-be37-6d01e8e4c0df None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:32.922064 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6f8df-b0b1-4e37-be37-6d01e8e4c0df None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:32.933032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-a8b6f8df-b0b1-4e37-be37-6d01e8e4c0df None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 14 00:53:32.933032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:53:32.933032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 14 00:53:32.933032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 14 00:53:32.933032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:53:32.933032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:53:32.933032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:53:32.933032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:53:32.933032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 14 00:53:32.933032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:53:32.933032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:53:32.933032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:53:32.933032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:53:32.933032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:53:32.933032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:53:32.933032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:53:32.933032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:53:32.934763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:53:32.934763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:53:32.934763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:53:32.934763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:53:32.934763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:53:32.934763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:53:32.934763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:53:32.934763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:53:32.934763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:53:32.934763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:53:32.934763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:53:32.934763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:53:32.934763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:53:32.934763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:53:32.934763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:53:32.934763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:53:32.935812 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:53:32.935812 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:53:32.935812 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:53:32.935812 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:53:32.935812 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:53:32.935812 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:53:32.935812 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:53:32.935812 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:53:32.935812 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:53:32.935812 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:53:32.935812 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 14 00:53:32.935812 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:53:32.935812 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 14 00:53:32.935812 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:53:32.935812 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 586/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Sep 14 00:53:32 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:53:32.940660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12005f8b-7520-410c-a39e-ec69a35fc912 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:33.037886 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12005f8b-7520-410c-a39e-ec69a35fc912 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:33.070259 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4c18e-4076-4bce-a325-f59a20ad8ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:33.070847 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4c18e-4076-4bce-a325-f59a20ad8ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:33.071123 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4c18e-4076-4bce-a325-f59a20ad8ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:33.071392 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4c18e-4076-4bce-a325-f59a20ad8ac7 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:33.072019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4c18e-4076-4bce-a325-f59a20ad8ac7 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:53:33.072315 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4c18e-4076-4bce-a325-f59a20ad8ac7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:33.073672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4c18e-4076-4bce-a325-f59a20ad8ac7 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:33.080766 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 580/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Sep 14 00:53:32 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:35.194293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc96e9-62a7-4763-9864-445220bcf25d None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:35.194836 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc96e9-62a7-4763-9864-445220bcf25d None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:35.194836 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc96e9-62a7-4763-9864-445220bcf25d None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:35.196168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 587/1167] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:53:35.202156 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55626dea-d5c3-4075-8702-66b2567fc283 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:35.202587 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55626dea-d5c3-4075-8702-66b2567fc283 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:35.202686 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55626dea-d5c3-4075-8702-66b2567fc283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:35.220306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-55626dea-d5c3-4075-8702-66b2567fc283 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:53:35.221474 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-55626dea-d5c3-4075-8702-66b2567fc283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:53:35.237886 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:35.286580 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 581/1168] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:53:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:53:35.554778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc96e9-62a7-4763-9864-445220bcf25d None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:35.652323 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc96e9-62a7-4763-9864-445220bcf25d None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:35.671985 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:35.686328 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ae566-fe99-45b0-9d1a-189921df1f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:35.686921 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ae566-fe99-45b0-9d1a-189921df1f3b None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:35.687201 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ae566-fe99-45b0-9d1a-189921df1f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:35.687471 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ae566-fe99-45b0-9d1a-189921df1f3b None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:35.688123 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ae566-fe99-45b0-9d1a-189921df1f3b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:35.689470 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ae566-fe99-45b0-9d1a-189921df1f3b None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:35.704709 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 588/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Wed Sep 14 00:53:35 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:53:37.858340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace194e-ddc5-451a-997b-4fdce25b5acf None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:37.858971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace194e-ddc5-451a-997b-4fdce25b5acf None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:37.858971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace194e-ddc5-451a-997b-4fdce25b5acf None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:37.860193 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 582/1170] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:53:37.865476 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c1c53-8eb9-48bf-b799-33ea0660d327 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:37.865927 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c1c53-8eb9-48bf-b799-33ea0660d327 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:37.866027 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c1c53-8eb9-48bf-b799-33ea0660d327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:37.884139 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-643c1c53-8eb9-48bf-b799-33ea0660d327 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:53:37.885313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-643c1c53-8eb9-48bf-b799-33ea0660d327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:53:37.949401 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 589/1171] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:53:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:53:38.219157 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace194e-ddc5-451a-997b-4fdce25b5acf None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:38.316884 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace194e-ddc5-451a-997b-4fdce25b5acf None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:38.348871 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727e52e-acac-4425-9348-898b9fa4ece0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:38.349475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727e52e-acac-4425-9348-898b9fa4ece0 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:38.349745 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727e52e-acac-4425-9348-898b9fa4ece0 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:38.350045 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727e52e-acac-4425-9348-898b9fa4ece0 None admin] PATH_INFO: `/v3/domains/dd6dea5f7b0a42f5b54601fb7d975152` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:38.360555 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9727e52e-acac-4425-9348-898b9fa4ece0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=dd6dea5f7b0a42f5b54601fb7d975152)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:38.362001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9727e52e-acac-4425-9348-898b9fa4ece0 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:38.363526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 583/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Wed Sep 14 00:53:38 2022] GET /identity/v3/domains/dd6dea5f7b0a42f5b54601fb7d975152 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:38.369459 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c1c53-8eb9-48bf-b799-33ea0660d327 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:38.466837 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c1c53-8eb9-48bf-b799-33ea0660d327 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:38.476909 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:38.501004 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904af6cd-a1b8-4e99-adbb-ffb6b5a04be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:38.501599 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904af6cd-a1b8-4e99-adbb-ffb6b5a04be6 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:38.501897 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904af6cd-a1b8-4e99-adbb-ffb6b5a04be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:38.502170 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904af6cd-a1b8-4e99-adbb-ffb6b5a04be6 None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:38.502803 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904af6cd-a1b8-4e99-adbb-ffb6b5a04be6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:38.504220 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904af6cd-a1b8-4e99-adbb-ffb6b5a04be6 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:38.530855 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 590/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Sep 14 00:53:38 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:53:40.656808 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a0a41-d2d6-451c-afc7-ea525d847347 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:40.657404 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a0a41-d2d6-451c-afc7-ea525d847347 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:40.657404 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a0a41-d2d6-451c-afc7-ea525d847347 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:40.658708 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 584/1174] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:53:40.663939 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293c502-877d-4e30-b433-dbc5c17bbaba None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:40.664366 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293c502-877d-4e30-b433-dbc5c17bbaba None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:40.664460 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293c502-877d-4e30-b433-dbc5c17bbaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:40.682571 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-7293c502-877d-4e30-b433-dbc5c17bbaba None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:53:40.684385 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7293c502-877d-4e30-b433-dbc5c17bbaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:53:40.746921 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 591/1175] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:53:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:53:41.012285 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a0a41-d2d6-451c-afc7-ea525d847347 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:41.028113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:41.112570 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a0a41-d2d6-451c-afc7-ea525d847347 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:41.144145 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed2a92-94e1-4a3f-93f5-23a3879721a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:41.144757 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed2a92-94e1-4a3f-93f5-23a3879721a2 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:41.145032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed2a92-94e1-4a3f-93f5-23a3879721a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:41.145299 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed2a92-94e1-4a3f-93f5-23a3879721a2 None admin] PATH_INFO: `/v3/domains/dd6dea5f7b0a42f5b54601fb7d975152` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:41.146399 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed2a92-94e1-4a3f-93f5-23a3879721a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=dd6dea5f7b0a42f5b54601fb7d975152)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:41.147824 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed2a92-94e1-4a3f-93f5-23a3879721a2 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:41.149352 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 585/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Wed Sep 14 00:53:41 2022] GET /identity/v3/domains/dd6dea5f7b0a42f5b54601fb7d975152 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:41.155765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293c502-877d-4e30-b433-dbc5c17bbaba None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:41.241661 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:41.251822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293c502-877d-4e30-b433-dbc5c17bbaba None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:41.290468 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6c1d8-e9bc-4df7-9ffb-a75ee7db05d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:41.291099 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6c1d8-e9bc-4df7-9ffb-a75ee7db05d5 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:41.291379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6c1d8-e9bc-4df7-9ffb-a75ee7db05d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:41.291651 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6c1d8-e9bc-4df7-9ffb-a75ee7db05d5 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:41.292307 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6c1d8-e9bc-4df7-9ffb-a75ee7db05d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:41.294423 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6c1d8-e9bc-4df7-9ffb-a75ee7db05d5 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:41.317103 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 592/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 14 00:53:41 2022] POST /identity/v3/users => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:53:43.471545 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da7dda-6db9-4105-b66c-8014f1b9d63b None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:43.472065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da7dda-6db9-4105-b66c-8014f1b9d63b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:43.472065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da7dda-6db9-4105-b66c-8014f1b9d63b None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:43.473331 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 586/1178] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:53:43.478577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7c962-e0ca-435f-8704-30aae3ff5bb3 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:43.478970 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7c962-e0ca-435f-8704-30aae3ff5bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:43.479113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7c962-e0ca-435f-8704-30aae3ff5bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:43.497109 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-54f7c962-e0ca-435f-8704-30aae3ff5bb3 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:53:43.498311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-54f7c962-e0ca-435f-8704-30aae3ff5bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:53:43.560841 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 593/1179] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:53:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:53:43.824693 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da7dda-6db9-4105-b66c-8014f1b9d63b None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:43.904588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:43.923431 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da7dda-6db9-4105-b66c-8014f1b9d63b None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:43.955567 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a03521-1a4c-492f-a5a3-e675ec1713e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:43.956178 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a03521-1a4c-492f-a5a3-e675ec1713e3 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:43.956456 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a03521-1a4c-492f-a5a3-e675ec1713e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:43.956721 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a03521-1a4c-492f-a5a3-e675ec1713e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:43.968170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a03521-1a4c-492f-a5a3-e675ec1713e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:53:43.972911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-99a03521-1a4c-492f-a5a3-e675ec1713e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:53:43.972911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:53:43.972911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:53:43.972911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:53:43.972911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:53:43.972911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:53:43.972911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:53:43.972911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:53:43.972911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:53:43.972911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:53:43.972911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:53:43.972911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:53:43.972911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:53:43.972911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:53:43.972911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:53:43.972911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:53:43.974130 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:53:43.974130 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:53:43.974130 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:53:43.974130 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:53:43.974130 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:53:43.974130 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:53:43.974130 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:53:43.974130 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:53:43.974130 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:53:43.974130 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:53:43.974130 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:53:43.974130 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:53:43.974130 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:53:43.974130 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:53:43.974130 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:53:43.974130 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:53:43.975255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:53:43.975255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:53:43.975255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:53:43.975255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:53:43.975255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:53:43.975255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:53:43.975255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:53:43.975255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:53:43.975255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:53:43.975255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:53:43.975255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:53:43.975255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:53:43.975255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 587/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:53:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:53:43.980138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7c962-e0ca-435f-8704-30aae3ff5bb3 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:44.054175 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:44.076298 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7c962-e0ca-435f-8704-30aae3ff5bb3 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:44.108834 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a6dc2-b40d-4a0d-b8d4-679724f5c0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:44.109427 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a6dc2-b40d-4a0d-b8d4-679724f5c0d8 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:44.109706 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a6dc2-b40d-4a0d-b8d4-679724f5c0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:44.110009 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a6dc2-b40d-4a0d-b8d4-679724f5c0d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:44.110657 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a6dc2-b40d-4a0d-b8d4-679724f5c0d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:53:44.110955 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a6dc2-b40d-4a0d-b8d4-679724f5c0d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:44.112307 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a6dc2-b40d-4a0d-b8d4-679724f5c0d8 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:44.119932 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 594/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:53:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:44.126010 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a03521-1a4c-492f-a5a3-e675ec1713e3 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:44.221936 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a03521-1a4c-492f-a5a3-e675ec1713e3 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:44.253892 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52659cde-d180-485a-8de0-54217562288b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:44.254501 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52659cde-d180-485a-8de0-54217562288b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:44.254778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52659cde-d180-485a-8de0-54217562288b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:44.255048 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52659cde-d180-485a-8de0-54217562288b None admin] PATH_INFO: `/v3/users/b13b6b0bfb3b485e8752ed0a344920af` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:44.265510 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:44.267762 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52659cde-d180-485a-8de0-54217562288b None admin] RBAC: Authorizing `identity:get_user(user_id=b13b6b0bfb3b485e8752ed0a344920af)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:44.269566 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52659cde-d180-485a-8de0-54217562288b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:44.271427 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 588/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:53:44 2022] GET /identity/v3/users/b13b6b0bfb3b485e8752ed0a344920af => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:44.277318 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a6dc2-b40d-4a0d-b8d4-679724f5c0d8 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:44.374076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a6dc2-b40d-4a0d-b8d4-679724f5c0d8 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:44.406141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60d047-6470-45b4-93d9-d22d1e249475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:44.406727 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60d047-6470-45b4-93d9-d22d1e249475 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:44.407005 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60d047-6470-45b4-93d9-d22d1e249475 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:44.407272 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60d047-6470-45b4-93d9-d22d1e249475 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:44.416897 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:44.472558 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60d047-6470-45b4-93d9-d22d1e249475 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:44.474013 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60d047-6470-45b4-93d9-d22d1e249475 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:44.567923 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 595/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:53:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 00:53:44.573819 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52659cde-d180-485a-8de0-54217562288b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:44.671046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52659cde-d180-485a-8de0-54217562288b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:44.705176 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6665de-abbd-4477-918a-c3279184816c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:44.705816 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6665de-abbd-4477-918a-c3279184816c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:44.706109 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6665de-abbd-4477-918a-c3279184816c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:44.706378 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6665de-abbd-4477-918a-c3279184816c None admin] PATH_INFO: `/v3/projects/71f8702ffc6a46a5af89008b4311ea8c` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:44.707483 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6665de-abbd-4477-918a-c3279184816c None admin] RBAC: Authorizing `identity:get_project(project_id=71f8702ffc6a46a5af89008b4311ea8c)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:44.708902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6665de-abbd-4477-918a-c3279184816c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:44.710522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 589/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:53:44 2022] GET /identity/v3/projects/71f8702ffc6a46a5af89008b4311ea8c => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:44.716656 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60d047-6470-45b4-93d9-d22d1e249475 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:44.758207 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:44.813134 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60d047-6470-45b4-93d9-d22d1e249475 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:44.845106 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0d077-8e2c-4d04-88ab-8cdd643dea3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:44.845698 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0d077-8e2c-4d04-88ab-8cdd643dea3a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:44.846003 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0d077-8e2c-4d04-88ab-8cdd643dea3a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:44.846270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0d077-8e2c-4d04-88ab-8cdd643dea3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:44.846971 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0d077-8e2c-4d04-88ab-8cdd643dea3a None admin] RBAC: Adding query filter params (role.id=0d7a36bda723430eae02f10f4c775c96, scope.project.id=71f8702ffc6a46a5af89008b4311ea8c, user.id=b13b6b0bfb3b485e8752ed0a344920af) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:53:44.847272 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0d077-8e2c-4d04-88ab-8cdd643dea3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:44.848668 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0d077-8e2c-4d04-88ab-8cdd643dea3a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:44.853811 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 596/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:53:44 2022] GET /identity/v3/role_assignments?user.id=b13b6b0bfb3b485e8752ed0a344920af&scope.project.id=71f8702ffc6a46a5af89008b4311ea8c&role.id=0d7a36bda723430eae02f10f4c775c96 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:46.958799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0c856-db70-4b1a-b402-0d0db2f855e7 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:46.959376 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0c856-db70-4b1a-b402-0d0db2f855e7 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:46.959376 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0c856-db70-4b1a-b402-0d0db2f855e7 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:46.960645 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 590/1186] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:53:46.965694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c886e-9dbc-48d8-a143-b5b2ad0132fa None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:46.966138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c886e-9dbc-48d8-a143-b5b2ad0132fa None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:46.966269 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c886e-9dbc-48d8-a143-b5b2ad0132fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:46.984204 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-245c886e-9dbc-48d8-a143-b5b2ad0132fa None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:53:46.985375 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-245c886e-9dbc-48d8-a143-b5b2ad0132fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:53:47.049007 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 597/1187] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:53:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:53:47.313470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0c856-db70-4b1a-b402-0d0db2f855e7 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:47.378369 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:47.414400 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0c856-db70-4b1a-b402-0d0db2f855e7 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:47.451960 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62da95c-8c8b-48b0-99e0-ea584592eef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:47.452566 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62da95c-8c8b-48b0-99e0-ea584592eef7 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:47.452839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62da95c-8c8b-48b0-99e0-ea584592eef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:47.453104 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62da95c-8c8b-48b0-99e0-ea584592eef7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:47.462878 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62da95c-8c8b-48b0-99e0-ea584592eef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:53:47.467690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-f62da95c-8c8b-48b0-99e0-ea584592eef7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:53:47.467690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:53:47.467690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:53:47.467690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:53:47.467690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:53:47.467690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:53:47.467690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:53:47.467690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:53:47.467690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:53:47.467690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:53:47.467690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:53:47.467690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:53:47.467690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:53:47.467690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:53:47.467690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:53:47.467690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:53:47.468778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:53:47.468778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:53:47.468778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:53:47.468778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:53:47.468778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:53:47.468778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:53:47.468778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:53:47.468778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:53:47.468778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:53:47.468778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:53:47.468778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:53:47.468778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:53:47.468778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:53:47.468778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:53:47.468778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:53:47.468778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:53:47.469917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:53:47.469917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:53:47.469917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:53:47.469917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:53:47.469917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:53:47.469917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:53:47.469917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:53:47.469917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:53:47.469917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:53:47.469917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:53:47.469917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:53:47.469917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:53:47.469917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 591/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:53:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:53:47.474813 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c886e-9dbc-48d8-a143-b5b2ad0132fa None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:47.507595 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:47.571288 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c886e-9dbc-48d8-a143-b5b2ad0132fa None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:47.602578 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804568b-1f02-4a65-acc3-8b3c0668b425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:47.603161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804568b-1f02-4a65-acc3-8b3c0668b425 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:47.603434 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804568b-1f02-4a65-acc3-8b3c0668b425 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:47.603698 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804568b-1f02-4a65-acc3-8b3c0668b425 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:47.604336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804568b-1f02-4a65-acc3-8b3c0668b425 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:53:47.604631 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804568b-1f02-4a65-acc3-8b3c0668b425 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:47.606513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804568b-1f02-4a65-acc3-8b3c0668b425 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:47.614227 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 598/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:53:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:47.619889 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62da95c-8c8b-48b0-99e0-ea584592eef7 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:47.723390 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62da95c-8c8b-48b0-99e0-ea584592eef7 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:47.751175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:47.759267 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af61c1b-69c5-4073-bacf-561500a6a99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:47.759885 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af61c1b-69c5-4073-bacf-561500a6a99f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:47.760163 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af61c1b-69c5-4073-bacf-561500a6a99f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:47.760432 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af61c1b-69c5-4073-bacf-561500a6a99f None admin] PATH_INFO: `/v3/users/b13b6b0bfb3b485e8752ed0a344920af` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:47.761628 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af61c1b-69c5-4073-bacf-561500a6a99f None admin] RBAC: Authorizing `identity:get_user(user_id=b13b6b0bfb3b485e8752ed0a344920af)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:47.763076 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af61c1b-69c5-4073-bacf-561500a6a99f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:47.764637 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 592/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:53:47 2022] GET /identity/v3/users/b13b6b0bfb3b485e8752ed0a344920af => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:47.770434 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804568b-1f02-4a65-acc3-8b3c0668b425 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:47.860777 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:47.866491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804568b-1f02-4a65-acc3-8b3c0668b425 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:47.898874 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4dcc1-ef6e-4672-bce3-f713a55fe54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:47.899497 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4dcc1-ef6e-4672-bce3-f713a55fe54f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:47.899774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4dcc1-ef6e-4672-bce3-f713a55fe54f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:47.900039 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4dcc1-ef6e-4672-bce3-f713a55fe54f None admin] PATH_INFO: `/v3/projects/71f8702ffc6a46a5af89008b4311ea8c` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:47.901153 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4dcc1-ef6e-4672-bce3-f713a55fe54f None admin] RBAC: Authorizing `identity:get_project(project_id=71f8702ffc6a46a5af89008b4311ea8c)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:47.903084 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4dcc1-ef6e-4672-bce3-f713a55fe54f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:47.904678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 599/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:53:47 2022] GET /identity/v3/projects/71f8702ffc6a46a5af89008b4311ea8c => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:47.910721 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af61c1b-69c5-4073-bacf-561500a6a99f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:48.006866 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af61c1b-69c5-4073-bacf-561500a6a99f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:48.048309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881346ec-e31f-4e7d-911e-d34e7a94893f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:48.048963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881346ec-e31f-4e7d-911e-d34e7a94893f None admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:48.049241 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881346ec-e31f-4e7d-911e-d34e7a94893f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:48.049513 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881346ec-e31f-4e7d-911e-d34e7a94893f None admin] PATH_INFO: `/v3/projects/71f8702ffc6a46a5af89008b4311ea8c/users/b13b6b0bfb3b485e8752ed0a344920af/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:48.051449 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881346ec-e31f-4e7d-911e-d34e7a94893f None admin] RBAC: Authorizing `identity:create_grant(project_id=71f8702ffc6a46a5af89008b4311ea8c, user_id=b13b6b0bfb3b485e8752ed0a344920af, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:48.052877 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881346ec-e31f-4e7d-911e-d34e7a94893f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:48.066015 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 593/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 14 00:53:47 2022] PUT /identity/v3/projects/71f8702ffc6a46a5af89008b4311ea8c/users/b13b6b0bfb3b485e8752ed0a344920af/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 00:53:50.168237 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452eb07c-360b-4c32-ab30-fb67b263c542 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:50.168790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452eb07c-360b-4c32-ab30-fb67b263c542 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:50.168790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452eb07c-360b-4c32-ab30-fb67b263c542 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:50.170134 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 600/1193] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:53:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:53:50.175445 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dcb17-09b5-4154-8158-435e1d1e7a4b None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:50.175838 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dcb17-09b5-4154-8158-435e1d1e7a4b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:50.175991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dcb17-09b5-4154-8158-435e1d1e7a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:50.193649 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-228dcb17-09b5-4154-8158-435e1d1e7a4b None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:53:50.194865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-228dcb17-09b5-4154-8158-435e1d1e7a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:53:50.243630 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:50.260826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 594/1194] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:53:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:53:50.536781 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452eb07c-360b-4c32-ab30-fb67b263c542 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:50.636089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452eb07c-360b-4c32-ab30-fb67b263c542 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:50.668745 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3d4a8-a740-4252-9d9b-32f94feed146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:50.669356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3d4a8-a740-4252-9d9b-32f94feed146 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:50.669635 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3d4a8-a740-4252-9d9b-32f94feed146 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:50.669935 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3d4a8-a740-4252-9d9b-32f94feed146 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:50.679532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e3d4a8-a740-4252-9d9b-32f94feed146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:53:50.684935 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-e2e3d4a8-a740-4252-9d9b-32f94feed146 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:53:50.684935 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:53:50.684935 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:53:50.684935 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:53:50.684935 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:53:50.684935 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:53:50.684935 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:53:50.684935 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:53:50.684935 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:53:50.684935 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:53:50.684935 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:53:50.684935 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:53:50.684935 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:53:50.684935 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:53:50.684935 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:53:50.684935 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:53:50.686066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:53:50.686066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:53:50.686066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:53:50.686066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:53:50.686066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:53:50.686066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:53:50.686066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:53:50.686066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:53:50.686066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:53:50.686066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:53:50.686066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:53:50.686066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:53:50.686066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:53:50.686066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:53:50.686066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:53:50.686066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:53:50.686915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:53:50.686915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:53:50.686915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:53:50.686915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:53:50.686915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:53:50.686915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:53:50.686915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:53:50.686915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:53:50.686915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:53:50.686915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:53:50.686915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:53:50.686915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:53:50.686915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 601/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:53:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:53:50.693195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dcb17-09b5-4154-8158-435e1d1e7a4b None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:50.788509 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dcb17-09b5-4154-8158-435e1d1e7a4b None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:50.821600 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267749c5-a1a5-42db-a027-aeff68465f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:50.822216 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267749c5-a1a5-42db-a027-aeff68465f69 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:50.822500 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267749c5-a1a5-42db-a027-aeff68465f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:50.822768 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267749c5-a1a5-42db-a027-aeff68465f69 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:50.823421 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267749c5-a1a5-42db-a027-aeff68465f69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:53:50.823746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267749c5-a1a5-42db-a027-aeff68465f69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:50.825096 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267749c5-a1a5-42db-a027-aeff68465f69 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:50.832782 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 595/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:53:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:50.838544 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3d4a8-a740-4252-9d9b-32f94feed146 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:50.863866 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:50.935578 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3d4a8-a740-4252-9d9b-32f94feed146 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:50.967708 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f50c6-2ea4-4289-b142-906842b21d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:50.968313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f50c6-2ea4-4289-b142-906842b21d36 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:50.968589 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f50c6-2ea4-4289-b142-906842b21d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:50.968855 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f50c6-2ea4-4289-b142-906842b21d36 None admin] PATH_INFO: `/v3/users/b13b6b0bfb3b485e8752ed0a344920af` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:50.969965 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f50c6-2ea4-4289-b142-906842b21d36 None admin] RBAC: Authorizing `identity:get_user(user_id=b13b6b0bfb3b485e8752ed0a344920af)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:50.971361 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f50c6-2ea4-4289-b142-906842b21d36 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:50.972893 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 602/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 14 00:53:50 2022] GET /identity/v3/users/b13b6b0bfb3b485e8752ed0a344920af => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:50.978625 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267749c5-a1a5-42db-a027-aeff68465f69 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:51.028280 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:51.077203 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267749c5-a1a5-42db-a027-aeff68465f69 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:51.108221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb1d4f-a143-4762-8b94-8e251f5e7b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:51.108801 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb1d4f-a143-4762-8b94-8e251f5e7b75 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:51.109072 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb1d4f-a143-4762-8b94-8e251f5e7b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:51.109336 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb1d4f-a143-4762-8b94-8e251f5e7b75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:51.173174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb1d4f-a143-4762-8b94-8e251f5e7b75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:51.174605 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb1d4f-a143-4762-8b94-8e251f5e7b75 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:51.219799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:51.268156 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 596/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:53:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 00:53:51.274057 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f50c6-2ea4-4289-b142-906842b21d36 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:51.360395 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:53:51.369006 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f50c6-2ea4-4289-b142-906842b21d36 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:51.400686 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb8c66-4d42-4b35-93e8-5468d20e8f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:51.401286 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb8c66-4d42-4b35-93e8-5468d20e8f17 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:51.401578 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb8c66-4d42-4b35-93e8-5468d20e8f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:51.402417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb8c66-4d42-4b35-93e8-5468d20e8f17 None admin] PATH_INFO: `/v3/projects/71f8702ffc6a46a5af89008b4311ea8c` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:51.403498 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb8c66-4d42-4b35-93e8-5468d20e8f17 None admin] RBAC: Authorizing `identity:get_project(project_id=71f8702ffc6a46a5af89008b4311ea8c)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:51.404897 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb8c66-4d42-4b35-93e8-5468d20e8f17 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:51.406818 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 603/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 14 00:53:51 2022] GET /identity/v3/projects/71f8702ffc6a46a5af89008b4311ea8c => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:53:51.412688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb1d4f-a143-4762-8b94-8e251f5e7b75 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:53:51.505917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb1d4f-a143-4762-8b94-8e251f5e7b75 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:53:51.539179 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3afe09-208e-4066-a094-d281d3fce0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:53:51.539756 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3afe09-208e-4066-a094-d281d3fce0a9 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:53:51.540026 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3afe09-208e-4066-a094-d281d3fce0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:53:51.540288 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3afe09-208e-4066-a094-d281d3fce0a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:53:51.540986 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3afe09-208e-4066-a094-d281d3fce0a9 None admin] RBAC: Adding query filter params (role.id=0d7a36bda723430eae02f10f4c775c96, scope.project.id=71f8702ffc6a46a5af89008b4311ea8c, user.id=b13b6b0bfb3b485e8752ed0a344920af) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:53:51.541282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3afe09-208e-4066-a094-d281d3fce0a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:53:51.542738 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3afe09-208e-4066-a094-d281d3fce0a9 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:53:51.548216 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 597/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:53:51 2022] GET /identity/v3/role_assignments?user.id=b13b6b0bfb3b485e8752ed0a344920af&scope.project.id=71f8702ffc6a46a5af89008b4311ea8c&role.id=0d7a36bda723430eae02f10f4c775c96 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:54:01.396809 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=20 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:54:01.545750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=94 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:54:47.177461 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa066a9-944a-405f-9721-defeae50bd91 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:47.177461 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa066a9-944a-405f-9721-defeae50bd91 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:47.177461 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa066a9-944a-405f-9721-defeae50bd91 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:47.178609 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 604/1201] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:54:47.185531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1424a15-d846-46b7-adb9-48315b01b1a9 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:47.186066 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1424a15-d846-46b7-adb9-48315b01b1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:47.186166 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1424a15-d846-46b7-adb9-48315b01b1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:47.210820 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-f1424a15-d846-46b7-adb9-48315b01b1a9 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:54:47.212340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f1424a15-d846-46b7-adb9-48315b01b1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:54:47.310194 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 598/1202] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:54:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:54:47.633426 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa066a9-944a-405f-9721-defeae50bd91 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:54:47.772976 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa066a9-944a-405f-9721-defeae50bd91 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:54:47.817914 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95d09e-e491-4221-8190-31fec758e0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:54:47.818545 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95d09e-e491-4221-8190-31fec758e0d9 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:47.818820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95d09e-e491-4221-8190-31fec758e0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:47.819088 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95d09e-e491-4221-8190-31fec758e0d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:47.836081 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95d09e-e491-4221-8190-31fec758e0d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:54:47.838080 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95d09e-e491-4221-8190-31fec758e0d9 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:54:47.857629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-0a95d09e-e491-4221-8190-31fec758e0d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:54:47.857629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:54:47.857629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:54:47.857629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:54:47.857629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:54:47.857629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:54:47.857629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:54:47.857629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:54:47.857629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:54:47.857629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:54:47.857629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:54:47.857629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:54:47.857629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:54:47.857629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:54:47.857629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:54:47.857629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:54:47.858973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:54:47.858973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:54:47.858973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:54:47.858973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:54:47.858973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:54:47.858973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:54:47.858973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:54:47.858973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:54:47.858973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:54:47.858973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:54:47.858973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:54:47.858973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:54:47.858973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:54:47.858973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:54:47.858973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:54:47.858973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:54:47.858973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:54:47.860024 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:54:47.860024 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:54:47.860024 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:54:47.860024 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 605/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:54:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:54:47.865258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1424a15-d846-46b7-adb9-48315b01b1a9 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:54:48.005645 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1424a15-d846-46b7-adb9-48315b01b1a9 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:54:48.047494 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:54:48.059171 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23477578-5d13-465d-a6a1-cf6743f80807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:54:48.059899 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23477578-5d13-465d-a6a1-cf6743f80807 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:48.060273 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23477578-5d13-465d-a6a1-cf6743f80807 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:48.060655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23477578-5d13-465d-a6a1-cf6743f80807 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:48.061423 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23477578-5d13-465d-a6a1-cf6743f80807 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:54:48.061778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23477578-5d13-465d-a6a1-cf6743f80807 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:54:48.063624 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23477578-5d13-465d-a6a1-cf6743f80807 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:54:48.079480 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 599/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:54:48.085849 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95d09e-e491-4221-8190-31fec758e0d9 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:54:48.164617 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:54:48.224934 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95d09e-e491-4221-8190-31fec758e0d9 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:54:48.262737 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a02d8-d8da-480d-8c48-ca0ad2606417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:54:48.262737 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a02d8-d8da-480d-8c48-ca0ad2606417 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:48.263023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a02d8-d8da-480d-8c48-ca0ad2606417 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:48.263197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a02d8-d8da-480d-8c48-ca0ad2606417 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:48.263840 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a02d8-d8da-480d-8c48-ca0ad2606417 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:54:48.265294 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a02d8-d8da-480d-8c48-ca0ad2606417 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:54:48.294336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 606/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 14 00:54:48 2022] POST /identity/v3/users => generated 251 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:54:50.914587 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec62bbe-937f-4bdc-bd94-430afac1c9a1 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:50.915234 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec62bbe-937f-4bdc-bd94-430afac1c9a1 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:50.915234 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec62bbe-937f-4bdc-bd94-430afac1c9a1 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:50.916794 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 600/1206] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:54:50.922901 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bda4a-a7a1-4050-98e7-52d47f2501d4 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:50.923434 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bda4a-a7a1-4050-98e7-52d47f2501d4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:50.923621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bda4a-a7a1-4050-98e7-52d47f2501d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:50.942962 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-7e3bda4a-a7a1-4050-98e7-52d47f2501d4 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:54:50.944196 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7e3bda4a-a7a1-4050-98e7-52d47f2501d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:54:51.021841 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 607/1207] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:54:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 00:54:51.322025 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec62bbe-937f-4bdc-bd94-430afac1c9a1 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:54:51.436971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec62bbe-937f-4bdc-bd94-430afac1c9a1 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:54:51.479412 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a144b9-d671-4f1f-9545-e078a1ae325a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:54:51.480054 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a144b9-d671-4f1f-9545-e078a1ae325a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:51.480329 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a144b9-d671-4f1f-9545-e078a1ae325a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:51.480596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a144b9-d671-4f1f-9545-e078a1ae325a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:51.493385 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a144b9-d671-4f1f-9545-e078a1ae325a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:54:51.498262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-57a144b9-d671-4f1f-9545-e078a1ae325a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:54:51.498262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:54:51.498262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:54:51.498262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:54:51.498262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:54:51.498262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:54:51.498262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:54:51.498262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:54:51.498262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:54:51.498262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:54:51.498262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:54:51.498262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:54:51.498262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:54:51.498262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:54:51.498262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:54:51.498262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:54:51.499247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:54:51.499247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:54:51.499247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:54:51.499247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:54:51.499247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:54:51.499247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:54:51.499247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:54:51.499247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:54:51.499247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:54:51.499247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:54:51.499247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:54:51.499247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:54:51.499247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:54:51.499247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:54:51.499247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:54:51.499247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:54:51.500119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:54:51.500119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:54:51.500119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:54:51.500119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:54:51.500119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:54:51.500119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:54:51.500119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:54:51.500119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:54:51.500119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:54:51.500119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:54:51.500119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:54:51.500119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:54:51.500119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 601/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 14 00:54:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:54:51.508071 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bda4a-a7a1-4050-98e7-52d47f2501d4 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:54:51.556280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:54:51.637675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bda4a-a7a1-4050-98e7-52d47f2501d4 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:54:51.681768 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26afb9-cfe7-4469-bfd2-c0ba7df5a49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:54:51.682404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26afb9-cfe7-4469-bfd2-c0ba7df5a49b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:51.682679 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26afb9-cfe7-4469-bfd2-c0ba7df5a49b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:51.682946 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26afb9-cfe7-4469-bfd2-c0ba7df5a49b None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:51.683604 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26afb9-cfe7-4469-bfd2-c0ba7df5a49b None admin] RBAC: Adding query filter params (name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:54:51.683906 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26afb9-cfe7-4469-bfd2-c0ba7df5a49b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:54:51.685271 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26afb9-cfe7-4469-bfd2-c0ba7df5a49b None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:54:51.695077 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 608/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 14 00:54:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:54:51.701446 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a144b9-d671-4f1f-9545-e078a1ae325a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:54:51.779601 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:54:51.846325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a144b9-d671-4f1f-9545-e078a1ae325a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:54:51.883340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d329e-28fb-4d47-b101-66aad7d7d68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:54:51.883973 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d329e-28fb-4d47-b101-66aad7d7d68d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:51.884812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d329e-28fb-4d47-b101-66aad7d7d68d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:51.884812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d329e-28fb-4d47-b101-66aad7d7d68d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:51.895447 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d329e-28fb-4d47-b101-66aad7d7d68d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:54:51.896807 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d329e-28fb-4d47-b101-66aad7d7d68d None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:54:51.912639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-479d329e-28fb-4d47-b101-66aad7d7d68d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:54:51.912639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:54:51.912639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:54:51.912639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:54:51.912639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:54:51.912639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:54:51.912639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:54:51.912639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:54:51.912639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:54:51.912639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:54:51.912639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:54:51.912639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:54:51.912639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:54:51.912639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:54:51.912639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:54:51.912639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:54:51.913981 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:54:51.913981 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:54:51.913981 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:54:51.913981 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:54:51.913981 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:54:51.913981 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:54:51.913981 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:54:51.913981 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:54:51.913981 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:54:51.913981 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:54:51.913981 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:54:51.913981 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:54:51.913981 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:54:51.913981 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:54:51.913981 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:54:51.913981 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:54:51.913981 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:54:51.915575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:54:51.915575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:54:51.915575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:54:51.915575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 602/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:54:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:54:51.920234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26afb9-cfe7-4469-bfd2-c0ba7df5a49b None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:54:52.044099 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:54:52.047659 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26afb9-cfe7-4469-bfd2-c0ba7df5a49b None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:54:52.104352 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25625313-104b-4529-8323-4ac1c8bb589a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:54:52.104965 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25625313-104b-4529-8323-4ac1c8bb589a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:52.105241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25625313-104b-4529-8323-4ac1c8bb589a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:52.105512 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25625313-104b-4529-8323-4ac1c8bb589a None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:52.106214 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25625313-104b-4529-8323-4ac1c8bb589a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:54:52.106543 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25625313-104b-4529-8323-4ac1c8bb589a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:54:52.108318 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25625313-104b-4529-8323-4ac1c8bb589a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:54:52.128731 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 609/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:54:52.130393 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d329e-28fb-4d47-b101-66aad7d7d68d None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:54:52.259677 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d329e-28fb-4d47-b101-66aad7d7d68d None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:54:52.261359 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:54:52.296327 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e5a2c-b7a7-4cdc-9aab-51861864ddef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:54:52.297277 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e5a2c-b7a7-4cdc-9aab-51861864ddef None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:52.297775 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e5a2c-b7a7-4cdc-9aab-51861864ddef None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:52.298297 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e5a2c-b7a7-4cdc-9aab-51861864ddef None admin] PATH_INFO: `/v3/users/placement` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:52.307205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e5a2c-b7a7-4cdc-9aab-51861864ddef None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:54:52.309107 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e5a2c-b7a7-4cdc-9aab-51861864ddef None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:54:52.323186 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-480e5a2c-b7a7-4cdc-9aab-51861864ddef None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 00:54:52.323186 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:54:52.323186 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:54:52.323186 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:54:52.323186 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:54:52.323186 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:54:52.323186 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:54:52.323186 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:54:52.323186 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:54:52.323186 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:54:52.323186 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:54:52.323186 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:54:52.323186 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:54:52.323186 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:54:52.323186 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:54:52.323186 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:54:52.324309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:54:52.324309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:54:52.324309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:54:52.324309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:54:52.324309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:54:52.324309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:54:52.324309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:54:52.324309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:54:52.324309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:54:52.324309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:54:52.324309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:54:52.324309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:54:52.324309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:54:52.324309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:54:52.324309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:54:52.324309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:54:52.324309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:54:52.324309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:54:52.325312 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:54:52.325312 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:54:52.325312 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:54:52.325312 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:54:52.325312 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:54:52.325312 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:54:52.325312 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:54:52.325312 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:54:52.325312 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 00:54:52.325312 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:54:52.327804 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 603/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:54:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:54:52.334138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25625313-104b-4529-8323-4ac1c8bb589a None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:54:52.448258 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25625313-104b-4529-8323-4ac1c8bb589a None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:54:52.494544 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1925f-4224-4a14-8713-5d0855c476fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:54:52.495217 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1925f-4224-4a14-8713-5d0855c476fb None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:52.495480 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1925f-4224-4a14-8713-5d0855c476fb None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:52.495767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1925f-4224-4a14-8713-5d0855c476fb None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:52.496573 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1925f-4224-4a14-8713-5d0855c476fb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:54:52.496810 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1925f-4224-4a14-8713-5d0855c476fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:54:52.498267 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1925f-4224-4a14-8713-5d0855c476fb None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:54:52.522029 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 610/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Sep 14 00:54:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:54:52.523628 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e5a2c-b7a7-4cdc-9aab-51861864ddef None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:54:52.639041 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e5a2c-b7a7-4cdc-9aab-51861864ddef None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:54:52.680063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc752578-f841-4d9c-aa10-61204a8ad764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:54:52.680793 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc752578-f841-4d9c-aa10-61204a8ad764 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:52.681261 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc752578-f841-4d9c-aa10-61204a8ad764 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:52.681607 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc752578-f841-4d9c-aa10-61204a8ad764 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:52.715822 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:54:52.771537 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc752578-f841-4d9c-aa10-61204a8ad764 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:54:52.773297 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc752578-f841-4d9c-aa10-61204a8ad764 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:54:52.904959 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 604/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:54:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 00:54:52.906910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1925f-4224-4a14-8713-5d0855c476fb None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:54:52.931630 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:54:53.032483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1925f-4224-4a14-8713-5d0855c476fb None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:54:53.074264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b7985-9758-48d5-b84c-efeeea3d0bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:54:53.074978 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b7985-9758-48d5-b84c-efeeea3d0bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:53.075148 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b7985-9758-48d5-b84c-efeeea3d0bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:53.075410 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b7985-9758-48d5-b84c-efeeea3d0bf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:53.086393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b7985-9758-48d5-b84c-efeeea3d0bf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:54:53.089230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b7985-9758-48d5-b84c-efeeea3d0bf2 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:54:53.107926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-840b7985-9758-48d5-b84c-efeeea3d0bf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:54:53.107926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:54:53.107926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:54:53.107926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:54:53.107926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:54:53.107926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:54:53.107926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:54:53.107926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:54:53.107926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:54:53.107926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:54:53.107926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:54:53.107926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:54:53.107926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:54:53.107926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:54:53.107926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:54:53.107926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:54:53.109132 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:54:53.109132 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:54:53.109132 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:54:53.109132 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:54:53.109132 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:54:53.109132 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:54:53.109132 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:54:53.109132 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:54:53.109132 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:54:53.109132 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:54:53.109132 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:54:53.109132 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:54:53.109132 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:54:53.109132 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:54:53.109132 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:54:53.109132 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:54:53.109132 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:54:53.110312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:54:53.110312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:54:53.110312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:54:53.110312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 611/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:54:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:54:53.115791 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc752578-f841-4d9c-aa10-61204a8ad764 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:54:53.187305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:54:53.236471 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc752578-f841-4d9c-aa10-61204a8ad764 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:54:53.278997 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e270fd2-5538-43a8-b27d-0a4b271cca51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:54:53.279868 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e270fd2-5538-43a8-b27d-0a4b271cca51 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:53.280339 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e270fd2-5538-43a8-b27d-0a4b271cca51 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:53.281072 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e270fd2-5538-43a8-b27d-0a4b271cca51 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:53.282012 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e270fd2-5538-43a8-b27d-0a4b271cca51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:54:53.282615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e270fd2-5538-43a8-b27d-0a4b271cca51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:54:53.284205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e270fd2-5538-43a8-b27d-0a4b271cca51 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:54:53.297859 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 605/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:54:53.301971 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b7985-9758-48d5-b84c-efeeea3d0bf2 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:54:53.389966 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:54:53.434867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b7985-9758-48d5-b84c-efeeea3d0bf2 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:54:53.481736 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043aa75-2704-4516-b244-33cd811070e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:54:53.482485 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043aa75-2704-4516-b244-33cd811070e7 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:53.482783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043aa75-2704-4516-b244-33cd811070e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:53.483125 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043aa75-2704-4516-b244-33cd811070e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:53.490102 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043aa75-2704-4516-b244-33cd811070e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:54:53.491538 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043aa75-2704-4516-b244-33cd811070e7 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:54:53.504145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-8043aa75-2704-4516-b244-33cd811070e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:54:53.504145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:54:53.504145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:54:53.504145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:54:53.504145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:54:53.504145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:54:53.504145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:54:53.504145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:54:53.504145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:54:53.504145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:54:53.504145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:54:53.504145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:54:53.504145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:54:53.504145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:54:53.504145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:54:53.505412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:54:53.505412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:54:53.505412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:54:53.505412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:54:53.505412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:54:53.505412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:54:53.505412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:54:53.505412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:54:53.505412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:54:53.505412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:54:53.505412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:54:53.505412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:54:53.505412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:54:53.505412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:54:53.505412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:54:53.505412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:54:53.505412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:54:53.506512 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:54:53.506512 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:54:53.506512 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:54:53.506512 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:54:53.506512 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:54:53.506512 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:54:53.506512 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:54:53.506512 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:54:53.506512 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 612/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:54:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:54:53.512042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e270fd2-5538-43a8-b27d-0a4b271cca51 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:54:53.623093 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e270fd2-5538-43a8-b27d-0a4b271cca51 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:54:53.647382 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:54:53.661223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3959824-360e-459b-9939-2a6afcafcebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:54:53.661932 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3959824-360e-459b-9939-2a6afcafcebf None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:53.662209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3959824-360e-459b-9939-2a6afcafcebf None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:53.662480 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3959824-360e-459b-9939-2a6afcafcebf None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:53.663224 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3959824-360e-459b-9939-2a6afcafcebf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:54:53.663517 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3959824-360e-459b-9939-2a6afcafcebf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:54:53.665035 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3959824-360e-459b-9939-2a6afcafcebf None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:54:53.677849 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 606/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:54:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:54:53.684432 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043aa75-2704-4516-b244-33cd811070e7 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:54:53.799912 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043aa75-2704-4516-b244-33cd811070e7 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:54:53.831489 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:54:53.838250 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a200084-7c27-40b0-818c-ef8f251f3f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:54:53.838849 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a200084-7c27-40b0-818c-ef8f251f3f29 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:53.839125 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a200084-7c27-40b0-818c-ef8f251f3f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:53.839394 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a200084-7c27-40b0-818c-ef8f251f3f29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:53.840098 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a200084-7c27-40b0-818c-ef8f251f3f29 None admin] RBAC: Adding query filter params (role.id=b9c910c1c68948858203c62521b73efc, scope.project.id=f37c835c05924364bcd1530d44f024fe, user.id=abf9ab5fafe94afdb3ebe98536b5cc3a) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:54:53.840401 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a200084-7c27-40b0-818c-ef8f251f3f29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:54:53.841816 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a200084-7c27-40b0-818c-ef8f251f3f29 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:54:53.847220 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 613/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:54:53 2022] GET /identity/v3/role_assignments?user.id=abf9ab5fafe94afdb3ebe98536b5cc3a&scope.project.id=f37c835c05924364bcd1530d44f024fe&role.id=b9c910c1c68948858203c62521b73efc => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:54:56.066944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78456cb-aeb1-428a-bd30-d5fd3b2579dd None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:56.067549 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78456cb-aeb1-428a-bd30-d5fd3b2579dd None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:56.067660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78456cb-aeb1-428a-bd30-d5fd3b2579dd None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:56.069016 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 607/1220] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:54:56.074518 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3522817-c1ef-48de-9bf3-93accdb61411 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:56.074992 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3522817-c1ef-48de-9bf3-93accdb61411 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:56.075263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3522817-c1ef-48de-9bf3-93accdb61411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:56.096134 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-a3522817-c1ef-48de-9bf3-93accdb61411 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:54:56.097327 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a3522817-c1ef-48de-9bf3-93accdb61411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:54:56.174065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 614/1221] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:54:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:54:56.455510 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78456cb-aeb1-428a-bd30-d5fd3b2579dd None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:54:56.562437 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78456cb-aeb1-428a-bd30-d5fd3b2579dd None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:54:56.599457 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9aa9f-6d16-4305-9173-9142669ff40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:54:56.600107 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9aa9f-6d16-4305-9173-9142669ff40b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:56.600353 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9aa9f-6d16-4305-9173-9142669ff40b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:56.600660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9aa9f-6d16-4305-9173-9142669ff40b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:56.611794 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9aa9f-6d16-4305-9173-9142669ff40b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:54:56.616840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-7ea9aa9f-6d16-4305-9173-9142669ff40b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:54:56.616840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:54:56.616840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:54:56.616840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:54:56.616840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:54:56.616840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:54:56.616840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:54:56.616840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:54:56.616840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:54:56.616840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:54:56.616840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:54:56.616840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:54:56.616840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:54:56.616840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:54:56.616840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:54:56.616840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:54:56.618383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:54:56.618383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:54:56.618383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:54:56.618383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:54:56.618383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:54:56.618383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:54:56.618383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:54:56.618383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:54:56.618383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:54:56.618383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:54:56.618383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:54:56.618383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:54:56.618383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:54:56.618383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:54:56.618383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:54:56.618383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:54:56.619837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:54:56.619837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:54:56.619837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:54:56.619837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:54:56.619837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:54:56.619837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:54:56.619837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:54:56.619837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:54:56.619837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:54:56.619837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:54:56.619837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:54:56.619837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:54:56.619837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 608/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 14 00:54:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:54:56.624716 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3522817-c1ef-48de-9bf3-93accdb61411 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:54:56.738410 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3522817-c1ef-48de-9bf3-93accdb61411 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:54:56.765007 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:54:56.776647 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efc43e-6cbd-4907-bd55-26b1781285a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:54:56.777268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efc43e-6cbd-4907-bd55-26b1781285a6 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:56.777544 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efc43e-6cbd-4907-bd55-26b1781285a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:56.777835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efc43e-6cbd-4907-bd55-26b1781285a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:56.778487 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29efc43e-6cbd-4907-bd55-26b1781285a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:54:56.778792 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29efc43e-6cbd-4907-bd55-26b1781285a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:54:56.780241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29efc43e-6cbd-4907-bd55-26b1781285a6 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:54:56.788469 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 615/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 14 00:54:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:54:56.794356 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9aa9f-6d16-4305-9173-9142669ff40b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:54:56.845166 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:54:56.911572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9aa9f-6d16-4305-9173-9142669ff40b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:54:56.950184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30baf139-5fee-42f6-9a9e-2a93a4a5a2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:54:56.950830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baf139-5fee-42f6-9a9e-2a93a4a5a2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:56.951094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baf139-5fee-42f6-9a9e-2a93a4a5a2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:56.951364 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baf139-5fee-42f6-9a9e-2a93a4a5a2b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:56.963334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30baf139-5fee-42f6-9a9e-2a93a4a5a2b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:54:56.964718 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30baf139-5fee-42f6-9a9e-2a93a4a5a2b6 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:54:56.979901 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-30baf139-5fee-42f6-9a9e-2a93a4a5a2b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:54:56.979901 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:54:56.979901 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:54:56.979901 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:54:56.979901 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:54:56.979901 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:54:56.979901 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:54:56.979901 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:54:56.979901 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:54:56.979901 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:54:56.979901 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:54:56.979901 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:54:56.979901 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:54:56.979901 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:54:56.979901 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:54:56.979901 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:54:56.981063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:54:56.981063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:54:56.981063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:54:56.981063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:54:56.981063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:54:56.981063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:54:56.981063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:54:56.981063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:54:56.981063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:54:56.981063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:54:56.981063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:54:56.981063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:54:56.981063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:54:56.981063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:54:56.981063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:54:56.981063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:54:56.981063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:54:56.982252 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:54:56.982252 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:54:56.982252 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:54:56.982252 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 609/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:54:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:54:56.988536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efc43e-6cbd-4907-bd55-26b1781285a6 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:54:57.099864 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efc43e-6cbd-4907-bd55-26b1781285a6 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:54:57.140411 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f3143-7203-4a4e-975d-7642386c75cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:54:57.141040 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f3143-7203-4a4e-975d-7642386c75cd None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:57.141396 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f3143-7203-4a4e-975d-7642386c75cd None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:57.141726 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f3143-7203-4a4e-975d-7642386c75cd None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:57.142580 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f3143-7203-4a4e-975d-7642386c75cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:54:57.142889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f3143-7203-4a4e-975d-7642386c75cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:54:57.144252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f3143-7203-4a4e-975d-7642386c75cd None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:54:57.163951 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 616/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:54:57.165118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30baf139-5fee-42f6-9a9e-2a93a4a5a2b6 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:54:57.271120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:54:57.277973 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30baf139-5fee-42f6-9a9e-2a93a4a5a2b6 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:54:57.315914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc961aeb-19d3-4a46-9598-170b61fd424d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:54:57.316572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc961aeb-19d3-4a46-9598-170b61fd424d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:57.316822 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc961aeb-19d3-4a46-9598-170b61fd424d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:57.317098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc961aeb-19d3-4a46-9598-170b61fd424d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:57.324873 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc961aeb-19d3-4a46-9598-170b61fd424d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:54:57.326343 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc961aeb-19d3-4a46-9598-170b61fd424d None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:54:57.339615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-dc961aeb-19d3-4a46-9598-170b61fd424d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 00:54:57.339615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:54:57.339615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:54:57.339615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:54:57.339615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:54:57.339615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:54:57.339615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:54:57.339615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:54:57.339615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:54:57.339615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:54:57.339615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:54:57.339615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:54:57.339615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:54:57.339615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:54:57.339615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:54:57.339615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:54:57.340945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:54:57.340945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:54:57.340945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:54:57.340945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:54:57.340945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:54:57.340945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:54:57.340945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:54:57.340945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:54:57.340945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:54:57.340945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:54:57.340945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:54:57.340945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:54:57.340945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:54:57.340945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:54:57.340945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:54:57.340945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:54:57.340945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:54:57.340945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:54:57.342222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:54:57.342222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:54:57.342222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:54:57.342222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:54:57.342222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:54:57.342222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:54:57.342222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:54:57.342222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:54:57.342222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 00:54:57.342222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:54:57.342222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 610/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:54:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:54:57.347071 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f3143-7203-4a4e-975d-7642386c75cd None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:54:57.397753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:54:57.459078 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f3143-7203-4a4e-975d-7642386c75cd None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:54:57.495165 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e4732-2921-47b6-a8b3-937665b156d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:54:57.495770 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e4732-2921-47b6-a8b3-937665b156d0 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:57.496050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e4732-2921-47b6-a8b3-937665b156d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:57.496321 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e4732-2921-47b6-a8b3-937665b156d0 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:57.497034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e4732-2921-47b6-a8b3-937665b156d0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:54:57.497333 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e4732-2921-47b6-a8b3-937665b156d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:54:57.498804 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e4732-2921-47b6-a8b3-937665b156d0 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:54:57.518131 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 617/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Sep 14 00:54:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:54:57.524074 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc961aeb-19d3-4a46-9598-170b61fd424d None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:54:57.641664 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc961aeb-19d3-4a46-9598-170b61fd424d None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:54:57.677003 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebc261-868f-493f-b897-54431afbe762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:54:57.677679 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebc261-868f-493f-b897-54431afbe762 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:57.678030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebc261-868f-493f-b897-54431afbe762 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:57.678327 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebc261-868f-493f-b897-54431afbe762 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:57.689651 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebc261-868f-493f-b897-54431afbe762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:54:57.691352 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebc261-868f-493f-b897-54431afbe762 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:54:57.708654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-b6ebc261-868f-493f-b897-54431afbe762 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:54:57.708654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:54:57.708654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:54:57.708654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:54:57.708654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:54:57.708654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:54:57.708654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:54:57.708654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:54:57.708654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:54:57.708654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:54:57.708654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:54:57.708654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:54:57.708654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:54:57.708654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:54:57.708654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:54:57.708654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:54:57.709884 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:54:57.709884 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:54:57.709884 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:54:57.709884 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:54:57.709884 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:54:57.709884 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:54:57.709884 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:54:57.709884 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:54:57.709884 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:54:57.709884 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:54:57.709884 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:54:57.709884 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:54:57.709884 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:54:57.709884 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:54:57.709884 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:54:57.709884 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:54:57.709884 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:54:57.710954 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:54:57.710954 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:54:57.710954 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:54:57.710954 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 611/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:54:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:54:57.717402 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e4732-2921-47b6-a8b3-937665b156d0 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:54:57.851323 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e4732-2921-47b6-a8b3-937665b156d0 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:54:57.853618 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:54:57.890570 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197aed6-ad04-4b21-b49f-60e8e4b76491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:54:57.891241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197aed6-ad04-4b21-b49f-60e8e4b76491 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:57.891511 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197aed6-ad04-4b21-b49f-60e8e4b76491 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:57.891782 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197aed6-ad04-4b21-b49f-60e8e4b76491 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:57.892503 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197aed6-ad04-4b21-b49f-60e8e4b76491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:54:57.892888 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197aed6-ad04-4b21-b49f-60e8e4b76491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:54:57.894520 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197aed6-ad04-4b21-b49f-60e8e4b76491 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:54:57.906833 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 618/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:54:57.912956 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebc261-868f-493f-b897-54431afbe762 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:54:57.924944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:54:58.037782 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebc261-868f-493f-b897-54431afbe762 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:54:58.076965 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a936c-24cc-4365-a864-8e08904060d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:54:58.077708 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a936c-24cc-4365-a864-8e08904060d8 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:58.078109 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a936c-24cc-4365-a864-8e08904060d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:58.078406 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a936c-24cc-4365-a864-8e08904060d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:58.085732 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a936c-24cc-4365-a864-8e08904060d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:54:58.087373 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a936c-24cc-4365-a864-8e08904060d8 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:54:58.100752 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-ce4a936c-24cc-4365-a864-8e08904060d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:54:58.100752 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:54:58.100752 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:54:58.100752 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:54:58.100752 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:54:58.100752 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:54:58.100752 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:54:58.100752 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:54:58.100752 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:54:58.100752 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:54:58.100752 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:54:58.100752 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:54:58.100752 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:54:58.100752 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:54:58.100752 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:54:58.101963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:54:58.101963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:54:58.101963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:54:58.101963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:54:58.101963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:54:58.101963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:54:58.101963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:54:58.101963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:54:58.101963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:54:58.101963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:54:58.101963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:54:58.101963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:54:58.101963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:54:58.101963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:54:58.101963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:54:58.101963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:54:58.101963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:54:58.103540 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:54:58.103540 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:54:58.103540 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:54:58.103540 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:54:58.103540 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:54:58.103540 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:54:58.103540 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:54:58.103540 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:54:58.103540 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 612/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:54:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:54:58.108807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197aed6-ad04-4b21-b49f-60e8e4b76491 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:54:58.222987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197aed6-ad04-4b21-b49f-60e8e4b76491 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:54:58.260883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffcf859-2c2e-4b88-bd4a-45fe29b9a981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:54:58.261583 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcf859-2c2e-4b88-bd4a-45fe29b9a981 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:58.261975 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcf859-2c2e-4b88-bd4a-45fe29b9a981 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:58.262249 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcf859-2c2e-4b88-bd4a-45fe29b9a981 None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:58.262934 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffcf859-2c2e-4b88-bd4a-45fe29b9a981 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:54:58.263230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffcf859-2c2e-4b88-bd4a-45fe29b9a981 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:54:58.264652 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffcf859-2c2e-4b88-bd4a-45fe29b9a981 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:54:58.276916 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 619/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:54:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:54:58.283319 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a936c-24cc-4365-a864-8e08904060d8 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:54:58.349758 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:54:58.387944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a936c-24cc-4365-a864-8e08904060d8 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:54:58.425904 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179567e-d17c-40cf-97d0-1de5fd33f7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:54:58.426561 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179567e-d17c-40cf-97d0-1de5fd33f7fa None admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:54:58.426841 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179567e-d17c-40cf-97d0-1de5fd33f7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:54:58.427107 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179567e-d17c-40cf-97d0-1de5fd33f7fa None admin] PATH_INFO: `/v3/projects/f37c835c05924364bcd1530d44f024fe/users/abf9ab5fafe94afdb3ebe98536b5cc3a/roles/b9c910c1c68948858203c62521b73efc` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:54:58.442956 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179567e-d17c-40cf-97d0-1de5fd33f7fa None admin] RBAC: Authorizing `identity:create_grant(project_id=f37c835c05924364bcd1530d44f024fe, user_id=abf9ab5fafe94afdb3ebe98536b5cc3a, role_id=b9c910c1c68948858203c62521b73efc)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:54:58.444425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179567e-d17c-40cf-97d0-1de5fd33f7fa None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:54:58.458203 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 613/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 14 00:54:58 2022] PUT /identity/v3/projects/f37c835c05924364bcd1530d44f024fe/users/abf9ab5fafe94afdb3ebe98536b5cc3a/roles/b9c910c1c68948858203c62521b73efc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 00:55:00.656983 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f693f-094b-4b5e-9d8a-8b8dd3788d7f None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:00.657530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f693f-094b-4b5e-9d8a-8b8dd3788d7f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:00.657530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f693f-094b-4b5e-9d8a-8b8dd3788d7f None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:00.658892 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 620/1233] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:55:00.665051 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ee5dc-686e-4554-92c2-2bcc5be8d5ca None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:00.666047 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ee5dc-686e-4554-92c2-2bcc5be8d5ca None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:00.666256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ee5dc-686e-4554-92c2-2bcc5be8d5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:00.686094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-7a4ee5dc-686e-4554-92c2-2bcc5be8d5ca None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:55:00.687344 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7a4ee5dc-686e-4554-92c2-2bcc5be8d5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:55:00.769034 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 614/1234] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:55:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:55:01.057054 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f693f-094b-4b5e-9d8a-8b8dd3788d7f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:01.082477 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:01.162317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f693f-094b-4b5e-9d8a-8b8dd3788d7f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:01.200060 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a899ba-e2b0-4d8e-a22f-32e0758f41ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:01.200699 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a899ba-e2b0-4d8e-a22f-32e0758f41ae None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:01.200980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a899ba-e2b0-4d8e-a22f-32e0758f41ae None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:01.201227 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a899ba-e2b0-4d8e-a22f-32e0758f41ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:01.212664 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a899ba-e2b0-4d8e-a22f-32e0758f41ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:55:01.218942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-03a899ba-e2b0-4d8e-a22f-32e0758f41ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:55:01.218942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:55:01.218942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:55:01.218942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:55:01.218942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:55:01.218942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:55:01.218942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:55:01.218942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:55:01.218942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:55:01.218942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:55:01.218942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:55:01.218942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:55:01.218942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:55:01.218942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:55:01.218942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:55:01.218942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:55:01.220146 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:55:01.220146 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:55:01.220146 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:55:01.220146 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:55:01.220146 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:55:01.220146 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:55:01.220146 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:55:01.220146 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:55:01.220146 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:55:01.220146 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:55:01.220146 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:55:01.220146 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:55:01.220146 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:55:01.220146 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:55:01.220146 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:55:01.220146 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:55:01.221453 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:55:01.221453 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:55:01.221453 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:55:01.221453 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:55:01.221453 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:55:01.221453 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:55:01.221453 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:55:01.221453 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:55:01.221453 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:55:01.221453 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:55:01.221453 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 00:55:01.221453 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:55:01.221453 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 621/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 14 00:55:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:55:01.226222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ee5dc-686e-4554-92c2-2bcc5be8d5ca None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:01.275668 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:01.331304 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ee5dc-686e-4554-92c2-2bcc5be8d5ca None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:01.373521 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28850ab9-9fba-4505-b72d-a3f119d91793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:01.374156 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28850ab9-9fba-4505-b72d-a3f119d91793 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:01.374428 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28850ab9-9fba-4505-b72d-a3f119d91793 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:01.374697 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28850ab9-9fba-4505-b72d-a3f119d91793 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:01.375397 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28850ab9-9fba-4505-b72d-a3f119d91793 None admin] RBAC: Adding query filter params (name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:55:01.375737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28850ab9-9fba-4505-b72d-a3f119d91793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:01.377300 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28850ab9-9fba-4505-b72d-a3f119d91793 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:01.386416 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 615/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 14 00:55:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:55:01.392669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a899ba-e2b0-4d8e-a22f-32e0758f41ae None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:01.486475 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:01.503668 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a899ba-e2b0-4d8e-a22f-32e0758f41ae None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:01.542268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2d04b-7531-4d72-9368-047e35640841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:01.542843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2d04b-7531-4d72-9368-047e35640841 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:01.543194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2d04b-7531-4d72-9368-047e35640841 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:01.543467 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2d04b-7531-4d72-9368-047e35640841 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:01.554663 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f2d04b-7531-4d72-9368-047e35640841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:01.556606 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f2d04b-7531-4d72-9368-047e35640841 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:01.572885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-27f2d04b-7531-4d72-9368-047e35640841 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:55:01.572885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:55:01.572885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:55:01.572885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:55:01.572885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:55:01.572885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:55:01.572885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:55:01.572885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:55:01.572885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:55:01.572885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:55:01.572885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:55:01.572885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:55:01.572885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:55:01.572885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:55:01.572885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:55:01.572885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:55:01.574127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:55:01.574127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:55:01.574127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:55:01.574127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:55:01.574127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:55:01.574127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:55:01.574127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:55:01.574127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:55:01.574127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:55:01.574127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:55:01.574127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:55:01.574127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:55:01.574127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:55:01.574127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:55:01.574127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:55:01.574127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:55:01.574127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:55:01.575020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:55:01.575020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:55:01.575020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:55:01.575020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 622/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:55:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:55:01.579913 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28850ab9-9fba-4505-b72d-a3f119d91793 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:01.691285 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28850ab9-9fba-4505-b72d-a3f119d91793 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:01.700563 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:01.731895 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833794c-69a8-4c29-8f8b-c498c4603913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:01.733341 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833794c-69a8-4c29-8f8b-c498c4603913 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:01.733341 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833794c-69a8-4c29-8f8b-c498c4603913 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:01.733545 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833794c-69a8-4c29-8f8b-c498c4603913 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:01.734298 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833794c-69a8-4c29-8f8b-c498c4603913 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:55:01.734926 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833794c-69a8-4c29-8f8b-c498c4603913 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:01.737042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833794c-69a8-4c29-8f8b-c498c4603913 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:01.756840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 616/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:55:01.762842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2d04b-7531-4d72-9368-047e35640841 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:01.874245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2d04b-7531-4d72-9368-047e35640841 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:01.910889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b9f62-a42e-426e-b092-408fda485c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:01.911514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b9f62-a42e-426e-b092-408fda485c3e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:01.911789 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b9f62-a42e-426e-b092-408fda485c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:01.912110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b9f62-a42e-426e-b092-408fda485c3e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:01.915885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:01.922502 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b9f62-a42e-426e-b092-408fda485c3e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:01.924061 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b9f62-a42e-426e-b092-408fda485c3e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:01.937256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-fa2b9f62-a42e-426e-b092-408fda485c3e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 00:55:01.937256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:55:01.937256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:55:01.937256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:55:01.937256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:55:01.937256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:55:01.937256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:55:01.937256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:55:01.937256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:55:01.937256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:55:01.937256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:55:01.937256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:55:01.937256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:55:01.937256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:55:01.937256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:55:01.937256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:55:01.938478 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:55:01.938478 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:55:01.938478 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:55:01.938478 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:55:01.938478 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:55:01.938478 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:55:01.938478 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:55:01.938478 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:55:01.938478 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:55:01.938478 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:55:01.938478 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:55:01.938478 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:55:01.938478 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:55:01.938478 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:55:01.938478 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:55:01.938478 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:55:01.938478 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:55:01.938478 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:55:01.939960 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:55:01.939960 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:55:01.939960 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:55:01.939960 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:55:01.939960 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:55:01.939960 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:55:01.939960 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:55:01.939960 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:55:01.939960 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 00:55:01.939960 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:55:01.939960 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 623/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:55:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:55:01.946785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833794c-69a8-4c29-8f8b-c498c4603913 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:02.057931 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833794c-69a8-4c29-8f8b-c498c4603913 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:02.094209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f0d92-1e4f-4015-bc19-bf417884953c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:02.094809 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f0d92-1e4f-4015-bc19-bf417884953c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:02.095086 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f0d92-1e4f-4015-bc19-bf417884953c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:02.095354 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f0d92-1e4f-4015-bc19-bf417884953c None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:02.096072 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f0d92-1e4f-4015-bc19-bf417884953c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:55:02.096372 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f0d92-1e4f-4015-bc19-bf417884953c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:02.097830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f0d92-1e4f-4015-bc19-bf417884953c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:02.116478 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 617/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Sep 14 00:55:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:55:02.122882 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b9f62-a42e-426e-b092-408fda485c3e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:02.243747 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b9f62-a42e-426e-b092-408fda485c3e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:02.282759 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d943770-7655-4da0-8638-e635f03fda7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:02.283389 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d943770-7655-4da0-8638-e635f03fda7f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:02.283678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d943770-7655-4da0-8638-e635f03fda7f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:02.283953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d943770-7655-4da0-8638-e635f03fda7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:02.355449 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:02.362726 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d943770-7655-4da0-8638-e635f03fda7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:02.364212 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d943770-7655-4da0-8638-e635f03fda7f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:02.483833 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 624/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:55:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 00:55:02.489964 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f0d92-1e4f-4015-bc19-bf417884953c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:02.521825 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:02.612174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f0d92-1e4f-4015-bc19-bf417884953c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:02.655609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8116aca-44d4-4120-b028-f88d6786e733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:02.656565 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8116aca-44d4-4120-b028-f88d6786e733 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:02.656844 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8116aca-44d4-4120-b028-f88d6786e733 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:02.657112 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8116aca-44d4-4120-b028-f88d6786e733 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:02.668900 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8116aca-44d4-4120-b028-f88d6786e733 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:02.670899 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8116aca-44d4-4120-b028-f88d6786e733 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:02.688863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-a8116aca-44d4-4120-b028-f88d6786e733 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:55:02.688863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:55:02.688863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:55:02.688863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:55:02.688863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:55:02.688863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:55:02.688863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:55:02.688863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:55:02.688863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:55:02.688863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:55:02.688863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:55:02.688863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:55:02.688863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:55:02.688863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:55:02.688863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:55:02.688863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:55:02.695090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:55:02.695090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:55:02.695090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:55:02.695090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:55:02.695090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:55:02.695090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:55:02.695090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:55:02.695090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:55:02.695090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:55:02.695090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:55:02.695090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:55:02.695090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:55:02.695090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:55:02.695090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:55:02.695090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:55:02.695090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:55:02.695090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:55:02.697707 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:55:02.697707 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:55:02.697707 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:55:02.697707 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 618/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:55:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:55:02.698103 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d943770-7655-4da0-8638-e635f03fda7f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:02.809963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:02.817294 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d943770-7655-4da0-8638-e635f03fda7f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:02.857185 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6657394-c58a-45fd-a391-30e4f384ab69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:02.858135 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6657394-c58a-45fd-a391-30e4f384ab69 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:02.858685 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6657394-c58a-45fd-a391-30e4f384ab69 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:02.859044 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6657394-c58a-45fd-a391-30e4f384ab69 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:02.859819 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6657394-c58a-45fd-a391-30e4f384ab69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:55:02.860328 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6657394-c58a-45fd-a391-30e4f384ab69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:02.862504 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6657394-c58a-45fd-a391-30e4f384ab69 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:02.877870 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 625/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:55:02.884919 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8116aca-44d4-4120-b028-f88d6786e733 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:02.973779 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:03.001461 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8116aca-44d4-4120-b028-f88d6786e733 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:03.043804 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc243444-7602-43a4-bc6c-56231bbb8188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:03.044648 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc243444-7602-43a4-bc6c-56231bbb8188 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:03.045005 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc243444-7602-43a4-bc6c-56231bbb8188 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:03.045291 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc243444-7602-43a4-bc6c-56231bbb8188 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:03.053149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc243444-7602-43a4-bc6c-56231bbb8188 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:03.054926 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc243444-7602-43a4-bc6c-56231bbb8188 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:03.068293 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-bc243444-7602-43a4-bc6c-56231bbb8188 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:55:03.068293 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:55:03.068293 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:55:03.068293 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:55:03.068293 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:55:03.068293 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:55:03.068293 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:55:03.068293 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:55:03.068293 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:55:03.068293 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:55:03.068293 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:55:03.068293 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:55:03.068293 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:55:03.068293 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:55:03.068293 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:55:03.074184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:55:03.074184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:55:03.074184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:55:03.074184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:55:03.074184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:55:03.074184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:55:03.074184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:55:03.074184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:55:03.074184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:55:03.074184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:55:03.074184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:55:03.074184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:55:03.074184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:55:03.074184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:55:03.074184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:55:03.074184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:55:03.074184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:55:03.075416 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:55:03.075416 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:55:03.075416 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:55:03.075416 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:55:03.075416 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:55:03.075416 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:55:03.075416 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:55:03.075416 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:55:03.075416 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 619/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:55:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 00:55:03.076124 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6657394-c58a-45fd-a391-30e4f384ab69 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:03.192601 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6657394-c58a-45fd-a391-30e4f384ab69 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:03.233376 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82afeee9-7286-42b8-9bff-a43960f89ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:03.234115 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afeee9-7286-42b8-9bff-a43960f89ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:03.234495 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afeee9-7286-42b8-9bff-a43960f89ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:03.234820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afeee9-7286-42b8-9bff-a43960f89ec1 None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:03.235563 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82afeee9-7286-42b8-9bff-a43960f89ec1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:55:03.235904 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82afeee9-7286-42b8-9bff-a43960f89ec1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:03.237629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82afeee9-7286-42b8-9bff-a43960f89ec1 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:03.251797 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 626/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:55:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:55:03.258164 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc243444-7602-43a4-bc6c-56231bbb8188 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:03.373515 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc243444-7602-43a4-bc6c-56231bbb8188 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:03.414174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ebeb6-d6db-47d6-989d-8be6a602ea3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:03.414868 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ebeb6-d6db-47d6-989d-8be6a602ea3b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:03.415698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ebeb6-d6db-47d6-989d-8be6a602ea3b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:03.416068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ebeb6-d6db-47d6-989d-8be6a602ea3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:03.416879 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ebeb6-d6db-47d6-989d-8be6a602ea3b None admin] RBAC: Adding query filter params (role.id=b9c910c1c68948858203c62521b73efc, scope.project.id=f37c835c05924364bcd1530d44f024fe, user.id=abf9ab5fafe94afdb3ebe98536b5cc3a) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:55:03.417205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ebeb6-d6db-47d6-989d-8be6a602ea3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:03.418964 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ebeb6-d6db-47d6-989d-8be6a602ea3b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:03.425607 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 620/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:55:03 2022] GET /identity/v3/role_assignments?user.id=abf9ab5fafe94afdb3ebe98536b5cc3a&scope.project.id=f37c835c05924364bcd1530d44f024fe&role.id=b9c910c1c68948858203c62521b73efc => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:55:05.777497 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b11d1-bb32-4959-a429-053bcb08bd88 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:05.778092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b11d1-bb32-4959-a429-053bcb08bd88 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:05.778092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b11d1-bb32-4959-a429-053bcb08bd88 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:05.779419 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 627/1247] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:55:05.784910 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d773b-1fb8-4139-98dd-70fe5e772204 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:05.785358 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d773b-1fb8-4139-98dd-70fe5e772204 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:05.785469 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d773b-1fb8-4139-98dd-70fe5e772204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:05.792189 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:05.804494 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-f00d773b-1fb8-4139-98dd-70fe5e772204 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:55:05.806204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f00d773b-1fb8-4139-98dd-70fe5e772204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:55:05.875580 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 621/1248] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:55:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:55:06.140497 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b11d1-bb32-4959-a429-053bcb08bd88 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:06.158749 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:06.247058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b11d1-bb32-4959-a429-053bcb08bd88 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:06.284207 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38d850-05fe-475e-890f-6a189236c71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:06.284832 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38d850-05fe-475e-890f-6a189236c71b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:06.285113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38d850-05fe-475e-890f-6a189236c71b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:06.285386 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38d850-05fe-475e-890f-6a189236c71b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:06.297508 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38d850-05fe-475e-890f-6a189236c71b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:55:06.302314 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-3a38d850-05fe-475e-890f-6a189236c71b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:55:06.302314 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:55:06.302314 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:55:06.302314 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:55:06.302314 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:55:06.302314 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:55:06.302314 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:55:06.302314 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:55:06.302314 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:55:06.302314 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:55:06.302314 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:55:06.302314 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:55:06.302314 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:55:06.302314 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:55:06.302314 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:55:06.302314 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:55:06.308769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:55:06.308769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:55:06.308769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:55:06.308769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:55:06.308769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:55:06.308769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:55:06.308769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:55:06.308769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:55:06.308769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:55:06.308769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:55:06.308769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:55:06.308769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:55:06.308769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:55:06.308769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:55:06.308769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:55:06.308769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:55:06.309836 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:55:06.309836 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:55:06.309836 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:55:06.309836 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:55:06.309836 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:55:06.309836 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:55:06.309836 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:55:06.309836 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:55:06.309836 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:55:06.309836 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:55:06.309836 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:55:06.309836 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:55:06.309836 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 628/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:55:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:55:06.310709 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d773b-1fb8-4139-98dd-70fe5e772204 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:06.414490 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d773b-1fb8-4139-98dd-70fe5e772204 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:06.447949 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:06.453345 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9a041-1e03-4eda-9312-c41b4276cd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:06.453997 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9a041-1e03-4eda-9312-c41b4276cd47 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:06.454276 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9a041-1e03-4eda-9312-c41b4276cd47 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:06.454544 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9a041-1e03-4eda-9312-c41b4276cd47 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:06.455217 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9a041-1e03-4eda-9312-c41b4276cd47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:55:06.455518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9a041-1e03-4eda-9312-c41b4276cd47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:06.456918 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9a041-1e03-4eda-9312-c41b4276cd47 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:06.467090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 622/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:55:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:55:06.473348 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38d850-05fe-475e-890f-6a189236c71b None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:06.553253 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:06.578053 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38d850-05fe-475e-890f-6a189236c71b None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:06.614211 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a0c63-f7a6-4880-aef3-f27f8f0f2bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:06.615094 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a0c63-f7a6-4880-aef3-f27f8f0f2bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:06.615375 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a0c63-f7a6-4880-aef3-f27f8f0f2bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:06.615698 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a0c63-f7a6-4880-aef3-f27f8f0f2bb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:06.627476 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a0c63-f7a6-4880-aef3-f27f8f0f2bb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:06.628975 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a0c63-f7a6-4880-aef3-f27f8f0f2bb5 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:06.645494 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-d74a0c63-f7a6-4880-aef3-f27f8f0f2bb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:55:06.645494 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:55:06.645494 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:55:06.645494 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:55:06.645494 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:55:06.645494 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:55:06.645494 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:55:06.645494 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:55:06.645494 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:55:06.645494 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:55:06.645494 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:55:06.645494 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:55:06.645494 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:55:06.645494 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:55:06.645494 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:55:06.645494 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:55:06.646713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:55:06.646713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:55:06.646713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:55:06.646713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:55:06.646713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:55:06.646713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:55:06.646713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:55:06.646713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:55:06.646713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:55:06.646713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:55:06.646713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:55:06.646713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:55:06.646713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:55:06.646713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:55:06.646713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:55:06.646713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:55:06.646713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:55:06.647637 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:55:06.647637 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:55:06.647637 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:55:06.647637 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 629/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:55:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:55:06.652595 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9a041-1e03-4eda-9312-c41b4276cd47 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:06.779294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9a041-1e03-4eda-9312-c41b4276cd47 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:06.815607 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373113b4-03a5-44af-92bd-4606bf55ff08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:06.816256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373113b4-03a5-44af-92bd-4606bf55ff08 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:06.816469 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373113b4-03a5-44af-92bd-4606bf55ff08 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:06.816733 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373113b4-03a5-44af-92bd-4606bf55ff08 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:06.817371 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373113b4-03a5-44af-92bd-4606bf55ff08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:55:06.817665 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373113b4-03a5-44af-92bd-4606bf55ff08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:06.819056 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373113b4-03a5-44af-92bd-4606bf55ff08 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:06.832627 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 623/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:55:06.838389 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a0c63-f7a6-4880-aef3-f27f8f0f2bb5 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:06.939177 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a0c63-f7a6-4880-aef3-f27f8f0f2bb5 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:06.964946 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:06.973374 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a1f24-8d4c-4ce4-aaea-bd23c94f9875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:06.974029 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a1f24-8d4c-4ce4-aaea-bd23c94f9875 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:06.974305 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a1f24-8d4c-4ce4-aaea-bd23c94f9875 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:06.974573 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a1f24-8d4c-4ce4-aaea-bd23c94f9875 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:06.983042 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a1f24-8d4c-4ce4-aaea-bd23c94f9875 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:06.984508 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a1f24-8d4c-4ce4-aaea-bd23c94f9875 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:06.996678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-792a1f24-8d4c-4ce4-aaea-bd23c94f9875 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 00:55:06.996678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:55:06.996678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:55:06.996678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:55:06.996678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:55:06.996678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:55:06.996678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:55:06.996678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:55:06.996678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:55:06.996678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:55:06.996678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:55:06.996678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:55:06.996678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:55:06.996678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:55:06.996678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:55:06.996678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:55:06.997982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:55:06.997982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:55:06.997982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:55:06.997982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:55:06.997982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:55:06.997982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:55:06.997982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:55:06.997982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:55:06.997982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:55:06.997982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:55:06.997982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:55:06.997982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:55:06.997982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:55:06.997982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:55:06.997982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:55:06.997982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:55:06.997982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:55:06.997982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:55:06.999126 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:55:06.999126 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:55:06.999126 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:55:06.999126 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:55:06.999126 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:55:06.999126 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:55:06.999126 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:55:06.999126 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:55:06.999126 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 00:55:06.999126 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:55:06.999126 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 630/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:55:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:55:07.003746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373113b4-03a5-44af-92bd-4606bf55ff08 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:07.062674 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:07.109591 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373113b4-03a5-44af-92bd-4606bf55ff08 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:07.142674 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3792b-79ff-40dc-9bf1-b027b09af297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:07.143264 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3792b-79ff-40dc-9bf1-b027b09af297 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:07.143538 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3792b-79ff-40dc-9bf1-b027b09af297 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:07.143804 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3792b-79ff-40dc-9bf1-b027b09af297 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:07.144512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3792b-79ff-40dc-9bf1-b027b09af297 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:55:07.144811 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3792b-79ff-40dc-9bf1-b027b09af297 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:07.146265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3792b-79ff-40dc-9bf1-b027b09af297 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:07.163079 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 624/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Sep 14 00:55:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:55:07.169346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a1f24-8d4c-4ce4-aaea-bd23c94f9875 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:07.263962 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a1f24-8d4c-4ce4-aaea-bd23c94f9875 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:07.295346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0256dd6-1de5-4efc-a61a-3636f859e037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:07.295929 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0256dd6-1de5-4efc-a61a-3636f859e037 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:07.296203 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0256dd6-1de5-4efc-a61a-3636f859e037 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:07.296475 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0256dd6-1de5-4efc-a61a-3636f859e037 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:07.347998 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:07.360671 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0256dd6-1de5-4efc-a61a-3636f859e037 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:07.362125 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0256dd6-1de5-4efc-a61a-3636f859e037 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:07.454610 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 631/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:55:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 00:55:07.460318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3792b-79ff-40dc-9bf1-b027b09af297 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:07.556767 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3792b-79ff-40dc-9bf1-b027b09af297 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:07.569300 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:07.590352 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc3d7f-a821-4ac6-9363-6e1206e731b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:07.590963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc3d7f-a821-4ac6-9363-6e1206e731b4 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:07.591239 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc3d7f-a821-4ac6-9363-6e1206e731b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:07.591507 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc3d7f-a821-4ac6-9363-6e1206e731b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:07.601188 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc3d7f-a821-4ac6-9363-6e1206e731b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:07.602618 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc3d7f-a821-4ac6-9363-6e1206e731b4 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:07.616698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-d5dc3d7f-a821-4ac6-9363-6e1206e731b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:55:07.616698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:55:07.616698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:55:07.616698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:55:07.616698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:55:07.616698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:55:07.616698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:55:07.616698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:55:07.616698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:55:07.616698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:55:07.616698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:55:07.616698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:55:07.616698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:55:07.616698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:55:07.616698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:55:07.616698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:55:07.617774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:55:07.617774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:55:07.617774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:55:07.617774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:55:07.617774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:55:07.617774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:55:07.617774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:55:07.617774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:55:07.617774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:55:07.617774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:55:07.617774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:55:07.617774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:55:07.617774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:55:07.617774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:55:07.617774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:55:07.617774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:55:07.617774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:55:07.619441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:55:07.619441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:55:07.619441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:55:07.619441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 625/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:55:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:55:07.623872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0256dd6-1de5-4efc-a61a-3636f859e037 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:07.710184 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:07.723424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0256dd6-1de5-4efc-a61a-3636f859e037 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:07.763452 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bbb17-5bad-4077-9e64-076eff62909d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:07.764147 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bbb17-5bad-4077-9e64-076eff62909d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:07.764463 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bbb17-5bad-4077-9e64-076eff62909d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:07.764802 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bbb17-5bad-4077-9e64-076eff62909d None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:07.765467 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3bbb17-5bad-4077-9e64-076eff62909d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:55:07.765771 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3bbb17-5bad-4077-9e64-076eff62909d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:07.767158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3bbb17-5bad-4077-9e64-076eff62909d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:07.778108 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 632/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 00:55:07.784014 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc3d7f-a821-4ac6-9363-6e1206e731b4 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:07.879409 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc3d7f-a821-4ac6-9363-6e1206e731b4 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:07.911410 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc674c-7026-4569-9a76-b508bd2d0ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:07.912008 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc674c-7026-4569-9a76-b508bd2d0ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:07.912282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc674c-7026-4569-9a76-b508bd2d0ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:07.912567 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc674c-7026-4569-9a76-b508bd2d0ce0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:07.919422 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc674c-7026-4569-9a76-b508bd2d0ce0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:07.920842 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc674c-7026-4569-9a76-b508bd2d0ce0 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:07.931853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-d3fc674c-7026-4569-9a76-b508bd2d0ce0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:55:07.931853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:55:07.931853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:55:07.931853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:55:07.931853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:55:07.931853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:55:07.931853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:55:07.931853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:55:07.931853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:55:07.931853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:55:07.931853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:55:07.931853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:55:07.931853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:55:07.931853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:55:07.931853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:55:07.932786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:55:07.932786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:55:07.932786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:55:07.932786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:55:07.932786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:55:07.932786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:55:07.932786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:55:07.932786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:55:07.932786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:55:07.932786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:55:07.932786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:55:07.932786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:55:07.932786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:55:07.932786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:55:07.932786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:55:07.932786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:55:07.932786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:55:07.933753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:55:07.933753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:55:07.933753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:55:07.933753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:55:07.933753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:55:07.933753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:55:07.933753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:55:07.933753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:55:07.933753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 626/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:55:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:55:07.938611 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bbb17-5bad-4077-9e64-076eff62909d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:08.042686 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bbb17-5bad-4077-9e64-076eff62909d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:08.075333 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c94331-3929-4f5e-90b5-11268a8cbfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:08.075921 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c94331-3929-4f5e-90b5-11268a8cbfb2 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:08.076196 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c94331-3929-4f5e-90b5-11268a8cbfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:08.076462 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c94331-3929-4f5e-90b5-11268a8cbfb2 None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:08.077128 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c94331-3929-4f5e-90b5-11268a8cbfb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:55:08.077425 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c94331-3929-4f5e-90b5-11268a8cbfb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:08.078849 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c94331-3929-4f5e-90b5-11268a8cbfb2 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:08.090188 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 633/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:55:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:55:08.096322 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc674c-7026-4569-9a76-b508bd2d0ce0 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:08.121689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:08.192895 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc674c-7026-4569-9a76-b508bd2d0ce0 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:08.224773 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23c36e-0cc4-4919-9eaf-204b2f27d350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:08.225355 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23c36e-0cc4-4919-9eaf-204b2f27d350 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:08.225628 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23c36e-0cc4-4919-9eaf-204b2f27d350 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:08.225920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23c36e-0cc4-4919-9eaf-204b2f27d350 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:08.226623 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23c36e-0cc4-4919-9eaf-204b2f27d350 None admin] RBAC: Adding query filter params (role.id=0d7a36bda723430eae02f10f4c775c96, scope.project.id=f37c835c05924364bcd1530d44f024fe, user.id=abf9ab5fafe94afdb3ebe98536b5cc3a) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:55:08.226922 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23c36e-0cc4-4919-9eaf-204b2f27d350 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:08.228359 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23c36e-0cc4-4919-9eaf-204b2f27d350 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:08.233469 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 627/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:55:08 2022] GET /identity/v3/role_assignments?user.id=abf9ab5fafe94afdb3ebe98536b5cc3a&scope.project.id=f37c835c05924364bcd1530d44f024fe&role.id=0d7a36bda723430eae02f10f4c775c96 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:55:10.355954 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e5c75-af60-42ee-9e64-12b8b6a0adae None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:10.356469 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e5c75-af60-42ee-9e64-12b8b6a0adae None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:10.356469 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e5c75-af60-42ee-9e64-12b8b6a0adae None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:10.357754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 634/1261] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:55:10.362853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ed77d-4342-42d9-8a28-1bde398b17d8 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:10.363257 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ed77d-4342-42d9-8a28-1bde398b17d8 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:10.363396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ed77d-4342-42d9-8a28-1bde398b17d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:10.383178 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-d64ed77d-4342-42d9-8a28-1bde398b17d8 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:55:10.385092 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d64ed77d-4342-42d9-8a28-1bde398b17d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:55:10.452788 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 628/1262] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:55:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:55:10.725872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e5c75-af60-42ee-9e64-12b8b6a0adae None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:10.738270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:10.839100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e5c75-af60-42ee-9e64-12b8b6a0adae None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:10.871758 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6d206-d0ef-45f7-9623-30469c2da285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:10.872428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6d206-d0ef-45f7-9623-30469c2da285 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:10.872708 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6d206-d0ef-45f7-9623-30469c2da285 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:10.872980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6d206-d0ef-45f7-9623-30469c2da285 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:10.882993 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6d206-d0ef-45f7-9623-30469c2da285 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:55:10.888748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-d5b6d206-d0ef-45f7-9623-30469c2da285 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:55:10.888748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:55:10.888748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:55:10.888748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:55:10.888748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:55:10.888748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:55:10.888748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:55:10.888748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:55:10.888748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:55:10.888748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:55:10.888748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:55:10.888748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:55:10.888748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:55:10.888748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:55:10.888748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:55:10.888748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:55:10.889842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:55:10.889842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:55:10.889842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:55:10.889842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:55:10.889842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:55:10.889842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:55:10.889842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:55:10.889842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:55:10.889842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:55:10.889842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:55:10.889842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:55:10.889842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:55:10.889842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:55:10.889842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:55:10.889842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:55:10.889842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:55:10.891114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:55:10.891114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:55:10.891114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:55:10.891114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:55:10.891114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:55:10.891114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:55:10.891114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:55:10.891114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:55:10.891114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:55:10.891114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:55:10.891114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:55:10.891114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:55:10.891114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 635/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:55:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:55:10.895935 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ed77d-4342-42d9-8a28-1bde398b17d8 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:10.914232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:10.995395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ed77d-4342-42d9-8a28-1bde398b17d8 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:11.030602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4c901-f53a-4865-8fe0-50aa36fa9d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:11.031448 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4c901-f53a-4865-8fe0-50aa36fa9d89 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:11.031724 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4c901-f53a-4865-8fe0-50aa36fa9d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:11.031992 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4c901-f53a-4865-8fe0-50aa36fa9d89 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:11.032642 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4c901-f53a-4865-8fe0-50aa36fa9d89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:55:11.032938 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4c901-f53a-4865-8fe0-50aa36fa9d89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:11.034327 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4c901-f53a-4865-8fe0-50aa36fa9d89 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:11.042250 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 629/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:55:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:55:11.047970 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6d206-d0ef-45f7-9623-30469c2da285 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:11.111845 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:11.144569 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6d206-d0ef-45f7-9623-30469c2da285 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:11.176556 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff618c4-93b2-4cc8-87ea-c5a573288e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:11.177163 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff618c4-93b2-4cc8-87ea-c5a573288e97 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:11.177437 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff618c4-93b2-4cc8-87ea-c5a573288e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:11.177706 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff618c4-93b2-4cc8-87ea-c5a573288e97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:11.187777 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff618c4-93b2-4cc8-87ea-c5a573288e97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:11.189198 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff618c4-93b2-4cc8-87ea-c5a573288e97 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:11.203684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-0ff618c4-93b2-4cc8-87ea-c5a573288e97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:55:11.203684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:55:11.203684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:55:11.203684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:55:11.203684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:55:11.203684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:55:11.203684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:55:11.203684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:55:11.203684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:55:11.203684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:55:11.203684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:55:11.203684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:55:11.203684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:55:11.203684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:55:11.203684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:55:11.203684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:55:11.204734 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:55:11.204734 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:55:11.204734 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:55:11.204734 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:55:11.204734 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:55:11.204734 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:55:11.204734 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:55:11.204734 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:55:11.204734 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:55:11.204734 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:55:11.204734 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:55:11.204734 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:55:11.204734 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:55:11.204734 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:55:11.204734 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:55:11.204734 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:55:11.204734 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:55:11.205640 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:55:11.205640 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:55:11.205640 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:55:11.205640 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 636/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:55:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:55:11.210583 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4c901-f53a-4865-8fe0-50aa36fa9d89 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:11.291109 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:11.310131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4c901-f53a-4865-8fe0-50aa36fa9d89 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:11.342450 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e48f66-df7d-4215-a60d-56e22d54dd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:11.343034 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e48f66-df7d-4215-a60d-56e22d54dd2c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:11.343311 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e48f66-df7d-4215-a60d-56e22d54dd2c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:11.343578 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e48f66-df7d-4215-a60d-56e22d54dd2c None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:11.344199 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e48f66-df7d-4215-a60d-56e22d54dd2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:55:11.344494 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e48f66-df7d-4215-a60d-56e22d54dd2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:11.345865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e48f66-df7d-4215-a60d-56e22d54dd2c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:11.357132 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 630/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:55:11.362935 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff618c4-93b2-4cc8-87ea-c5a573288e97 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:11.458071 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff618c4-93b2-4cc8-87ea-c5a573288e97 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:11.476288 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:11.490052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096277e-27cd-4f26-991e-dac818cac8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:11.490650 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096277e-27cd-4f26-991e-dac818cac8ac None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:11.490924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096277e-27cd-4f26-991e-dac818cac8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:11.491192 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096277e-27cd-4f26-991e-dac818cac8ac None admin] PATH_INFO: `/v3/users/placement` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:11.498208 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096277e-27cd-4f26-991e-dac818cac8ac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:11.499634 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096277e-27cd-4f26-991e-dac818cac8ac None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:11.510753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-d096277e-27cd-4f26-991e-dac818cac8ac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 00:55:11.510753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:55:11.510753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:55:11.510753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:55:11.510753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:55:11.510753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:55:11.510753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:55:11.510753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:55:11.510753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:55:11.510753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:55:11.510753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:55:11.510753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:55:11.510753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:55:11.510753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:55:11.510753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:55:11.510753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:55:11.511793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:55:11.511793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:55:11.511793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:55:11.511793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:55:11.511793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:55:11.511793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:55:11.511793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:55:11.511793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:55:11.511793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:55:11.511793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:55:11.511793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:55:11.511793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:55:11.511793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:55:11.511793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:55:11.511793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:55:11.511793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:55:11.511793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:55:11.511793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:55:11.512908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:55:11.512908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:55:11.512908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:55:11.512908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:55:11.512908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:55:11.512908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:55:11.512908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:55:11.512908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:55:11.512908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 00:55:11.512908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:55:11.512908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 637/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:55:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:55:11.517462 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e48f66-df7d-4215-a60d-56e22d54dd2c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:11.612924 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e48f66-df7d-4215-a60d-56e22d54dd2c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:11.645237 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c0041-7701-4565-bf14-62a48022da0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:11.645836 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c0041-7701-4565-bf14-62a48022da0f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:11.646119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c0041-7701-4565-bf14-62a48022da0f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:11.646386 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c0041-7701-4565-bf14-62a48022da0f None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:11.647087 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c0041-7701-4565-bf14-62a48022da0f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:55:11.647386 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c0041-7701-4565-bf14-62a48022da0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:11.648785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c0041-7701-4565-bf14-62a48022da0f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:11.657884 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:11.666074 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 631/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Sep 14 00:55:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:55:11.671814 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096277e-27cd-4f26-991e-dac818cac8ac None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:11.770031 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096277e-27cd-4f26-991e-dac818cac8ac None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:11.802946 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871984a-0111-4fc7-b830-3d4d35c371ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:11.803556 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871984a-0111-4fc7-b830-3d4d35c371ee None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:11.803830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871984a-0111-4fc7-b830-3d4d35c371ee None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:11.804097 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871984a-0111-4fc7-b830-3d4d35c371ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:11.814529 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871984a-0111-4fc7-b830-3d4d35c371ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:11.815941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871984a-0111-4fc7-b830-3d4d35c371ee None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:11.829263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-1871984a-0111-4fc7-b830-3d4d35c371ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:55:11.829263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:55:11.829263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:55:11.829263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:55:11.829263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:55:11.829263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:55:11.829263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:55:11.829263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:55:11.829263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:55:11.829263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:55:11.829263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:55:11.829263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:55:11.829263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:55:11.829263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:55:11.829263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:55:11.829263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:55:11.830245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:55:11.830245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:55:11.830245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:55:11.830245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:55:11.830245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:55:11.830245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:55:11.830245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:55:11.830245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:55:11.830245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:55:11.830245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:55:11.830245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:55:11.830245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:55:11.830245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:55:11.830245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:55:11.830245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:55:11.830245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:55:11.830245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:55:11.831197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:55:11.831197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:55:11.831197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:55:11.831197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 638/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:55:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:55:11.836174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c0041-7701-4565-bf14-62a48022da0f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:11.932295 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c0041-7701-4565-bf14-62a48022da0f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:11.964745 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96287d-df51-4ae9-b036-66b8e59a52e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:11.965325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96287d-df51-4ae9-b036-66b8e59a52e8 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:11.965600 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96287d-df51-4ae9-b036-66b8e59a52e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:11.965892 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96287d-df51-4ae9-b036-66b8e59a52e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:11.966513 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96287d-df51-4ae9-b036-66b8e59a52e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:55:11.966808 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96287d-df51-4ae9-b036-66b8e59a52e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:11.968150 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96287d-df51-4ae9-b036-66b8e59a52e8 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:11.979512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 632/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:55:11.985033 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871984a-0111-4fc7-b830-3d4d35c371ee None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:12.014895 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:12.080408 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871984a-0111-4fc7-b830-3d4d35c371ee None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:12.112868 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2bea3-3d2a-41bf-bff9-ea3c4995df48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:12.113479 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2bea3-3d2a-41bf-bff9-ea3c4995df48 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:12.113754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2bea3-3d2a-41bf-bff9-ea3c4995df48 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:12.114054 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2bea3-3d2a-41bf-bff9-ea3c4995df48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:12.120354 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2bea3-3d2a-41bf-bff9-ea3c4995df48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:12.121777 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2bea3-3d2a-41bf-bff9-ea3c4995df48 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:12.132662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-e2a2bea3-3d2a-41bf-bff9-ea3c4995df48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:55:12.132662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:55:12.132662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:55:12.132662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:55:12.132662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:55:12.132662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:55:12.132662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:55:12.132662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:55:12.132662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:55:12.132662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:55:12.132662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:55:12.132662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:55:12.132662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:55:12.132662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:55:12.132662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:55:12.133694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:55:12.133694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:55:12.133694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:55:12.133694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:55:12.133694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:55:12.133694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:55:12.133694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:55:12.133694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:55:12.133694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:55:12.133694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:55:12.133694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:55:12.133694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:55:12.133694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:55:12.133694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:55:12.133694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:55:12.133694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:55:12.133694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:55:12.138807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:55:12.138807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:55:12.138807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:55:12.138807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:55:12.138807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:55:12.138807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:55:12.138807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:55:12.138807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:55:12.138807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 639/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:55:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:55:12.139564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96287d-df51-4ae9-b036-66b8e59a52e8 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:12.197815 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:12.237559 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96287d-df51-4ae9-b036-66b8e59a52e8 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:12.268978 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da0183-7a67-4f53-a5e1-41270392ade8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:12.269559 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da0183-7a67-4f53-a5e1-41270392ade8 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:12.269916 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da0183-7a67-4f53-a5e1-41270392ade8 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:12.270189 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da0183-7a67-4f53-a5e1-41270392ade8 None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:12.270857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da0183-7a67-4f53-a5e1-41270392ade8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:55:12.271150 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da0183-7a67-4f53-a5e1-41270392ade8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:12.272561 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da0183-7a67-4f53-a5e1-41270392ade8 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:12.284766 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 633/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:55:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:55:12.290765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2bea3-3d2a-41bf-bff9-ea3c4995df48 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:12.376771 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:12.385884 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2bea3-3d2a-41bf-bff9-ea3c4995df48 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:12.417889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab50cd-7c69-4747-a091-06f847fa7a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:12.418522 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab50cd-7c69-4747-a091-06f847fa7a5b None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:12.418799 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab50cd-7c69-4747-a091-06f847fa7a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:12.419068 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab50cd-7c69-4747-a091-06f847fa7a5b None admin] PATH_INFO: `/v3/projects/f37c835c05924364bcd1530d44f024fe/users/abf9ab5fafe94afdb3ebe98536b5cc3a/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:12.420904 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab50cd-7c69-4747-a091-06f847fa7a5b None admin] RBAC: Authorizing `identity:create_grant(project_id=f37c835c05924364bcd1530d44f024fe, user_id=abf9ab5fafe94afdb3ebe98536b5cc3a, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:12.422342 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab50cd-7c69-4747-a091-06f847fa7a5b None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:12.434415 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 640/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 14 00:55:12 2022] PUT /identity/v3/projects/f37c835c05924364bcd1530d44f024fe/users/abf9ab5fafe94afdb3ebe98536b5cc3a/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 00:55:14.539147 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfddb5f-0d38-47a5-a88b-a6347c08a00d None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:14.539699 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfddb5f-0d38-47a5-a88b-a6347c08a00d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:14.539699 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfddb5f-0d38-47a5-a88b-a6347c08a00d None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:14.541008 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 634/1274] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:55:14.546089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922135b-ddeb-426f-8414-2588e118485c None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:14.546464 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922135b-ddeb-426f-8414-2588e118485c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:14.546629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922135b-ddeb-426f-8414-2588e118485c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:14.564105 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-f922135b-ddeb-426f-8414-2588e118485c None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:55:14.565270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f922135b-ddeb-426f-8414-2588e118485c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:55:14.627958 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 641/1275] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:55:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:55:14.912553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfddb5f-0d38-47a5-a88b-a6347c08a00d None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:15.011779 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfddb5f-0d38-47a5-a88b-a6347c08a00d None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:15.028229 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:15.044711 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187d59e-eb70-421e-8027-34e189e5c981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:15.045326 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187d59e-eb70-421e-8027-34e189e5c981 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:15.045599 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187d59e-eb70-421e-8027-34e189e5c981 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:15.045893 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187d59e-eb70-421e-8027-34e189e5c981 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:15.056066 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c187d59e-eb70-421e-8027-34e189e5c981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 00:55:15.060820 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-c187d59e-eb70-421e-8027-34e189e5c981 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:55:15.060820 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:55:15.060820 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:55:15.060820 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:55:15.060820 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:55:15.060820 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:55:15.060820 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:55:15.060820 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:55:15.060820 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:55:15.060820 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:55:15.060820 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:55:15.060820 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:55:15.060820 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 00:55:15.060820 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 00:55:15.060820 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 00:55:15.060820 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 00:55:15.061957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 00:55:15.061957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 00:55:15.061957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 00:55:15.061957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 00:55:15.061957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:55:15.061957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:55:15.061957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:55:15.061957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:55:15.061957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:55:15.061957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:55:15.061957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:55:15.061957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:55:15.061957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:55:15.061957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:55:15.061957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:55:15.061957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:55:15.062789 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:55:15.062789 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:55:15.062789 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:55:15.062789 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:55:15.062789 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 00:55:15.062789 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 00:55:15.062789 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 00:55:15.062789 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 00:55:15.062789 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 00:55:15.062789 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 00:55:15.062789 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 00:55:15.062789 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:55:15.062789 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 635/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 14 00:55:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:55:15.067801 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922135b-ddeb-426f-8414-2588e118485c None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:15.144797 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:15.163297 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922135b-ddeb-426f-8414-2588e118485c None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:15.196100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ed195-3f31-437c-a2ef-8acd416317d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:15.196692 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ed195-3f31-437c-a2ef-8acd416317d4 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:15.196973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ed195-3f31-437c-a2ef-8acd416317d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:15.197261 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ed195-3f31-437c-a2ef-8acd416317d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:15.197919 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ed195-3f31-437c-a2ef-8acd416317d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:55:15.198223 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ed195-3f31-437c-a2ef-8acd416317d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:15.199578 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ed195-3f31-437c-a2ef-8acd416317d4 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:15.207247 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 642/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 14 00:55:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:55:15.213051 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187d59e-eb70-421e-8027-34e189e5c981 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:15.310568 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187d59e-eb70-421e-8027-34e189e5c981 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:15.342585 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711a34f-0f05-478c-a4fb-7b32867f1e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:15.343189 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711a34f-0f05-478c-a4fb-7b32867f1e5c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:15.343464 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711a34f-0f05-478c-a4fb-7b32867f1e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:15.343733 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711a34f-0f05-478c-a4fb-7b32867f1e5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:15.353934 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711a34f-0f05-478c-a4fb-7b32867f1e5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:15.355360 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711a34f-0f05-478c-a4fb-7b32867f1e5c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:15.369377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-7711a34f-0f05-478c-a4fb-7b32867f1e5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:55:15.369377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:55:15.369377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:55:15.369377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:55:15.369377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:55:15.369377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:55:15.369377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:55:15.369377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:55:15.369377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:55:15.369377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:55:15.369377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:55:15.369377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:55:15.369377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:55:15.369377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:55:15.369377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:55:15.369377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:55:15.370575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:55:15.370575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:55:15.370575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:55:15.370575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:55:15.370575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:55:15.370575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:55:15.370575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:55:15.370575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:55:15.370575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:55:15.370575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:55:15.370575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:55:15.370575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:55:15.370575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:55:15.370575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:55:15.370575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:55:15.370575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:55:15.370575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:55:15.371665 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:55:15.371665 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:55:15.371665 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:55:15.371665 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 636/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:55:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:55:15.376288 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ed195-3f31-437c-a2ef-8acd416317d4 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:15.470805 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ed195-3f31-437c-a2ef-8acd416317d4 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:15.501503 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353fc29-b72a-4424-8133-567fa64bf7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:15.502113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353fc29-b72a-4424-8133-567fa64bf7c9 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:15.502386 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353fc29-b72a-4424-8133-567fa64bf7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:15.502650 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353fc29-b72a-4424-8133-567fa64bf7c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:15.503259 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353fc29-b72a-4424-8133-567fa64bf7c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:55:15.503551 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353fc29-b72a-4424-8133-567fa64bf7c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:15.504881 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353fc29-b72a-4424-8133-567fa64bf7c9 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:15.516402 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 643/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:55:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:55:15.521890 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711a34f-0f05-478c-a4fb-7b32867f1e5c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:15.551899 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:15.619512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711a34f-0f05-478c-a4fb-7b32867f1e5c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:15.651622 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927a500-b601-452f-b5b7-004ffd32343e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:15.652226 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927a500-b601-452f-b5b7-004ffd32343e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:15.652504 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927a500-b601-452f-b5b7-004ffd32343e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:15.652771 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927a500-b601-452f-b5b7-004ffd32343e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:15.660148 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927a500-b601-452f-b5b7-004ffd32343e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:15.661569 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927a500-b601-452f-b5b7-004ffd32343e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:15.672368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-5927a500-b601-452f-b5b7-004ffd32343e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 00:55:15.672368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:55:15.672368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:55:15.672368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:55:15.672368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:55:15.672368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:55:15.672368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:55:15.672368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:55:15.672368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:55:15.672368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:55:15.672368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:55:15.672368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:55:15.672368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 00:55:15.672368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 00:55:15.672368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 00:55:15.672368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 00:55:15.673470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:55:15.673470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:55:15.673470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 00:55:15.673470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:55:15.673470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 00:55:15.673470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 00:55:15.673470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:55:15.673470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:55:15.673470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:55:15.673470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:55:15.673470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:55:15.673470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:55:15.673470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:55:15.673470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:55:15.673470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:55:15.673470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:55:15.673470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:55:15.673470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:55:15.674698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:55:15.674698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:55:15.674698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 00:55:15.674698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 00:55:15.674698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 00:55:15.674698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 00:55:15.674698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 00:55:15.674698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 00:55:15.674698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 00:55:15.674698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:55:15.674698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 637/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:55:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:55:15.679194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353fc29-b72a-4424-8133-567fa64bf7c9 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:15.683511 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:15.775557 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353fc29-b72a-4424-8133-567fa64bf7c9 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:15.807783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefad0b-f9b3-4d3b-a7ba-70852c8e938c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:15.808368 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefad0b-f9b3-4d3b-a7ba-70852c8e938c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:15.808646 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefad0b-f9b3-4d3b-a7ba-70852c8e938c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:15.808916 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefad0b-f9b3-4d3b-a7ba-70852c8e938c None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:15.809621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefad0b-f9b3-4d3b-a7ba-70852c8e938c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:55:15.809950 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefad0b-f9b3-4d3b-a7ba-70852c8e938c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:15.811352 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefad0b-f9b3-4d3b-a7ba-70852c8e938c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:15.827411 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 644/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Sep 14 00:55:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:55:15.833127 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927a500-b601-452f-b5b7-004ffd32343e None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:15.921406 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:15.930934 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927a500-b601-452f-b5b7-004ffd32343e None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:15.962951 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f96f0-6b92-499c-afd6-6aae6895ddc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:15.963538 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f96f0-6b92-499c-afd6-6aae6895ddc9 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:15.963813 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f96f0-6b92-499c-afd6-6aae6895ddc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:15.964079 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f96f0-6b92-499c-afd6-6aae6895ddc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:16.029070 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f96f0-6b92-499c-afd6-6aae6895ddc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:16.030460 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f96f0-6b92-499c-afd6-6aae6895ddc9 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:16.114601 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:16.124784 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 638/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 14 00:55:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 00:55:16.130599 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefad0b-f9b3-4d3b-a7ba-70852c8e938c None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:16.188624 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:16.225514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefad0b-f9b3-4d3b-a7ba-70852c8e938c None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:16.259217 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88094a-99a3-4b7a-ae20-ea025b4389c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:16.259819 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88094a-99a3-4b7a-ae20-ea025b4389c7 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:16.260092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88094a-99a3-4b7a-ae20-ea025b4389c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:16.260358 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88094a-99a3-4b7a-ae20-ea025b4389c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:16.269936 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88094a-99a3-4b7a-ae20-ea025b4389c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:16.271270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88094a-99a3-4b7a-ae20-ea025b4389c7 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:16.285942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-ae88094a-99a3-4b7a-ae20-ea025b4389c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:55:16.285942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:55:16.285942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:55:16.285942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:55:16.285942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:55:16.285942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:55:16.285942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:55:16.285942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:55:16.285942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:55:16.285942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:55:16.285942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:55:16.285942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:55:16.285942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 00:55:16.285942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 00:55:16.285942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 00:55:16.285942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 00:55:16.287160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:55:16.287160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:55:16.287160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:55:16.287160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:55:16.287160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:55:16.287160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:55:16.287160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:55:16.287160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:55:16.287160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:55:16.287160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:55:16.287160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:55:16.287160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:55:16.287160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:55:16.287160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:55:16.287160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:55:16.287160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:55:16.287160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 00:55:16.288252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 00:55:16.288252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 00:55:16.288252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:55:16.288252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 645/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:55:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:55:16.292741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f96f0-6b92-499c-afd6-6aae6895ddc9 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:16.387943 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f96f0-6b92-499c-afd6-6aae6895ddc9 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:16.420242 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd61273-aee0-447c-b561-efb2fd11f777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:16.420827 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd61273-aee0-447c-b561-efb2fd11f777 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:16.421102 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd61273-aee0-447c-b561-efb2fd11f777 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:16.421369 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd61273-aee0-447c-b561-efb2fd11f777 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:16.422025 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd61273-aee0-447c-b561-efb2fd11f777 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:55:16.422323 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd61273-aee0-447c-b561-efb2fd11f777 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:16.423662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd61273-aee0-447c-b561-efb2fd11f777 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:16.434918 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 639/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 14 00:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:55:16.440234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88094a-99a3-4b7a-ae20-ea025b4389c7 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:16.533977 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88094a-99a3-4b7a-ae20-ea025b4389c7 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:16.547020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:16.566368 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec49d9-d233-41e8-9580-3100ed80719f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:16.566963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec49d9-d233-41e8-9580-3100ed80719f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:16.567240 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec49d9-d233-41e8-9580-3100ed80719f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:16.567507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec49d9-d233-41e8-9580-3100ed80719f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:16.574328 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec49d9-d233-41e8-9580-3100ed80719f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:16.575750 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec49d9-d233-41e8-9580-3100ed80719f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:16.586365 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-96ec49d9-d233-41e8-9580-3100ed80719f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:55:16.586365 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:55:16.586365 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:55:16.586365 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:55:16.586365 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:55:16.586365 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:55:16.586365 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:55:16.586365 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:55:16.586365 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:55:16.586365 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:55:16.586365 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:55:16.586365 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:55:16.586365 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 00:55:16.586365 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 00:55:16.586365 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 00:55:16.587251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 00:55:16.587251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:55:16.587251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:55:16.587251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:55:16.587251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:55:16.587251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:55:16.587251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:55:16.587251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:55:16.587251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 14 00:55:16.587251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:55:16.587251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:55:16.587251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:55:16.587251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:55:16.587251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:55:16.587251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:55:16.587251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:55:16.587251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:55:16.588210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 00:55:16.588210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 00:55:16.588210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 00:55:16.588210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 00:55:16.588210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 00:55:16.588210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 00:55:16.588210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 00:55:16.588210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 14 00:55:16.588210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 646/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 14 00:55:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:55:16.593055 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd61273-aee0-447c-b561-efb2fd11f777 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:16.641068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:16.689252 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd61273-aee0-447c-b561-efb2fd11f777 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:16.720886 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a5161-aefb-44ab-91e9-980c596ba0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:16.721471 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a5161-aefb-44ab-91e9-980c596ba0e3 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:16.721747 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a5161-aefb-44ab-91e9-980c596ba0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:16.722042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a5161-aefb-44ab-91e9-980c596ba0e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:16.722717 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a5161-aefb-44ab-91e9-980c596ba0e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:55:16.723016 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a5161-aefb-44ab-91e9-980c596ba0e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:16.724421 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a5161-aefb-44ab-91e9-980c596ba0e3 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:16.736539 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 640/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 14 00:55:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:55:16.742522 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec49d9-d233-41e8-9580-3100ed80719f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:16.838571 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec49d9-d233-41e8-9580-3100ed80719f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:16.872461 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693ba35-7776-4d29-95bb-a321b68d1884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:16.873051 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693ba35-7776-4d29-95bb-a321b68d1884 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:16.873328 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693ba35-7776-4d29-95bb-a321b68d1884 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:16.873598 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693ba35-7776-4d29-95bb-a321b68d1884 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:16.874332 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693ba35-7776-4d29-95bb-a321b68d1884 None admin] RBAC: Adding query filter params (role.id=0d7a36bda723430eae02f10f4c775c96, scope.project.id=f37c835c05924364bcd1530d44f024fe, user.id=abf9ab5fafe94afdb3ebe98536b5cc3a) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:55:16.874640 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693ba35-7776-4d29-95bb-a321b68d1884 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:16.876040 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693ba35-7776-4d29-95bb-a321b68d1884 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:16.881576 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 647/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 14 00:55:16 2022] GET /identity/v3/role_assignments?user.id=abf9ab5fafe94afdb3ebe98536b5cc3a&scope.project.id=f37c835c05924364bcd1530d44f024fe&role.id=0d7a36bda723430eae02f10f4c775c96 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:55:19.013623 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc0aa9-aaa9-4335-8acc-afca9f421fc5 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:19.014118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc0aa9-aaa9-4335-8acc-afca9f421fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:19.014212 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc0aa9-aaa9-4335-8acc-afca9f421fc5 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:19.015511 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 641/1288] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:55:19.020718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e10d9e-5382-488e-8bd8-430ee216d295 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:19.021121 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e10d9e-5382-488e-8bd8-430ee216d295 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:19.021260 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e10d9e-5382-488e-8bd8-430ee216d295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:19.039039 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-04e10d9e-5382-488e-8bd8-430ee216d295 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:55:19.040760 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-04e10d9e-5382-488e-8bd8-430ee216d295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:55:19.068825 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:19.105944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 648/1289] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:55:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:55:19.384105 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc0aa9-aaa9-4335-8acc-afca9f421fc5 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:19.483379 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc0aa9-aaa9-4335-8acc-afca9f421fc5 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:19.493750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:19.517042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c2dd4-4579-4827-935f-03c5beb79e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:19.517658 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c2dd4-4579-4827-935f-03c5beb79e19 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:19.517973 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c2dd4-4579-4827-935f-03c5beb79e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:19.518244 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c2dd4-4579-4827-935f-03c5beb79e19 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:19.518813 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c2dd4-4579-4827-935f-03c5beb79e19 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:19.520170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c2dd4-4579-4827-935f-03c5beb79e19 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:19.529165 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-1d1c2dd4-4579-4827-935f-03c5beb79e19 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 00:55:19.529165 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:55:19.529165 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 00:55:19.529165 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 00:55:19.529165 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 00:55:19.529165 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 00:55:19.529165 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 00:55:19.529165 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:55:19.529165 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 00:55:19.529165 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:55:19.529165 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:55:19.529165 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:55:19.529165 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:55:19.529165 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:55:19.529165 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:55:19.529165 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:55:19.529165 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:55:19.530426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:55:19.530426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:55:19.530426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:55:19.530426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:55:19.530426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:55:19.530426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:55:19.530426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 00:55:19.530426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 00:55:19.530426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 00:55:19.530426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 00:55:19.530426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:55:19.530426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:55:19.530426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:55:19.530426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:55:19.530426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:55:19.530426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:55:19.531848 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:55:19.531848 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:55:19.531848 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:55:19.531848 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:55:19.531848 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:55:19.531848 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:55:19.531848 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:55:19.531848 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:55:19.531848 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:55:19.531848 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:55:19.531848 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 00:55:19.531848 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:55:19.531848 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 00:55:19.531848 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:55:19.531848 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 642/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Sep 14 00:55:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:55:19.536490 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e10d9e-5382-488e-8bd8-430ee216d295 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:19.631166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e10d9e-5382-488e-8bd8-430ee216d295 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:19.663826 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378958ad-4506-4d3a-b402-a107b8bfad71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:19.664358 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378958ad-4506-4d3a-b402-a107b8bfad71 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:19.664663 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378958ad-4506-4d3a-b402-a107b8bfad71 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:19.665431 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378958ad-4506-4d3a-b402-a107b8bfad71 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:19.666071 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378958ad-4506-4d3a-b402-a107b8bfad71 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:55:19.666379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378958ad-4506-4d3a-b402-a107b8bfad71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:19.667727 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378958ad-4506-4d3a-b402-a107b8bfad71 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:19.672396 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 649/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Sep 14 00:55:19 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:55:19.678141 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c2dd4-4579-4827-935f-03c5beb79e19 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:19.791263 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c2dd4-4579-4827-935f-03c5beb79e19 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:19.824538 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49fb103-5b5e-4699-9f1e-99bb6aa760f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:19.825324 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fb103-5b5e-4699-9f1e-99bb6aa760f2 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:19.825923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fb103-5b5e-4699-9f1e-99bb6aa760f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:19.826056 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fb103-5b5e-4699-9f1e-99bb6aa760f2 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:19.826691 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49fb103-5b5e-4699-9f1e-99bb6aa760f2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:55:19.826981 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49fb103-5b5e-4699-9f1e-99bb6aa760f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:19.828352 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49fb103-5b5e-4699-9f1e-99bb6aa760f2 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:19.832883 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 643/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Sep 14 00:55:19 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:55:21.948916 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7bc93-270e-412c-9f7a-2d6a3e425edc None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:21.949502 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7bc93-270e-412c-9f7a-2d6a3e425edc None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:21.949502 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7bc93-270e-412c-9f7a-2d6a3e425edc None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:21.950819 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 650/1293] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:55:21.955846 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1878ce4-f2fc-42b8-92cf-c697ecde6fd5 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:21.956219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1878ce4-f2fc-42b8-92cf-c697ecde6fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:21.956387 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1878ce4-f2fc-42b8-92cf-c697ecde6fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:21.973954 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-f1878ce4-f2fc-42b8-92cf-c697ecde6fd5 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:55:21.975107 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f1878ce4-f2fc-42b8-92cf-c697ecde6fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:55:22.004828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:22.041783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 644/1294] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:55:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:55:22.311249 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7bc93-270e-412c-9f7a-2d6a3e425edc None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:22.341615 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:22.409104 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7bc93-270e-412c-9f7a-2d6a3e425edc None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:22.441113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ef03f-c88b-4514-9a52-cbef0275511d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:22.441695 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ef03f-c88b-4514-9a52-cbef0275511d None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:22.442003 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ef03f-c88b-4514-9a52-cbef0275511d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:22.442274 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ef03f-c88b-4514-9a52-cbef0275511d None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:22.442921 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ef03f-c88b-4514-9a52-cbef0275511d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:22.444263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ef03f-c88b-4514-9a52-cbef0275511d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:22.457430 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 651/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Sep 14 00:55:22 2022] POST /identity/v3/services => generated 246 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:55:24.587860 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acd57a-3c03-4c0f-8214-ced2e008f05c None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:24.588395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acd57a-3c03-4c0f-8214-ced2e008f05c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:24.588395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acd57a-3c03-4c0f-8214-ced2e008f05c None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:24.589717 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 645/1296] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:55:24.595082 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ac215-4a70-4d0e-957f-3a878bed407a None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:24.595532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ac215-4a70-4d0e-957f-3a878bed407a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:24.595628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ac215-4a70-4d0e-957f-3a878bed407a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:24.613881 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e54ac215-4a70-4d0e-957f-3a878bed407a None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:55:24.615056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e54ac215-4a70-4d0e-957f-3a878bed407a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:55:24.682825 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 652/1297] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:55:24 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:55:24.950210 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0acd57a-3c03-4c0f-8214-ced2e008f05c None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:25.048473 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0acd57a-3c03-4c0f-8214-ced2e008f05c None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:25.080987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7550a6-da37-4bfb-ae3d-5530f6111e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:25.081593 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7550a6-da37-4bfb-ae3d-5530f6111e79 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:25.081892 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7550a6-da37-4bfb-ae3d-5530f6111e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:25.082162 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7550a6-da37-4bfb-ae3d-5530f6111e79 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:25.082736 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7550a6-da37-4bfb-ae3d-5530f6111e79 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:25.084091 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7550a6-da37-4bfb-ae3d-5530f6111e79 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:25.093100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-3f7550a6-da37-4bfb-ae3d-5530f6111e79 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 00:55:25.093100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:55:25.093100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 00:55:25.093100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 00:55:25.093100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 00:55:25.093100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 00:55:25.093100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 00:55:25.093100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:55:25.093100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 00:55:25.093100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:55:25.093100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:55:25.093100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:55:25.093100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:55:25.093100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:55:25.093100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:55:25.093100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:55:25.093100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:55:25.094426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:55:25.094426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:55:25.094426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:55:25.094426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:55:25.094426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:55:25.094426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:55:25.094426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 00:55:25.094426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 00:55:25.094426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 00:55:25.094426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 00:55:25.094426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:55:25.094426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:55:25.094426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:55:25.094426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:55:25.094426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:55:25.094426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:55:25.095648 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:55:25.095648 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:55:25.095648 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:55:25.095648 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:55:25.095648 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:55:25.095648 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:55:25.095648 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:55:25.095648 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:55:25.095648 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:55:25.095648 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:55:25.095648 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 00:55:25.095648 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:55:25.095648 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 00:55:25.095648 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:55:25.095648 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 646/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Sep 14 00:55:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:55:25.100169 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ac215-4a70-4d0e-957f-3a878bed407a None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:25.117503 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:25.196209 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ac215-4a70-4d0e-957f-3a878bed407a None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:25.227918 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7d6b6-2115-446e-a9c4-f742d16348b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:25.228503 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7d6b6-2115-446e-a9c4-f742d16348b3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:25.228776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7d6b6-2115-446e-a9c4-f742d16348b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:25.229041 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7d6b6-2115-446e-a9c4-f742d16348b3 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:25.229647 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7d6b6-2115-446e-a9c4-f742d16348b3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:55:25.229973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7d6b6-2115-446e-a9c4-f742d16348b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:25.231309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7d6b6-2115-446e-a9c4-f742d16348b3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:25.236166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 653/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Sep 14 00:55:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:55:25.242021 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7550a6-da37-4bfb-ae3d-5530f6111e79 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:25.272493 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:25.340263 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7550a6-da37-4bfb-ae3d-5530f6111e79 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:25.372389 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81614a3-4e02-46c1-88a9-04f13a7bb665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:25.372976 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81614a3-4e02-46c1-88a9-04f13a7bb665 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:25.373255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81614a3-4e02-46c1-88a9-04f13a7bb665 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:25.373522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81614a3-4e02-46c1-88a9-04f13a7bb665 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:25.374241 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81614a3-4e02-46c1-88a9-04f13a7bb665 None admin] RBAC: Adding query filter params (interface=public, service_id=cbc549528b59462e9e6b51bb5f901af7, region_id=RegionOne) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:55:25.374544 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81614a3-4e02-46c1-88a9-04f13a7bb665 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:25.375890 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81614a3-4e02-46c1-88a9-04f13a7bb665 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:25.380723 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 647/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Sep 14 00:55:25 2022] GET /identity/v3/endpoints?service_id=cbc549528b59462e9e6b51bb5f901af7&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:55:25.386989 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7d6b6-2115-446e-a9c4-f742d16348b3 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:25.464773 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:25.482065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7d6b6-2115-446e-a9c4-f742d16348b3 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:25.514212 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064aee0-3faa-4e11-bc02-303ae069750e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:25.514793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064aee0-3faa-4e11-bc02-303ae069750e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:25.515068 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064aee0-3faa-4e11-bc02-303ae069750e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:25.515335 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064aee0-3faa-4e11-bc02-303ae069750e None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:25.515920 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7064aee0-3faa-4e11-bc02-303ae069750e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:25.517251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7064aee0-3faa-4e11-bc02-303ae069750e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:25.523973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 654/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Sep 14 00:55:25 2022] GET /identity/v3/services => generated 2191 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 00:55:27.667790 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859bff6b-44ca-438f-9007-a7965ac9e873 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:27.668317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859bff6b-44ca-438f-9007-a7965ac9e873 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:27.668317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859bff6b-44ca-438f-9007-a7965ac9e873 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:27.669646 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 648/1302] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:55:27.674699 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ae6a8-ed12-4ff7-82d4-f497d8057a14 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:27.675160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ae6a8-ed12-4ff7-82d4-f497d8057a14 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:27.675265 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ae6a8-ed12-4ff7-82d4-f497d8057a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:27.693167 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-d54ae6a8-ed12-4ff7-82d4-f497d8057a14 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:55:27.694362 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d54ae6a8-ed12-4ff7-82d4-f497d8057a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:55:27.767991 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 655/1303] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:55:27 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 00:55:28.030791 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859bff6b-44ca-438f-9007-a7965ac9e873 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:28.122580 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:28.129364 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859bff6b-44ca-438f-9007-a7965ac9e873 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:28.161535 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d72ceb-0fc7-46ff-8cfc-768b69d13c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:28.162169 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d72ceb-0fc7-46ff-8cfc-768b69d13c46 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:28.162444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d72ceb-0fc7-46ff-8cfc-768b69d13c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:28.162710 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d72ceb-0fc7-46ff-8cfc-768b69d13c46 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:28.163285 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d72ceb-0fc7-46ff-8cfc-768b69d13c46 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:28.165158 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d72ceb-0fc7-46ff-8cfc-768b69d13c46 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:28.173603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-d1d72ceb-0fc7-46ff-8cfc-768b69d13c46 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 00:55:28.173603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:55:28.173603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 00:55:28.173603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 00:55:28.173603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 00:55:28.173603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 00:55:28.173603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 00:55:28.173603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:55:28.173603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 00:55:28.173603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:55:28.173603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 00:55:28.173603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:55:28.173603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 00:55:28.173603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 00:55:28.173603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 00:55:28.173603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 00:55:28.173603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 00:55:28.174661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 00:55:28.174661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 00:55:28.174661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 00:55:28.174661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 00:55:28.174661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 00:55:28.174661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 00:55:28.174661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 00:55:28.174661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 00:55:28.174661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 00:55:28.174661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 00:55:28.174661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 00:55:28.174661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 00:55:28.174661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 00:55:28.174661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 00:55:28.174661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 00:55:28.174661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 00:55:28.175503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 00:55:28.175503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 14 00:55:28.175503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 00:55:28.175503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 14 00:55:28.175503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 00:55:28.175503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 00:55:28.175503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 00:55:28.175503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 14 00:55:28.175503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 00:55:28.175503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 14 00:55:28.175503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 00:55:28.175503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 00:55:28.175503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 00:55:28.175503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 14 00:55:28.175503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 649/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Sep 14 00:55:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 00:55:28.180675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ae6a8-ed12-4ff7-82d4-f497d8057a14 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:28.252843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:28.274670 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ae6a8-ed12-4ff7-82d4-f497d8057a14 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:28.307256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d959a1-3fda-4de4-b6b9-eba1bbe5a20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:28.307844 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d959a1-3fda-4de4-b6b9-eba1bbe5a20d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:28.308117 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d959a1-3fda-4de4-b6b9-eba1bbe5a20d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:28.308381 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d959a1-3fda-4de4-b6b9-eba1bbe5a20d None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:28.308991 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d959a1-3fda-4de4-b6b9-eba1bbe5a20d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 00:55:28.309285 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d959a1-3fda-4de4-b6b9-eba1bbe5a20d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:28.310645 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d959a1-3fda-4de4-b6b9-eba1bbe5a20d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:28.315499 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 656/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Sep 14 00:55:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 00:55:28.321006 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d72ceb-0fc7-46ff-8cfc-768b69d13c46 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:55:28.416246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d72ceb-0fc7-46ff-8cfc-768b69d13c46 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:55:28.449176 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7ddf0-16f5-45fb-9cf1-37da8029737e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:55:28.449759 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7ddf0-16f5-45fb-9cf1-37da8029737e None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:55:28.450068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7ddf0-16f5-45fb-9cf1-37da8029737e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:55:28.450337 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7ddf0-16f5-45fb-9cf1-37da8029737e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:55:28.450998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7ddf0-16f5-45fb-9cf1-37da8029737e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:55:28.452333 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7ddf0-16f5-45fb-9cf1-37da8029737e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:55:28.470961 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 650/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 00:55:28 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 00:55:38.312730 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=30 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:55:38.468141 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:56:32.126743 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47020f8f-acd9-40d3-9666-9abcf98e1e10 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:32.127203 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47020f8f-acd9-40d3-9666-9abcf98e1e10 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:32.127490 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47020f8f-acd9-40d3-9666-9abcf98e1e10 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:32.134888 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae205c-c8ff-4531-ba0e-0454dad25648 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:32.135293 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae205c-c8ff-4531-ba0e-0454dad25648 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:32.135611 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae205c-c8ff-4531-ba0e-0454dad25648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:32.137838 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 657/1307] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:56:32 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:56:32.247260 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-45ae205c-c8ff-4531-ba0e-0454dad25648 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:56:32.248651 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-45ae205c-c8ff-4531-ba0e-0454dad25648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:56:32.361930 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 651/1308] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:56:32.659013 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76a0e2-4244-41cf-92b3-ebcbdd98b3ee None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:32.659374 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76a0e2-4244-41cf-92b3-ebcbdd98b3ee None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:32.659575 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76a0e2-4244-41cf-92b3-ebcbdd98b3ee None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:32.661075 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 658/1309] 10.222.0.20 () {54 vars in 965 bytes} [Wed Sep 14 00:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:56:32.667254 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c1608-0050-429c-9041-86bab4294682 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:32.667539 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c1608-0050-429c-9041-86bab4294682 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:32.667810 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c1608-0050-429c-9041-86bab4294682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:32.746234 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-819c1608-0050-429c-9041-86bab4294682 None None] MFA Rules not processed for user `b4444b17075f4224a4da1ef501fd4eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:56:32.747432 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-819c1608-0050-429c-9041-86bab4294682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:56:32.768521 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:56:32.827559 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 652/1310] 10.222.0.20 () {58 vars in 1062 bytes} [Wed Sep 14 00:56:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:56:32.836841 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76a0e2-4244-41cf-92b3-ebcbdd98b3ee None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:56:32.838611 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5b76a0e2-4244-41cf-92b3-ebcbdd98b3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:56:32.957463 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76a0e2-4244-41cf-92b3-ebcbdd98b3ee None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:56:33.039235 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb36634-c677-43e2-8c90-8df6df40d096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:56:33.039941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb36634-c677-43e2-8c90-8df6df40d096 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:33.040288 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb36634-c677-43e2-8c90-8df6df40d096 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:33.040627 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb36634-c677-43e2-8c90-8df6df40d096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:33.042349 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-cdb36634-c677-43e2-8c90-8df6df40d096 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:56:33.101754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:56:33.160158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb36634-c677-43e2-8c90-8df6df40d096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:56:33.161924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb36634-c677-43e2-8c90-8df6df40d096 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:56:33.182286 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 659/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:56:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:56:35.710166 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f5dd2-4c85-4b4b-baf3-f8de6f57618a None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:35.710719 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f5dd2-4c85-4b4b-baf3-f8de6f57618a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:35.710719 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f5dd2-4c85-4b4b-baf3-f8de6f57618a None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:35.711956 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 653/1312] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:56:35.717178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba161e16-29c1-4f89-a706-6d0ffad71c5b None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:35.717597 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba161e16-29c1-4f89-a706-6d0ffad71c5b None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:35.717706 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba161e16-29c1-4f89-a706-6d0ffad71c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:35.796734 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ba161e16-29c1-4f89-a706-6d0ffad71c5b None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:56:35.798019 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ba161e16-29c1-4f89-a706-6d0ffad71c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:56:35.892099 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 660/1313] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:56:36.177338 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f5dd2-4c85-4b4b-baf3-f8de6f57618a None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:56:36.179255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-910f5dd2-4c85-4b4b-baf3-f8de6f57618a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:56:36.281032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f5dd2-4c85-4b4b-baf3-f8de6f57618a None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:56:36.352489 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:56:36.354985 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522734c-6793-4942-8319-d4637f156542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:56:36.355663 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522734c-6793-4942-8319-d4637f156542 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:36.356113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522734c-6793-4942-8319-d4637f156542 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:36.356532 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522734c-6793-4942-8319-d4637f156542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:36.358412 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8522734c-6793-4942-8319-d4637f156542 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:56:36.467369 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522734c-6793-4942-8319-d4637f156542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:56:36.468792 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522734c-6793-4942-8319-d4637f156542 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:56:36.488520 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 654/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:56:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:56:38.968256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df50049-80d5-4d54-b2a0-8ec5bceec426 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:38.968797 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df50049-80d5-4d54-b2a0-8ec5bceec426 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:38.968797 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df50049-80d5-4d54-b2a0-8ec5bceec426 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:38.970176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 661/1315] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:56:38.975957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc542777-a91c-4e45-ab07-556689b338a5 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:38.976378 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc542777-a91c-4e45-ab07-556689b338a5 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:38.976486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc542777-a91c-4e45-ab07-556689b338a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:39.041940 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-fc542777-a91c-4e45-ab07-556689b338a5 None None] MFA Rules not processed for user `4fde697280c34660bcd0b9ec24ba1a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:56:39.043137 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fc542777-a91c-4e45-ab07-556689b338a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:56:39.093286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:56:39.137347 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 655/1316] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:56:38 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:56:39.417530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df50049-80d5-4d54-b2a0-8ec5bceec426 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:56:39.419110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8df50049-80d5-4d54-b2a0-8ec5bceec426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:56:39.429984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:56:39.520730 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df50049-80d5-4d54-b2a0-8ec5bceec426 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:56:39.594997 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95c271-30a5-4d28-a67b-071e55401e12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:56:39.595594 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95c271-30a5-4d28-a67b-071e55401e12 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:39.595870 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95c271-30a5-4d28-a67b-071e55401e12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:39.596140 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95c271-30a5-4d28-a67b-071e55401e12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:39.597756 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5a95c271-30a5-4d28-a67b-071e55401e12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:56:39.657810 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:56:39.704137 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95c271-30a5-4d28-a67b-071e55401e12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:56:39.705549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95c271-30a5-4d28-a67b-071e55401e12 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:56:39.726089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 662/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:56:39 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:56:42.392085 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe212fc1-62c0-4995-98da-98b6076ccf24 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:42.392604 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe212fc1-62c0-4995-98da-98b6076ccf24 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:42.392604 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe212fc1-62c0-4995-98da-98b6076ccf24 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:42.393927 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 656/1318] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:56:42.399862 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e5160-ee1e-4962-adf8-2bf4385fc72f None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:42.400290 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e5160-ee1e-4962-adf8-2bf4385fc72f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:42.400400 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e5160-ee1e-4962-adf8-2bf4385fc72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:42.464742 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-db3e5160-ee1e-4962-adf8-2bf4385fc72f None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:56:42.465969 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-db3e5160-ee1e-4962-adf8-2bf4385fc72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:56:42.561579 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 663/1319] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:56:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:56:42.849064 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe212fc1-62c0-4995-98da-98b6076ccf24 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:56:42.850638 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fe212fc1-62c0-4995-98da-98b6076ccf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:56:42.952431 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe212fc1-62c0-4995-98da-98b6076ccf24 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:56:43.025712 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086f0d1-dcf4-4bb3-8385-75bfd6837867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:56:43.026333 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086f0d1-dcf4-4bb3-8385-75bfd6837867 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:43.026610 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086f0d1-dcf4-4bb3-8385-75bfd6837867 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:43.026875 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086f0d1-dcf4-4bb3-8385-75bfd6837867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:43.028440 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-2086f0d1-dcf4-4bb3-8385-75bfd6837867 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:56:43.035484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:56:43.134342 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086f0d1-dcf4-4bb3-8385-75bfd6837867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:56:43.135682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086f0d1-dcf4-4bb3-8385-75bfd6837867 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:56:43.153432 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 657/1320] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:56:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:56:45.914641 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de78d5b-52ab-4ca5-8de9-dc19bb9987d6 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:45.915204 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de78d5b-52ab-4ca5-8de9-dc19bb9987d6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:45.915204 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de78d5b-52ab-4ca5-8de9-dc19bb9987d6 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:45.916536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 664/1321] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:56:45.921922 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8669341-32bb-46c5-8f6c-56102c89fb00 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:45.922371 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8669341-32bb-46c5-8f6c-56102c89fb00 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:45.922464 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8669341-32bb-46c5-8f6c-56102c89fb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:45.993065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-a8669341-32bb-46c5-8f6c-56102c89fb00 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:56:45.994322 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a8669341-32bb-46c5-8f6c-56102c89fb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:56:46.057791 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:56:46.100383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 658/1322] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:56:46.379984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de78d5b-52ab-4ca5-8de9-dc19bb9987d6 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:56:46.381628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-9de78d5b-52ab-4ca5-8de9-dc19bb9987d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:56:46.402007 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:56:46.484780 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de78d5b-52ab-4ca5-8de9-dc19bb9987d6 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:56:46.558895 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4af4a4-0a93-46d9-a0f1-10a28b0a7466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:56:46.559492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4af4a4-0a93-46d9-a0f1-10a28b0a7466 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:46.559766 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4af4a4-0a93-46d9-a0f1-10a28b0a7466 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:46.560030 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4af4a4-0a93-46d9-a0f1-10a28b0a7466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:46.561607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3a4af4a4-0a93-46d9-a0f1-10a28b0a7466 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:56:46.631793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:56:46.671038 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4af4a4-0a93-46d9-a0f1-10a28b0a7466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:56:46.672468 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4af4a4-0a93-46d9-a0f1-10a28b0a7466 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:56:46.690314 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 665/1323] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:56:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:56:48.895516 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca305bd9-65f0-4686-b8d0-958f5eb71da0 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:48.896074 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca305bd9-65f0-4686-b8d0-958f5eb71da0 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:48.896074 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca305bd9-65f0-4686-b8d0-958f5eb71da0 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:48.897417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 659/1324] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:56:48.902576 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d63f4f-bce8-4a7b-ae3c-3b4e85222823 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:48.903006 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d63f4f-bce8-4a7b-ae3c-3b4e85222823 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:48.903253 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d63f4f-bce8-4a7b-ae3c-3b4e85222823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:48.970307 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-29d63f4f-bce8-4a7b-ae3c-3b4e85222823 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:56:48.971513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-29d63f4f-bce8-4a7b-ae3c-3b4e85222823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:56:49.077849 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 666/1325] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:56:49.366040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca305bd9-65f0-4686-b8d0-958f5eb71da0 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:56:49.367567 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ca305bd9-65f0-4686-b8d0-958f5eb71da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:56:49.471010 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca305bd9-65f0-4686-b8d0-958f5eb71da0 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:56:49.545444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be15e8-9c2f-411e-b6df-0ee858f1df6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:56:49.546068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be15e8-9c2f-411e-b6df-0ee858f1df6e service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:49.546339 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be15e8-9c2f-411e-b6df-0ee858f1df6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:49.546602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be15e8-9c2f-411e-b6df-0ee858f1df6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:49.548160 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a8be15e8-9c2f-411e-b6df-0ee858f1df6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:56:49.565862 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:56:49.656993 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be15e8-9c2f-411e-b6df-0ee858f1df6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:56:49.658372 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be15e8-9c2f-411e-b6df-0ee858f1df6e service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:56:49.677363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 660/1326] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:56:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:56:51.958464 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a2938-b701-4e62-bcc9-acd84b8afd8a None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:51.958981 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a2938-b701-4e62-bcc9-acd84b8afd8a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:51.958981 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a2938-b701-4e62-bcc9-acd84b8afd8a None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:51.960320 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 667/1327] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:56:51.965701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a481852-4d69-4953-805d-8dadc901e66e None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:51.966172 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a481852-4d69-4953-805d-8dadc901e66e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:51.966284 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a481852-4d69-4953-805d-8dadc901e66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:52.034641 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-3a481852-4d69-4953-805d-8dadc901e66e None None] MFA Rules not processed for user `4fde697280c34660bcd0b9ec24ba1a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:56:52.035828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3a481852-4d69-4953-805d-8dadc901e66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:56:52.098322 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:56:52.131696 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 661/1328] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:56:51 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:56:52.415009 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a2938-b701-4e62-bcc9-acd84b8afd8a None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:56:52.416694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6e7a2938-b701-4e62-bcc9-acd84b8afd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:56:52.450395 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:56:52.523372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a2938-b701-4e62-bcc9-acd84b8afd8a None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:56:52.596414 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1916f-fc64-46fd-aac8-c2883543c527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:56:52.597016 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1916f-fc64-46fd-aac8-c2883543c527 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:52.597293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1916f-fc64-46fd-aac8-c2883543c527 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:52.597562 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1916f-fc64-46fd-aac8-c2883543c527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:52.599191 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-26e1916f-fc64-46fd-aac8-c2883543c527 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:56:52.695463 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:56:52.728525 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1916f-fc64-46fd-aac8-c2883543c527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:56:52.730006 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1916f-fc64-46fd-aac8-c2883543c527 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:56:52.748970 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 668/1329] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:56:52 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:56:55.149640 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42bb08-eeeb-4a16-beba-b84dd6adc319 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:55.150208 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42bb08-eeeb-4a16-beba-b84dd6adc319 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:55.150301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42bb08-eeeb-4a16-beba-b84dd6adc319 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:55.151580 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 662/1330] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:56:55.157116 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa84800-e62c-4c0a-ac2a-f0bf8a9a7027 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:55.157545 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa84800-e62c-4c0a-ac2a-f0bf8a9a7027 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:55.157688 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa84800-e62c-4c0a-ac2a-f0bf8a9a7027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:55.221623 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-0fa84800-e62c-4c0a-ac2a-f0bf8a9a7027 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:56:55.222857 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0fa84800-e62c-4c0a-ac2a-f0bf8a9a7027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:56:55.319319 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 669/1331] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:56:55.604958 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42bb08-eeeb-4a16-beba-b84dd6adc319 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:56:55.606542 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8b42bb08-eeeb-4a16-beba-b84dd6adc319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:56:55.707265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42bb08-eeeb-4a16-beba-b84dd6adc319 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:56:55.779137 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1244e-3ce0-47f2-98a4-88280448c02b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:56:55.779725 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1244e-3ce0-47f2-98a4-88280448c02b service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:55.779994 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1244e-3ce0-47f2-98a4-88280448c02b service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:55.780255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1244e-3ce0-47f2-98a4-88280448c02b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:55.782103 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-51c1244e-3ce0-47f2-98a4-88280448c02b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:56:55.809594 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:56:55.890178 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1244e-3ce0-47f2-98a4-88280448c02b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:56:55.891564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1244e-3ce0-47f2-98a4-88280448c02b service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:56:55.909294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 663/1332] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:56:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:56:58.131147 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77776e05-9577-45ea-b9c4-c051458785e4 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:58.131763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77776e05-9577-45ea-b9c4-c051458785e4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:58.131763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77776e05-9577-45ea-b9c4-c051458785e4 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:58.133061 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 670/1333] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:56:58.138403 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3702ee7-d023-481c-91b0-5027f930dfb6 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:58.138829 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3702ee7-d023-481c-91b0-5027f930dfb6 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:58.138970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3702ee7-d023-481c-91b0-5027f930dfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:58.202997 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-b3702ee7-d023-481c-91b0-5027f930dfb6 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:56:58.204188 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b3702ee7-d023-481c-91b0-5027f930dfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:56:58.276349 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:56:58.298557 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 664/1334] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:56:58.582628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77776e05-9577-45ea-b9c4-c051458785e4 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:56:58.584354 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-77776e05-9577-45ea-b9c4-c051458785e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:56:58.623289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:56:58.688628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77776e05-9577-45ea-b9c4-c051458785e4 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:56:58.760411 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a35b39-5a45-4194-b0fe-323a0b74b0bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:56:58.761006 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a35b39-5a45-4194-b0fe-323a0b74b0bb service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:56:58.761279 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a35b39-5a45-4194-b0fe-323a0b74b0bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:56:58.761542 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a35b39-5a45-4194-b0fe-323a0b74b0bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:56:58.763140 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-77a35b39-5a45-4194-b0fe-323a0b74b0bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:56:58.844115 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:56:58.870025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a35b39-5a45-4194-b0fe-323a0b74b0bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:56:58.871449 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a35b39-5a45-4194-b0fe-323a0b74b0bb service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:56:58.889440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 671/1335] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:56:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:57:01.383004 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb36d5-4699-48b8-8ff4-3a0b49b3d593 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:01.383558 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb36d5-4699-48b8-8ff4-3a0b49b3d593 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:01.383558 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb36d5-4699-48b8-8ff4-3a0b49b3d593 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:01.384864 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 665/1336] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:57:01.389916 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cc765-8209-4ade-bf11-0524e1b3eda3 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:01.390361 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cc765-8209-4ade-bf11-0524e1b3eda3 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:01.390471 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cc765-8209-4ade-bf11-0524e1b3eda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:01.454325 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-b51cc765-8209-4ade-bf11-0524e1b3eda3 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:57:01.455533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b51cc765-8209-4ade-bf11-0524e1b3eda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:01.549420 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 672/1337] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:57:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:57:01.853525 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9019aa-ca37-4510-84f7-3d6691bdcb90 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:01.853819 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9019aa-ca37-4510-84f7-3d6691bdcb90 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:01.854115 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9019aa-ca37-4510-84f7-3d6691bdcb90 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:01.855445 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 666/1338] 10.222.0.20 () {54 vars in 965 bytes} [Wed Sep 14 00:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:57:01.861291 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215ebd2-75ba-4bbf-96f6-14eb1a11b497 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:01.861574 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215ebd2-75ba-4bbf-96f6-14eb1a11b497 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:01.861879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215ebd2-75ba-4bbf-96f6-14eb1a11b497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:01.916821 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:01.938388 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-5215ebd2-75ba-4bbf-96f6-14eb1a11b497 None None] MFA Rules not processed for user `b4444b17075f4224a4da1ef501fd4eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:57:01.939604 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5215ebd2-75ba-4bbf-96f6-14eb1a11b497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:02.014383 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 673/1339] 10.222.0.20 () {58 vars in 1062 bytes} [Wed Sep 14 00:57:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:57:02.024084 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9019aa-ca37-4510-84f7-3d6691bdcb90 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:57:02.025600 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9e9019aa-ca37-4510-84f7-3d6691bdcb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:02.127691 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9019aa-ca37-4510-84f7-3d6691bdcb90 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:57:02.199607 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ee93b-c8f5-4cc6-8da4-04010e3a83d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:57:02.200194 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ee93b-c8f5-4cc6-8da4-04010e3a83d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:02.200462 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ee93b-c8f5-4cc6-8da4-04010e3a83d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:02.200723 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ee93b-c8f5-4cc6-8da4-04010e3a83d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:02.202318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-0c9ee93b-c8f5-4cc6-8da4-04010e3a83d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:02.236612 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:02.310902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ee93b-c8f5-4cc6-8da4-04010e3a83d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:57:02.312329 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ee93b-c8f5-4cc6-8da4-04010e3a83d5 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:57:02.330839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 667/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:57:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:57:06.922210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8c401-2a93-4b6d-ac0f-ce5ad0231cdc None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:06.922742 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8c401-2a93-4b6d-ac0f-ce5ad0231cdc None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:06.922742 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8c401-2a93-4b6d-ac0f-ce5ad0231cdc None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:06.924224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 674/1341] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:57:06.930293 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033a733-2014-4613-a1c1-b66eab39d7a0 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:06.930766 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033a733-2014-4613-a1c1-b66eab39d7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:06.930867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033a733-2014-4613-a1c1-b66eab39d7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:07.005931 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-f033a733-2014-4613-a1c1-b66eab39d7a0 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:57:07.007140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f033a733-2014-4613-a1c1-b66eab39d7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:07.095649 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:07.107687 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 668/1342] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:57:07.391783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8c401-2a93-4b6d-ac0f-ce5ad0231cdc None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:57:07.393332 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-79d8c401-2a93-4b6d-ac0f-ce5ad0231cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:07.495962 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8c401-2a93-4b6d-ac0f-ce5ad0231cdc None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:57:07.535053 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:07.571405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f51d7c-c1d9-431a-a7b6-f099468b30ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:57:07.572003 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f51d7c-c1d9-431a-a7b6-f099468b30ae service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:07.572277 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f51d7c-c1d9-431a-a7b6-f099468b30ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:07.572542 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f51d7c-c1d9-431a-a7b6-f099468b30ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:07.574144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c0f51d7c-c1d9-431a-a7b6-f099468b30ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:07.697170 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f51d7c-c1d9-431a-a7b6-f099468b30ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:57:07.698624 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f51d7c-c1d9-431a-a7b6-f099468b30ae service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:57:07.716822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 675/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:57:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:57:10.507917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f8135-3a42-45f3-9b1d-9feb75792ad6 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:10.508484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f8135-3a42-45f3-9b1d-9feb75792ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:10.508484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f8135-3a42-45f3-9b1d-9feb75792ad6 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:10.509839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 669/1344] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:57:10.515081 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722a10c-5ca7-4064-89ea-10667c0f6921 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:10.515512 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722a10c-5ca7-4064-89ea-10667c0f6921 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:10.515646 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722a10c-5ca7-4064-89ea-10667c0f6921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:10.580954 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-b722a10c-5ca7-4064-89ea-10667c0f6921 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:57:10.582188 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b722a10c-5ca7-4064-89ea-10667c0f6921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:10.600135 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:10.682982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 676/1345] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:57:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:57:10.979528 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f8135-3a42-45f3-9b1d-9feb75792ad6 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:57:10.981126 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ca7f8135-3a42-45f3-9b1d-9feb75792ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:11.090558 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f8135-3a42-45f3-9b1d-9feb75792ad6 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:57:11.166103 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a58557-9fb1-4d92-90a1-19b230fc867e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:57:11.166704 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a58557-9fb1-4d92-90a1-19b230fc867e service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:11.166978 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a58557-9fb1-4d92-90a1-19b230fc867e service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:11.167246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a58557-9fb1-4d92-90a1-19b230fc867e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:11.168829 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b8a58557-9fb1-4d92-90a1-19b230fc867e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:11.211306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:11.277925 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a58557-9fb1-4d92-90a1-19b230fc867e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:57:11.279370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a58557-9fb1-4d92-90a1-19b230fc867e service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:57:11.298652 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 670/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:57:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:57:15.388567 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2c60d-3879-4c89-8f8b-8b8c6d9a566c None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:15.389002 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2c60d-3879-4c89-8f8b-8b8c6d9a566c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:15.389270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2c60d-3879-4c89-8f8b-8b8c6d9a566c None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:15.394558 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 677/1347] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:57:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:57:15.396925 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac2117-8780-47c7-b576-3967125e55d3 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:15.397371 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac2117-8780-47c7-b576-3967125e55d3 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:15.397460 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac2117-8780-47c7-b576-3967125e55d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:15.473221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-37ac2117-8780-47c7-b576-3967125e55d3 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:57:15.474603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-37ac2117-8780-47c7-b576-3967125e55d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:15.578905 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:15.581392 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 671/1348] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:57:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:57:15.871264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2c60d-3879-4c89-8f8b-8b8c6d9a566c None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:57:15.872800 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e7d2c60d-3879-4c89-8f8b-8b8c6d9a566c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:15.980706 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2c60d-3879-4c89-8f8b-8b8c6d9a566c None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:57:16.145981 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:16.171678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6888629-d38f-4f52-9b8d-15dacb3b8a9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:57:16.172268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6888629-d38f-4f52-9b8d-15dacb3b8a9f service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:16.172537 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6888629-d38f-4f52-9b8d-15dacb3b8a9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:16.172801 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6888629-d38f-4f52-9b8d-15dacb3b8a9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:16.174602 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a6888629-d38f-4f52-9b8d-15dacb3b8a9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:16.281283 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6888629-d38f-4f52-9b8d-15dacb3b8a9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:57:16.283014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6888629-d38f-4f52-9b8d-15dacb3b8a9f service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:57:16.302958 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 678/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:57:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:57:21.176061 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e74c8e-90c9-4be1-b75a-bb36bc5c74d5 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:21.177038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e74c8e-90c9-4be1-b75a-bb36bc5c74d5 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:21.177310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e74c8e-90c9-4be1-b75a-bb36bc5c74d5 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:21.179305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 672/1350] 10.222.0.20 () {54 vars in 921 bytes} [Wed Sep 14 00:57:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:57:21.194661 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c63cc3-298b-41d8-b106-495cfa8c4d19 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:21.195084 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c63cc3-298b-41d8-b106-495cfa8c4d19 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:21.195264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c63cc3-298b-41d8-b106-495cfa8c4d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:21.340127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-42c63cc3-298b-41d8-b106-495cfa8c4d19 None None] MFA Rules not processed for user `abf9ab5fafe94afdb3ebe98536b5cc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:57:21.341612 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-42c63cc3-298b-41d8-b106-495cfa8c4d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:21.360735 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:21.479388 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 679/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Sep 14 00:57:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:57:25.554402 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c971ffb-4fcc-4057-b4fd-0a8311c11659 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:25.554920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c971ffb-4fcc-4057-b4fd-0a8311c11659 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:25.555133 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c971ffb-4fcc-4057-b4fd-0a8311c11659 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:25.556548 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 673/1352] 10.222.0.20 () {54 vars in 921 bytes} [Wed Sep 14 00:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:57:25.562277 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f146e5-a5ae-42c3-9bb4-7ebcf4f30e37 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:25.562687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f146e5-a5ae-42c3-9bb4-7ebcf4f30e37 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:25.562927 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f146e5-a5ae-42c3-9bb4-7ebcf4f30e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:25.647259 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-d5f146e5-a5ae-42c3-9bb4-7ebcf4f30e37 None None] MFA Rules not processed for user `abf9ab5fafe94afdb3ebe98536b5cc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:57:25.649343 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d5f146e5-a5ae-42c3-9bb4-7ebcf4f30e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:25.730812 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:25.771282 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 680/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Sep 14 00:57:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:57:27.188711 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2c1c9-98fa-496a-8eb6-2afc7c05aa7b None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:27.189280 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2c1c9-98fa-496a-8eb6-2afc7c05aa7b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:27.189280 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2c1c9-98fa-496a-8eb6-2afc7c05aa7b None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:27.190601 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 674/1354] 10.222.0.20 () {54 vars in 921 bytes} [Wed Sep 14 00:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:57:27.196123 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df31d3-6105-43b7-9677-d02b0b30ceb0 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:27.196541 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df31d3-6105-43b7-9677-d02b0b30ceb0 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:27.196866 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df31d3-6105-43b7-9677-d02b0b30ceb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:27.275938 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-62df31d3-6105-43b7-9677-d02b0b30ceb0 None None] MFA Rules not processed for user `abf9ab5fafe94afdb3ebe98536b5cc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:57:27.277160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-62df31d3-6105-43b7-9677-d02b0b30ceb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:27.383155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 681/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Sep 14 00:57:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:57:30.992763 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31352117-701a-44f7-85fc-f9c59985cc8f None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:30.993648 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31352117-701a-44f7-85fc-f9c59985cc8f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:30.994098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31352117-701a-44f7-85fc-f9c59985cc8f None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:30.995840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 675/1356] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:57:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:57:31.001523 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9224df-29ca-4c1a-806c-c24625a1aa45 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:31.002384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9224df-29ca-4c1a-806c-c24625a1aa45 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:31.002821 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9224df-29ca-4c1a-806c-c24625a1aa45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:31.044317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:31.083145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ab9224df-29ca-4c1a-806c-c24625a1aa45 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:57:31.084606 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ab9224df-29ca-4c1a-806c-c24625a1aa45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:31.188251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 682/1357] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 00:57:31.505625 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aacc47-f995-409c-9129-58b9841951f0 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:31.506425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aacc47-f995-409c-9129-58b9841951f0 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:31.507028 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aacc47-f995-409c-9129-58b9841951f0 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:31.509113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 676/1358] 10.222.0.20 () {54 vars in 962 bytes} [Wed Sep 14 00:57:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:57:31.514930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c29a47-b83f-4610-a50d-eaf30df9bd48 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:31.515384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c29a47-b83f-4610-a50d-eaf30df9bd48 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:31.515830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c29a47-b83f-4610-a50d-eaf30df9bd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:31.599162 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-88c29a47-b83f-4610-a50d-eaf30df9bd48 None None] MFA Rules not processed for user `c05caac9e8b9498583780306887734be`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:57:31.600604 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-88c29a47-b83f-4610-a50d-eaf30df9bd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:31.650216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:31.728082 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 683/1359] 10.222.0.20 () {58 vars in 1059 bytes} [Wed Sep 14 00:57:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 00:57:31.740801 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aacc47-f995-409c-9129-58b9841951f0 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:57:31.742709 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-58aacc47-f995-409c-9129-58b9841951f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:31.904012 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aacc47-f995-409c-9129-58b9841951f0 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:57:31.989764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:32.036601 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dece54d-a1e5-4dd4-beb6-94dd82fb4d08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:57:32.037293 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dece54d-a1e5-4dd4-beb6-94dd82fb4d08 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:32.037572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dece54d-a1e5-4dd4-beb6-94dd82fb4d08 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:32.037751 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dece54d-a1e5-4dd4-beb6-94dd82fb4d08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:32.039335 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3dece54d-a1e5-4dd4-beb6-94dd82fb4d08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:32.141407 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dece54d-a1e5-4dd4-beb6-94dd82fb4d08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:57:32.143044 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dece54d-a1e5-4dd4-beb6-94dd82fb4d08 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:57:32.164973 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 677/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:57:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:57:34.567290 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7791af6-386a-43ad-9453-b8feed9e3311 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:34.567942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7791af6-386a-43ad-9453-b8feed9e3311 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:34.567942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7791af6-386a-43ad-9453-b8feed9e3311 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:34.574501 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188256c-552e-4008-8038-458dcc6e2fec None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:34.575135 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188256c-552e-4008-8038-458dcc6e2fec None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:34.575135 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188256c-552e-4008-8038-458dcc6e2fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:34.579474 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 684/1361] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:57:34 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:57:34.644468 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-5188256c-552e-4008-8038-458dcc6e2fec None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:57:34.646590 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5188256c-552e-4008-8038-458dcc6e2fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:34.687060 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:34.757967 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 678/1362] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 00:57:35.042073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7791af6-386a-43ad-9453-b8feed9e3311 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:57:35.043827 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d7791af6-386a-43ad-9453-b8feed9e3311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:35.236298 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7791af6-386a-43ad-9453-b8feed9e3311 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:57:35.250425 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:35.371211 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe3591-8897-4c65-ac11-5c5884768ec4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:57:35.371815 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe3591-8897-4c65-ac11-5c5884768ec4 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:35.372091 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe3591-8897-4c65-ac11-5c5884768ec4 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:35.372366 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe3591-8897-4c65-ac11-5c5884768ec4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:35.374093 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-dabe3591-8897-4c65-ac11-5c5884768ec4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:35.465171 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe3591-8897-4c65-ac11-5c5884768ec4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:57:35.466704 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe3591-8897-4c65-ac11-5c5884768ec4 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:57:35.484455 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 685/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:57:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:57:37.978270 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12f342-38ee-45ac-8b6f-db6ae727da32 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:37.978807 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12f342-38ee-45ac-8b6f-db6ae727da32 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:37.978807 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12f342-38ee-45ac-8b6f-db6ae727da32 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:37.980120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 679/1364] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:57:37.985982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6812b-7281-4297-a3bf-aaf0d062b408 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:37.986405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6812b-7281-4297-a3bf-aaf0d062b408 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:37.986580 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6812b-7281-4297-a3bf-aaf0d062b408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:38.003090 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:38.061539 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-3df6812b-7281-4297-a3bf-aaf0d062b408 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:57:38.062917 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3df6812b-7281-4297-a3bf-aaf0d062b408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:38.164810 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 686/1365] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:57:38.454987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58bb7f-b877-4554-ae78-9908c808386c None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:38.455346 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58bb7f-b877-4554-ae78-9908c808386c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:38.455694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58bb7f-b877-4554-ae78-9908c808386c None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:38.457125 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 680/1366] 10.222.0.20 () {54 vars in 962 bytes} [Wed Sep 14 00:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:57:38.463037 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d21a0-887d-4224-803b-0de23d60e0d3 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:38.463416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d21a0-887d-4224-803b-0de23d60e0d3 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:38.463763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d21a0-887d-4224-803b-0de23d60e0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:38.548913 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-8c7d21a0-887d-4224-803b-0de23d60e0d3 None None] MFA Rules not processed for user `c05caac9e8b9498583780306887734be`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:57:38.550195 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8c7d21a0-887d-4224-803b-0de23d60e0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:38.593565 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:38.681030 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 687/1367] 10.222.0.20 () {58 vars in 1059 bytes} [Wed Sep 14 00:57:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 00:57:38.689240 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58bb7f-b877-4554-ae78-9908c808386c None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:57:38.691080 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7a58bb7f-b877-4554-ae78-9908c808386c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:38.852324 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58bb7f-b877-4554-ae78-9908c808386c None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:57:38.873540 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:38.973149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22647d8c-d479-400c-91cb-ae743f36ff32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:57:38.973751 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22647d8c-d479-400c-91cb-ae743f36ff32 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:38.974057 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22647d8c-d479-400c-91cb-ae743f36ff32 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:38.974322 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22647d8c-d479-400c-91cb-ae743f36ff32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:38.975883 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-22647d8c-d479-400c-91cb-ae743f36ff32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:39.073364 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22647d8c-d479-400c-91cb-ae743f36ff32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:57:39.074984 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22647d8c-d479-400c-91cb-ae743f36ff32 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:57:39.096748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 681/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:57:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 00:57:39.208517 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab7e01-7633-4199-bd6f-b42848cdc6e2 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:39.209055 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab7e01-7633-4199-bd6f-b42848cdc6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:39.209055 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab7e01-7633-4199-bd6f-b42848cdc6e2 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:39.210668 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 688/1369] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:57:39.216851 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0531d-5234-4e13-9ed6-7554d6115b66 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:39.217601 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0531d-5234-4e13-9ed6-7554d6115b66 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:39.218171 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0531d-5234-4e13-9ed6-7554d6115b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:39.259339 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:39.311559 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-dbc0531d-5234-4e13-9ed6-7554d6115b66 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:57:39.313325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-dbc0531d-5234-4e13-9ed6-7554d6115b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:39.428071 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 682/1370] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:57:39.769020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdaa934-26e7-4d4e-b906-501475f01bf9 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:39.769020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdaa934-26e7-4d4e-b906-501475f01bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:39.769020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdaa934-26e7-4d4e-b906-501475f01bf9 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:39.770902 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 689/1371] 10.222.0.20 () {54 vars in 964 bytes} [Wed Sep 14 00:57:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:57:39.775551 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaec4d7-8f8a-4998-888e-a763383add74 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:39.775838 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaec4d7-8f8a-4998-888e-a763383add74 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:39.776111 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaec4d7-8f8a-4998-888e-a763383add74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:39.861637 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-4eaec4d7-8f8a-4998-888e-a763383add74 None None] MFA Rules not processed for user `50394b1ba51b45a6bf833b63ff7e423b`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:57:39.862913 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4eaec4d7-8f8a-4998-888e-a763383add74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:39.913074 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:39.946280 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 683/1372] 10.222.0.20 () {58 vars in 1061 bytes} [Wed Sep 14 00:57:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:57:39.953840 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdaa934-26e7-4d4e-b906-501475f01bf9 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:57:39.955350 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0cdaa934-26e7-4d4e-b906-501475f01bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:40.087665 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdaa934-26e7-4d4e-b906-501475f01bf9 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:57:40.136604 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:40.178759 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a867b-32af-4df2-a206-d5e323add0a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:57:40.179593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a867b-32af-4df2-a206-d5e323add0a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:40.179831 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a867b-32af-4df2-a206-d5e323add0a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:40.180166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a867b-32af-4df2-a206-d5e323add0a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:40.182051 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2a7a867b-32af-4df2-a206-d5e323add0a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:40.313029 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a867b-32af-4df2-a206-d5e323add0a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:57:40.313029 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a867b-32af-4df2-a206-d5e323add0a7 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:57:40.336156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 690/1373] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:57:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:57:41.320142 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30431b39-5c9a-4e28-aae7-a3623fbf5a2e None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:41.320697 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30431b39-5c9a-4e28-aae7-a3623fbf5a2e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:41.320697 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30431b39-5c9a-4e28-aae7-a3623fbf5a2e None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:41.322032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 684/1374] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 00:57:41.327579 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80e3cf-bd66-4978-b5ae-f2092e3ccd48 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:41.328038 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80e3cf-bd66-4978-b5ae-f2092e3ccd48 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:41.328302 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80e3cf-bd66-4978-b5ae-f2092e3ccd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:41.393194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-2a80e3cf-bd66-4978-b5ae-f2092e3ccd48 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:57:41.394473 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2a80e3cf-bd66-4978-b5ae-f2092e3ccd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:41.415872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:41.492079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 691/1375] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:57:41.780260 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30431b39-5c9a-4e28-aae7-a3623fbf5a2e None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:57:41.782478 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-30431b39-5c9a-4e28-aae7-a3623fbf5a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:41.946363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30431b39-5c9a-4e28-aae7-a3623fbf5a2e None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:57:42.003288 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:42.068276 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f24bcf-49b6-44db-b675-b3ae2a85d0c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:57:42.068972 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f24bcf-49b6-44db-b675-b3ae2a85d0c7 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:42.069241 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f24bcf-49b6-44db-b675-b3ae2a85d0c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:42.069504 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f24bcf-49b6-44db-b675-b3ae2a85d0c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:42.071124 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d9f24bcf-49b6-44db-b675-b3ae2a85d0c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:42.164325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f24bcf-49b6-44db-b675-b3ae2a85d0c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:57:42.166215 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f24bcf-49b6-44db-b675-b3ae2a85d0c7 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:57:42.187216 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 685/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:57:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:57:44.403882 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500f8a7-5471-4f65-b1bc-bfb539803cb7 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:44.404404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500f8a7-5471-4f65-b1bc-bfb539803cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:44.404612 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500f8a7-5471-4f65-b1bc-bfb539803cb7 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:44.406302 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 692/1377] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:57:44.412169 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbb7b5-39b2-4e4d-a3fd-0e3c27f94f51 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:44.412580 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbb7b5-39b2-4e4d-a3fd-0e3c27f94f51 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:44.412747 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbb7b5-39b2-4e4d-a3fd-0e3c27f94f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:44.480658 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-defbb7b5-39b2-4e4d-a3fd-0e3c27f94f51 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:57:44.481874 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-defbb7b5-39b2-4e4d-a3fd-0e3c27f94f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:44.489125 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:44.583619 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 686/1378] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:57:44.876958 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500f8a7-5471-4f65-b1bc-bfb539803cb7 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:57:44.878683 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d500f8a7-5471-4f65-b1bc-bfb539803cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:45.041987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500f8a7-5471-4f65-b1bc-bfb539803cb7 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:57:45.046908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:45.162584 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe56f6-427e-471d-86d9-f40280fad2f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:57:45.163261 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe56f6-427e-471d-86d9-f40280fad2f7 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:45.163652 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe56f6-427e-471d-86d9-f40280fad2f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:45.164020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe56f6-427e-471d-86d9-f40280fad2f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:45.165684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-debe56f6-427e-471d-86d9-f40280fad2f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:45.257346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe56f6-427e-471d-86d9-f40280fad2f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:57:45.259097 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe56f6-427e-471d-86d9-f40280fad2f7 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:57:45.278578 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 693/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:57:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:57:47.483226 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ac54d-0033-45b9-aaf9-f8fb66e98875 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:47.483766 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ac54d-0033-45b9-aaf9-f8fb66e98875 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:47.483766 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ac54d-0033-45b9-aaf9-f8fb66e98875 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:47.485246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 687/1380] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:57:47.490379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ff3cb-6067-415e-8f23-cb7350ac6df8 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:47.490787 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ff3cb-6067-415e-8f23-cb7350ac6df8 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:47.491022 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ff3cb-6067-415e-8f23-cb7350ac6df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:47.502360 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:47.559928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-975ff3cb-6067-415e-8f23-cb7350ac6df8 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:57:47.561064 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-975ff3cb-6067-415e-8f23-cb7350ac6df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:47.670059 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 694/1381] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:57:47.966103 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ac54d-0033-45b9-aaf9-f8fb66e98875 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:57:47.967609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4f0ac54d-0033-45b9-aaf9-f8fb66e98875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:48.128572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:48.139374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ac54d-0033-45b9-aaf9-f8fb66e98875 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:57:48.270727 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca415ea-35a3-41a3-91aa-97c966bd14fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:57:48.271469 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca415ea-35a3-41a3-91aa-97c966bd14fc service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:48.271903 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca415ea-35a3-41a3-91aa-97c966bd14fc service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:48.272225 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca415ea-35a3-41a3-91aa-97c966bd14fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:48.274306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-eca415ea-35a3-41a3-91aa-97c966bd14fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:48.370128 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca415ea-35a3-41a3-91aa-97c966bd14fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:57:48.371732 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca415ea-35a3-41a3-91aa-97c966bd14fc service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:57:48.381535 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:48.390630 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 688/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:57:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:57:50.972219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb66b2-1190-4fed-8d42-0fb88cf6b0ff None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:50.972826 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb66b2-1190-4fed-8d42-0fb88cf6b0ff None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:50.972826 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb66b2-1190-4fed-8d42-0fb88cf6b0ff None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:50.974141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 695/1383] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 00:57:50.979325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315af17d-e626-476b-a64f-5c41a63c27c5 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:50.979733 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315af17d-e626-476b-a64f-5c41a63c27c5 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:50.979866 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315af17d-e626-476b-a64f-5c41a63c27c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:51.050307 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-315af17d-e626-476b-a64f-5c41a63c27c5 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:57:51.052033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-315af17d-e626-476b-a64f-5c41a63c27c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:51.170019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 689/1384] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:57:51.464723 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb66b2-1190-4fed-8d42-0fb88cf6b0ff None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:57:51.466595 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-79cb66b2-1190-4fed-8d42-0fb88cf6b0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:51.552461 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:51.625674 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb66b2-1190-4fed-8d42-0fb88cf6b0ff None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:57:51.752328 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b34700-5c42-46f2-a59b-febf47015536 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:57:51.752941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b34700-5c42-46f2-a59b-febf47015536 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:51.753213 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b34700-5c42-46f2-a59b-febf47015536 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:51.753476 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b34700-5c42-46f2-a59b-febf47015536 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:51.755666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-47b34700-5c42-46f2-a59b-febf47015536 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:51.807634 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:51.854712 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b34700-5c42-46f2-a59b-febf47015536 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:57:51.856752 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b34700-5c42-46f2-a59b-febf47015536 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:57:51.879531 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 696/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:57:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:57:54.111008 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6dea0-2198-487c-868a-c835db12db81 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:54.111613 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6dea0-2198-487c-868a-c835db12db81 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:54.111613 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6dea0-2198-487c-868a-c835db12db81 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:54.113655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 690/1386] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:57:54.119014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea5ed3-487c-4165-b530-ae8bed72e53e None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:54.119496 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea5ed3-487c-4165-b530-ae8bed72e53e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:54.119616 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea5ed3-487c-4165-b530-ae8bed72e53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:54.188172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-c6ea5ed3-487c-4165-b530-ae8bed72e53e None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:57:54.189686 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c6ea5ed3-487c-4165-b530-ae8bed72e53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:54.292898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 697/1387] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:57:54.583761 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6dea0-2198-487c-868a-c835db12db81 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:57:54.585270 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fba6dea0-2198-487c-868a-c835db12db81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:54.664043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:54.733975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6dea0-2198-487c-868a-c835db12db81 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:57:54.845888 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cdf6b-33f0-4302-a6ab-93a0f045362e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:57:54.846406 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cdf6b-33f0-4302-a6ab-93a0f045362e service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:54.846678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cdf6b-33f0-4302-a6ab-93a0f045362e service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:54.846941 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cdf6b-33f0-4302-a6ab-93a0f045362e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:54.849106 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d46cdf6b-33f0-4302-a6ab-93a0f045362e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:54.886374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:54.937148 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46cdf6b-33f0-4302-a6ab-93a0f045362e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:57:54.938762 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46cdf6b-33f0-4302-a6ab-93a0f045362e service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:57:54.956847 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 691/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:57:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:57:55.535456 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fcdf1-3280-4002-8021-61feb84893a4 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:55.536030 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fcdf1-3280-4002-8021-61feb84893a4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:55.536030 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fcdf1-3280-4002-8021-61feb84893a4 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:55.537500 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 698/1389] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:57:55.542717 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb0a40-1567-4568-a163-147bf987b92c None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:55.543168 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb0a40-1567-4568-a163-147bf987b92c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:55.543168 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb0a40-1567-4568-a163-147bf987b92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:55.608544 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-accb0a40-1567-4568-a163-147bf987b92c None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:57:55.609721 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-accb0a40-1567-4568-a163-147bf987b92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:55.706608 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 692/1390] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:57:56.010392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2747d-801f-4acf-823c-de83adb716c7 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:56.010678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2747d-801f-4acf-823c-de83adb716c7 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:56.010953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2747d-801f-4acf-823c-de83adb716c7 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:56.012303 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 699/1391] 10.222.0.20 () {54 vars in 966 bytes} [Wed Sep 14 00:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:57:56.017516 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddac4fa-60cb-4054-8edf-a2cc659d9a8d None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:56.018057 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddac4fa-60cb-4054-8edf-a2cc659d9a8d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:56.018328 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddac4fa-60cb-4054-8edf-a2cc659d9a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:56.034692 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:56.094208 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-2ddac4fa-60cb-4054-8edf-a2cc659d9a8d None None] MFA Rules not processed for user `ee54ed3a092e4eef9082c4e86bd918a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:57:56.095381 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-2ddac4fa-60cb-4054-8edf-a2cc659d9a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:56.180108 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 693/1392] 10.222.0.20 () {58 vars in 1063 bytes} [Wed Sep 14 00:57:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 00:57:56.189364 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2747d-801f-4acf-823c-de83adb716c7 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:57:56.190887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e8f2747d-801f-4acf-823c-de83adb716c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:56.222791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:56.295551 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2747d-801f-4acf-823c-de83adb716c7 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:57:56.367956 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd483d-eb90-4b48-8036-4e5b495b0946 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee54ed3a092e4eef9082c4e86bd918a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:57:56.368551 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd483d-eb90-4b48-8036-4e5b495b0946 service glance] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:56.368828 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd483d-eb90-4b48-8036-4e5b495b0946 service glance] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:56.369096 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd483d-eb90-4b48-8036-4e5b495b0946 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:56.370688 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d9fd483d-eb90-4b48-8036-4e5b495b0946 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:56.448350 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:56.481875 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd483d-eb90-4b48-8036-4e5b495b0946 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:57:56.483206 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd483d-eb90-4b48-8036-4e5b495b0946 service glance] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:57:56.501475 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 700/1393] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:57:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:57:57.184921 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc1b02-8516-4eae-9acd-6390f8e1254d None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:57.185457 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc1b02-8516-4eae-9acd-6390f8e1254d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:57.185457 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc1b02-8516-4eae-9acd-6390f8e1254d None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:57.187116 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 694/1394] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:57:57.193176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a58467-b384-4d54-be5c-3d9aca10f588 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:57.193627 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a58467-b384-4d54-be5c-3d9aca10f588 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:57.193741 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a58467-b384-4d54-be5c-3d9aca10f588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:57.258376 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d395ed6-a35c-426a-8987-0cd44813c43a None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:57.258685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d395ed6-a35c-426a-8987-0cd44813c43a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:57.258981 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d395ed6-a35c-426a-8987-0cd44813c43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:57.261751 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-44a58467-b384-4d54-be5c-3d9aca10f588 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:57:57.262998 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-44a58467-b384-4d54-be5c-3d9aca10f588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:57.327006 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-9d395ed6-a35c-426a-8987-0cd44813c43a None None] MFA Rules not processed for user `eb9d1149a417436bbf1577d61407c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:57:57.328223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9d395ed6-a35c-426a-8987-0cd44813c43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:57.360898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 701/1395] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:57:57.383166 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:57.415612 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 695/1396] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 14 00:57:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 00:57:57.461557 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d06af2-562d-43d0-baec-c0d8b01fef86 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:57.461876 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d06af2-562d-43d0-baec-c0d8b01fef86 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:57.462158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d06af2-562d-43d0-baec-c0d8b01fef86 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:57.463568 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 702/1397] 10.222.0.20 () {54 vars in 943 bytes} [Wed Sep 14 00:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:57:57.469977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce0651-0500-4de2-8628-9071e6682a65 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:57.470263 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce0651-0500-4de2-8628-9071e6682a65 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:57.470536 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce0651-0500-4de2-8628-9071e6682a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:57.547835 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-e9ce0651-0500-4de2-8628-9071e6682a65 None None] MFA Rules not processed for user `c8d05652bfe542d5a2cfa39fbf7a83c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:57:57.549029 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e9ce0651-0500-4de2-8628-9071e6682a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:57.650248 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d06af2-562d-43d0-baec-c0d8b01fef86 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:57:57.651754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f8d06af2-562d-43d0-baec-c0d8b01fef86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:57.656774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 696/1398] 10.222.0.20 () {58 vars in 1040 bytes} [Wed Sep 14 00:57:57 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:57:57.666255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce0651-0500-4de2-8628-9071e6682a65 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:57:57.676306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce0651-0500-4de2-8628-9071e6682a65 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:57:57.694805 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:57.703054 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:57.785706 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8808e89-5beb-4894-afb1-2a5750893df9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d05652bfe542d5a2cfa39fbf7a83c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:57:57.786530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8808e89-5beb-4894-afb1-2a5750893df9 service swift] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:57.786885 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8808e89-5beb-4894-afb1-2a5750893df9 service swift] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:57.787151 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8808e89-5beb-4894-afb1-2a5750893df9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:57.788763 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b8808e89-5beb-4894-afb1-2a5750893df9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:57.802511 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d06af2-562d-43d0-baec-c0d8b01fef86 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:57:57.872515 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8808e89-5beb-4894-afb1-2a5750893df9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:57:57.874142 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8808e89-5beb-4894-afb1-2a5750893df9 service swift] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:57:57.882016 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 697/1399] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 14 00:57:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 14 00:57:57.917450 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:57.920223 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68295e-a6a1-415c-9929-58016ded60e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:57:57.921062 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68295e-a6a1-415c-9929-58016ded60e7 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:57:57.921476 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68295e-a6a1-415c-9929-58016ded60e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:57:57.922022 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68295e-a6a1-415c-9929-58016ded60e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:57:57.923656 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-da68295e-a6a1-415c-9929-58016ded60e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:57:58.040853 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da68295e-a6a1-415c-9929-58016ded60e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:57:58.042580 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da68295e-a6a1-415c-9929-58016ded60e7 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:57:58.065002 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 703/1400] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 00:58:00.289753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323e408-8edd-4f32-8472-d2120b25bf56 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:00.290295 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323e408-8edd-4f32-8472-d2120b25bf56 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:00.290295 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323e408-8edd-4f32-8472-d2120b25bf56 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:00.291566 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 698/1401] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:58:00.297202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf0823-56ab-4d31-bc2e-54bef484bc3d None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:00.297637 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf0823-56ab-4d31-bc2e-54bef484bc3d None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:00.297729 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf0823-56ab-4d31-bc2e-54bef484bc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:00.376985 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-60bf0823-56ab-4d31-bc2e-54bef484bc3d None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:58:00.378786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-60bf0823-56ab-4d31-bc2e-54bef484bc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:00.453858 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:00.489463 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 704/1402] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:58:00.782643 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323e408-8edd-4f32-8472-d2120b25bf56 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:58:00.784246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5323e408-8edd-4f32-8472-d2120b25bf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:00.850793 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:00.948739 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323e408-8edd-4f32-8472-d2120b25bf56 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:58:01.075368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99522a51-8b7a-4f62-8d90-9564f79c86b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:58:01.075880 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99522a51-8b7a-4f62-8d90-9564f79c86b0 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:01.076168 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99522a51-8b7a-4f62-8d90-9564f79c86b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:01.076420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99522a51-8b7a-4f62-8d90-9564f79c86b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:01.078075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-99522a51-8b7a-4f62-8d90-9564f79c86b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:01.100690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:01.176451 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99522a51-8b7a-4f62-8d90-9564f79c86b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:58:01.178126 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99522a51-8b7a-4f62-8d90-9564f79c86b0 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:58:01.197773 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 699/1403] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:58:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:58:03.415089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d4bbe-54ce-4966-a60f-c214cec08f2c None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:03.415655 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d4bbe-54ce-4966-a60f-c214cec08f2c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:03.415655 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d4bbe-54ce-4966-a60f-c214cec08f2c None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:03.417243 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 705/1404] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:58:03.422581 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaa421-43e3-42a5-bfbf-fb6658960df8 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:03.423097 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaa421-43e3-42a5-bfbf-fb6658960df8 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:03.423097 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaa421-43e3-42a5-bfbf-fb6658960df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:03.495173 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-92eaa421-43e3-42a5-bfbf-fb6658960df8 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:58:03.496487 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-92eaa421-43e3-42a5-bfbf-fb6658960df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:03.599794 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:03.607241 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 700/1405] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:58:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:58:03.902086 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d4bbe-54ce-4966-a60f-c214cec08f2c None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:58:03.903935 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ad4d4bbe-54ce-4966-a60f-c214cec08f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:04.068877 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d4bbe-54ce-4966-a60f-c214cec08f2c None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:58:04.129188 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:04.198156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed0e51-a153-410c-b07e-5bba77914b28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:58:04.199105 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed0e51-a153-410c-b07e-5bba77914b28 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:04.199442 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed0e51-a153-410c-b07e-5bba77914b28 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:04.199784 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed0e51-a153-410c-b07e-5bba77914b28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:04.201433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4aed0e51-a153-410c-b07e-5bba77914b28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:04.299071 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed0e51-a153-410c-b07e-5bba77914b28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:58:04.301403 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed0e51-a153-410c-b07e-5bba77914b28 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:58:04.323646 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 706/1406] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:58:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:58:06.599790 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44f720-9bb3-43ac-82b3-fe4ca6e1b9c8 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:06.600422 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44f720-9bb3-43ac-82b3-fe4ca6e1b9c8 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:06.600543 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44f720-9bb3-43ac-82b3-fe4ca6e1b9c8 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:06.609509 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 701/1407] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:58:06 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:58:06.611374 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc66b21-3272-4b0d-b173-5bac5d9198be None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:06.611930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc66b21-3272-4b0d-b173-5bac5d9198be None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:06.612043 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc66b21-3272-4b0d-b173-5bac5d9198be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:06.686036 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-2bc66b21-3272-4b0d-b173-5bac5d9198be None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:58:06.687264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2bc66b21-3272-4b0d-b173-5bac5d9198be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:06.701687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:06.798706 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 707/1408] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:58:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:58:07.092119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44f720-9bb3-43ac-82b3-fe4ca6e1b9c8 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:58:07.093635 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-bb44f720-9bb3-43ac-82b3-fe4ca6e1b9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:07.251955 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44f720-9bb3-43ac-82b3-fe4ca6e1b9c8 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:58:07.323836 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:07.375753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e05b8-7739-4f6a-a098-4e80029c9a91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:58:07.376725 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e05b8-7739-4f6a-a098-4e80029c9a91 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:07.376996 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e05b8-7739-4f6a-a098-4e80029c9a91 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:07.377267 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e05b8-7739-4f6a-a098-4e80029c9a91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:07.379548 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ad0e05b8-7739-4f6a-a098-4e80029c9a91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:07.478248 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e05b8-7739-4f6a-a098-4e80029c9a91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:58:07.479952 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e05b8-7739-4f6a-a098-4e80029c9a91 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:58:07.504152 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 702/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:58:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:58:16.797338 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=38 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:17.500910 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=64 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:20.425046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b48ad-3fd2-47b4-be03-f406d52fb81b None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:20.425587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b48ad-3fd2-47b4-be03-f406d52fb81b None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:20.425587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b48ad-3fd2-47b4-be03-f406d52fb81b None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:20.426910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 708/1410] 10.222.0.20 () {54 vars in 918 bytes} [Wed Sep 14 00:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:58:20.431852 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cd616-bf2e-4efc-89bf-f7c4550d481a None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:20.432300 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cd616-bf2e-4efc-89bf-f7c4550d481a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:20.432396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cd616-bf2e-4efc-89bf-f7c4550d481a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:20.506103 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-848cd616-bf2e-4efc-89bf-f7c4550d481a None None] MFA Rules not processed for user `abf9ab5fafe94afdb3ebe98536b5cc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:58:20.507292 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-848cd616-bf2e-4efc-89bf-f7c4550d481a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:20.610770 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 703/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Wed Sep 14 00:58:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:58:20.624654 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040b75d-5a35-44cb-bdc7-320b90b02c97 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:20.624937 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040b75d-5a35-44cb-bdc7-320b90b02c97 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:20.625206 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040b75d-5a35-44cb-bdc7-320b90b02c97 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:20.626586 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 709/1412] 10.222.0.20 () {54 vars in 918 bytes} [Wed Sep 14 00:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:58:20.631593 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b969fce-8d04-4307-af87-9ef79df6aa47 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:20.631871 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b969fce-8d04-4307-af87-9ef79df6aa47 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:20.632171 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b969fce-8d04-4307-af87-9ef79df6aa47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:20.702968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:20.706884 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-1b969fce-8d04-4307-af87-9ef79df6aa47 None None] MFA Rules not processed for user `c05caac9e8b9498583780306887734be`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:58:20.708663 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1b969fce-8d04-4307-af87-9ef79df6aa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:20.822882 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 704/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Wed Sep 14 00:58:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:58:23.483780 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d5d13-4ff0-42a7-b523-71835ed8a28e None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:23.484351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d5d13-4ff0-42a7-b523-71835ed8a28e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:23.484351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d5d13-4ff0-42a7-b523-71835ed8a28e None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:23.485664 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 00:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:58:23.492401 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87435aae-3d44-47a6-afc7-ceba9408d1a7 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:23.492858 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87435aae-3d44-47a6-afc7-ceba9408d1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:23.492964 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87435aae-3d44-47a6-afc7-ceba9408d1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:23.563983 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-87435aae-3d44-47a6-afc7-ceba9408d1a7 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:58:23.565651 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-87435aae-3d44-47a6-afc7-ceba9408d1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:23.628596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:23.674675 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 00:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:58:23.987063 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d5d13-4ff0-42a7-b523-71835ed8a28e None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:58:23.988599 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-101d5d13-4ff0-42a7-b523-71835ed8a28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:24.132440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d5d13-4ff0-42a7-b523-71835ed8a28e None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:58:24.203339 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:24.244099 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179a8a2-e119-44de-b540-1d818b7ad1b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:58:24.244703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179a8a2-e119-44de-b540-1d818b7ad1b0 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:24.244980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179a8a2-e119-44de-b540-1d818b7ad1b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:24.245248 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179a8a2-e119-44de-b540-1d818b7ad1b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:24.246895 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2179a8a2-e119-44de-b540-1d818b7ad1b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:24.337792 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179a8a2-e119-44de-b540-1d818b7ad1b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:58:24.339391 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179a8a2-e119-44de-b540-1d818b7ad1b0 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:58:24.357389 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 711/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:58:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:58:25.475954 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257927ca-3a76-41f3-b960-02fa6b6be34c None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:25.476518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257927ca-3a76-41f3-b960-02fa6b6be34c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:25.476518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257927ca-3a76-41f3-b960-02fa6b6be34c None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:25.477843 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 00:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:58:25.483859 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ff973-77ca-4cf8-a8cd-e1283f976a84 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:25.484296 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ff973-77ca-4cf8-a8cd-e1283f976a84 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:25.484404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ff973-77ca-4cf8-a8cd-e1283f976a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:25.558180 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-6e7ff973-77ca-4cf8-a8cd-e1283f976a84 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:58:25.559295 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6e7ff973-77ca-4cf8-a8cd-e1283f976a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:25.585859 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:25.653689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 00:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:58:25.804681 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257927ca-3a76-41f3-b960-02fa6b6be34c None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:58:25.806225 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-257927ca-3a76-41f3-b960-02fa6b6be34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:25.949131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257927ca-3a76-41f3-b960-02fa6b6be34c None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:58:25.989010 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:26.062286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306cca34-1361-445f-8eb7-a35862e25f41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:58:26.062886 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cca34-1361-445f-8eb7-a35862e25f41 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:26.063160 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cca34-1361-445f-8eb7-a35862e25f41 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:26.063426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cca34-1361-445f-8eb7-a35862e25f41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:26.065598 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-306cca34-1361-445f-8eb7-a35862e25f41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:26.153215 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306cca34-1361-445f-8eb7-a35862e25f41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:58:26.154807 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306cca34-1361-445f-8eb7-a35862e25f41 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:58:26.173683 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 707/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:58:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:58:27.319900 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c17f5-5266-42cc-951c-e490d3bc2782 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:27.320323 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c17f5-5266-42cc-951c-e490d3bc2782 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:27.320450 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c17f5-5266-42cc-951c-e490d3bc2782 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:27.321793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 00:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:58:27.327909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1af93-85b8-4cec-8566-258617f13296 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:27.328375 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1af93-85b8-4cec-8566-258617f13296 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:27.328477 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1af93-85b8-4cec-8566-258617f13296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:27.382176 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:27.404221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-b4f1af93-85b8-4cec-8566-258617f13296 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:58:27.405396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b4f1af93-85b8-4cec-8566-258617f13296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:27.498154 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 00:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:58:27.649722 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c17f5-5266-42cc-951c-e490d3bc2782 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:58:27.651190 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d93c17f5-5266-42cc-951c-e490d3bc2782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:27.794248 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c17f5-5266-42cc-951c-e490d3bc2782 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:58:27.806037 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:27.903903 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1dd31-bdf0-4005-b0e5-9dabc588d2db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:58:27.904420 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1dd31-bdf0-4005-b0e5-9dabc588d2db service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:27.904696 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1dd31-bdf0-4005-b0e5-9dabc588d2db service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:27.904964 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1dd31-bdf0-4005-b0e5-9dabc588d2db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:27.906840 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-aec1dd31-bdf0-4005-b0e5-9dabc588d2db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:27.995726 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1dd31-bdf0-4005-b0e5-9dabc588d2db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:58:27.997308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1dd31-bdf0-4005-b0e5-9dabc588d2db service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:58:28.015020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 714/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:58:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:58:29.118329 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758d647-f7d7-49db-b72e-10870ecabd2c None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:29.118889 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758d647-f7d7-49db-b72e-10870ecabd2c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:29.118889 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758d647-f7d7-49db-b72e-10870ecabd2c None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:29.120189 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 00:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:58:29.126319 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0576a01-e94a-4293-beb4-7a2f907dd381 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:29.126766 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0576a01-e94a-4293-beb4-7a2f907dd381 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:29.126874 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0576a01-e94a-4293-beb4-7a2f907dd381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:29.146633 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:29.202297 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e0576a01-e94a-4293-beb4-7a2f907dd381 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:58:29.203492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e0576a01-e94a-4293-beb4-7a2f907dd381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:29.300209 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 00:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:58:29.451247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758d647-f7d7-49db-b72e-10870ecabd2c None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:58:29.452737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c758d647-f7d7-49db-b72e-10870ecabd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:29.560063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:29.596184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758d647-f7d7-49db-b72e-10870ecabd2c None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:58:29.707114 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697ba02-27e4-4d88-af9e-d3276d581fc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:58:29.707710 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697ba02-27e4-4d88-af9e-d3276d581fc7 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:29.707984 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697ba02-27e4-4d88-af9e-d3276d581fc7 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:29.708251 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697ba02-27e4-4d88-af9e-d3276d581fc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:29.709860 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c697ba02-27e4-4d88-af9e-d3276d581fc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:29.785008 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:29.799340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697ba02-27e4-4d88-af9e-d3276d581fc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:58:29.800924 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697ba02-27e4-4d88-af9e-d3276d581fc7 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:58:29.819120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 710/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:58:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:58:30.965694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b738b-315a-4362-b72c-41beb1c49d1e None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:30.966269 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b738b-315a-4362-b72c-41beb1c49d1e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:30.966269 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b738b-315a-4362-b72c-41beb1c49d1e None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:30.967608 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 00:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:58:30.974986 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c658a4e-f625-44e6-b3e9-2ca784f53549 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:30.975484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c658a4e-f625-44e6-b3e9-2ca784f53549 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:30.975592 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c658a4e-f625-44e6-b3e9-2ca784f53549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:31.053618 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-6c658a4e-f625-44e6-b3e9-2ca784f53549 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:58:31.054862 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6c658a4e-f625-44e6-b3e9-2ca784f53549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:31.149461 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 00:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:58:31.303678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b738b-315a-4362-b72c-41beb1c49d1e None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:58:31.305303 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c67b738b-315a-4362-b72c-41beb1c49d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:31.388721 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:31.449000 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b738b-315a-4362-b72c-41beb1c49d1e None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:58:31.558682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cae0a-4f35-4079-828d-d253140abaa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:58:31.559204 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cae0a-4f35-4079-828d-d253140abaa7 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:31.559478 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cae0a-4f35-4079-828d-d253140abaa7 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:31.559745 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cae0a-4f35-4079-828d-d253140abaa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:31.561312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2c2cae0a-4f35-4079-828d-d253140abaa7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:31.609047 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:31.648906 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2cae0a-4f35-4079-828d-d253140abaa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:58:31.650514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2cae0a-4f35-4079-828d-d253140abaa7 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:58:31.668537 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 717/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:58:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:58:32.717137 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31430d6-84c1-4629-933b-5bf42ea87304 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:32.717658 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31430d6-84c1-4629-933b-5bf42ea87304 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:32.717658 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31430d6-84c1-4629-933b-5bf42ea87304 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:32.718960 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 00:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:58:32.725067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216bfda-93a7-465c-8ceb-5069f6071db8 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:32.725510 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216bfda-93a7-465c-8ceb-5069f6071db8 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:32.725609 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216bfda-93a7-465c-8ceb-5069f6071db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:32.806195 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e216bfda-93a7-465c-8ceb-5069f6071db8 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:58:32.807393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e216bfda-93a7-465c-8ceb-5069f6071db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:32.901771 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 00:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:58:33.054768 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31430d6-84c1-4629-933b-5bf42ea87304 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:58:33.056286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b31430d6-84c1-4629-933b-5bf42ea87304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:33.104781 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:33.199719 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31430d6-84c1-4629-933b-5bf42ea87304 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:58:33.315884 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93703cd-a6f0-4cda-80b0-d5d79dc7ccee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:58:33.316490 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93703cd-a6f0-4cda-80b0-d5d79dc7ccee service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:33.316765 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93703cd-a6f0-4cda-80b0-d5d79dc7ccee service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:33.317032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93703cd-a6f0-4cda-80b0-d5d79dc7ccee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:33.318676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f93703cd-a6f0-4cda-80b0-d5d79dc7ccee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:33.325779 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:33.409454 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93703cd-a6f0-4cda-80b0-d5d79dc7ccee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:58:33.411068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93703cd-a6f0-4cda-80b0-d5d79dc7ccee service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:58:33.428559 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 713/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:58:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:58:34.486339 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba0bac-01ec-4b49-9fe8-43a44920f333 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:34.486869 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba0bac-01ec-4b49-9fe8-43a44920f333 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:34.486869 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba0bac-01ec-4b49-9fe8-43a44920f333 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:34.488237 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 00:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:58:34.494499 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c8f92-f957-456a-af73-389d9be87aaa None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:34.494960 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c8f92-f957-456a-af73-389d9be87aaa None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:34.495053 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c8f92-f957-456a-af73-389d9be87aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:34.568662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-3e5c8f92-f957-456a-af73-389d9be87aaa None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:58:34.569874 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3e5c8f92-f957-456a-af73-389d9be87aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:34.635523 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:34.664942 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 00:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:58:34.815408 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba0bac-01ec-4b49-9fe8-43a44920f333 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:58:34.816891 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-97ba0bac-01ec-4b49-9fe8-43a44920f333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:34.835667 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:34.960775 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba0bac-01ec-4b49-9fe8-43a44920f333 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:58:35.046197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:35.072476 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee12e7-e366-46af-a399-a38f3caf9801 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:58:35.073023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee12e7-e366-46af-a399-a38f3caf9801 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:35.073281 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee12e7-e366-46af-a399-a38f3caf9801 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:35.073549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee12e7-e366-46af-a399-a38f3caf9801 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:35.075159 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d2ee12e7-e366-46af-a399-a38f3caf9801 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:35.162157 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee12e7-e366-46af-a399-a38f3caf9801 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:58:35.163718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee12e7-e366-46af-a399-a38f3caf9801 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:58:35.181496 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 720/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:58:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:58:36.242638 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb913842-0991-4986-98ab-0cb2732caad7 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:36.243168 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb913842-0991-4986-98ab-0cb2732caad7 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:36.243168 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb913842-0991-4986-98ab-0cb2732caad7 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:36.244522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 00:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:58:36.251293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa720579-ea21-4cd1-ab1d-182e7f5a22c9 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:36.251799 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa720579-ea21-4cd1-ab1d-182e7f5a22c9 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:36.251905 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa720579-ea21-4cd1-ab1d-182e7f5a22c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:36.327849 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-aa720579-ea21-4cd1-ab1d-182e7f5a22c9 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:58:36.329651 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-aa720579-ea21-4cd1-ab1d-182e7f5a22c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:36.369169 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:36.422977 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 00:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:58:36.573429 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb913842-0991-4986-98ab-0cb2732caad7 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:58:36.574924 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fb913842-0991-4986-98ab-0cb2732caad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:36.719690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb913842-0991-4986-98ab-0cb2732caad7 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:58:36.773869 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:36.832881 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1daa7-d787-47b7-a4cb-b15f9e63aac9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:58:36.833390 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1daa7-d787-47b7-a4cb-b15f9e63aac9 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:36.833659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1daa7-d787-47b7-a4cb-b15f9e63aac9 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:36.833950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1daa7-d787-47b7-a4cb-b15f9e63aac9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:36.835523 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-46b1daa7-d787-47b7-a4cb-b15f9e63aac9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:36.924601 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1daa7-d787-47b7-a4cb-b15f9e63aac9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:58:36.926201 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1daa7-d787-47b7-a4cb-b15f9e63aac9 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:58:36.943633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 716/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:58:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:58:37.983124 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b63a6-3f00-4006-8e50-c808703051c0 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:37.983696 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b63a6-3f00-4006-8e50-c808703051c0 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:37.983696 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b63a6-3f00-4006-8e50-c808703051c0 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:37.985828 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 00:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:58:37.992130 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4b239-bf31-4d28-8998-1f87806d62eb None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:37.992563 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4b239-bf31-4d28-8998-1f87806d62eb None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:37.992671 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4b239-bf31-4d28-8998-1f87806d62eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:38.067813 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-00b4b239-bf31-4d28-8998-1f87806d62eb None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:58:38.069032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-00b4b239-bf31-4d28-8998-1f87806d62eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:38.071330 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:38.168667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 00:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:58:38.319795 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b63a6-3f00-4006-8e50-c808703051c0 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:58:38.321247 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e61b63a6-3f00-4006-8e50-c808703051c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:38.466704 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b63a6-3f00-4006-8e50-c808703051c0 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:58:38.492618 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:38.575261 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd9dd2-149e-43f3-b0d3-14877e21d54f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:58:38.575783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd9dd2-149e-43f3-b0d3-14877e21d54f service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:38.576054 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd9dd2-149e-43f3-b0d3-14877e21d54f service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:38.576327 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd9dd2-149e-43f3-b0d3-14877e21d54f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:38.577922 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0ebd9dd2-149e-43f3-b0d3-14877e21d54f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:38.666028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd9dd2-149e-43f3-b0d3-14877e21d54f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:58:38.667638 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd9dd2-149e-43f3-b0d3-14877e21d54f service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:58:38.684967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 723/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:58:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:58:40.795463 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0081f-f74a-4e3e-91c0-e2d99eaf162f None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:40.796079 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0081f-f74a-4e3e-91c0-e2d99eaf162f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:40.796079 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0081f-f74a-4e3e-91c0-e2d99eaf162f None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:40.797368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 00:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:58:40.802780 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcc2c1-13ae-40fe-9f4d-5ebb24b4281a None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:40.803201 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcc2c1-13ae-40fe-9f4d-5ebb24b4281a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:40.803334 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcc2c1-13ae-40fe-9f4d-5ebb24b4281a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:40.843968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:40.869982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-25fcc2c1-13ae-40fe-9f4d-5ebb24b4281a None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:58:40.871174 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-25fcc2c1-13ae-40fe-9f4d-5ebb24b4281a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:40.965355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 00:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:58:41.249252 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0081f-f74a-4e3e-91c0-e2d99eaf162f None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:58:41.250836 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-2bb0081f-f74a-4e3e-91c0-e2d99eaf162f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:41.356004 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0081f-f74a-4e3e-91c0-e2d99eaf162f None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:58:41.387394 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:41.429336 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d86f5-26fd-487d-a7eb-6f2da1a2b0f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:58:41.429982 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d86f5-26fd-487d-a7eb-6f2da1a2b0f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:41.430257 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d86f5-26fd-487d-a7eb-6f2da1a2b0f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:41.430521 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d86f5-26fd-487d-a7eb-6f2da1a2b0f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:41.432137 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-010d86f5-26fd-487d-a7eb-6f2da1a2b0f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:41.539593 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d86f5-26fd-487d-a7eb-6f2da1a2b0f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:58:41.540926 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d86f5-26fd-487d-a7eb-6f2da1a2b0f2 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:58:41.558186 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 719/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:58:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:58:43.862746 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8a146-b9fb-4b4f-abdd-628c4f61d18f None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:43.863311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8a146-b9fb-4b4f-abdd-628c4f61d18f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:43.863311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8a146-b9fb-4b4f-abdd-628c4f61d18f None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:43.864665 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 00:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:58:43.869922 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443e505-0304-4a5e-8e7d-eb11f9666b61 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:43.870395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443e505-0304-4a5e-8e7d-eb11f9666b61 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:43.870506 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443e505-0304-4a5e-8e7d-eb11f9666b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:43.934418 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-f443e505-0304-4a5e-8e7d-eb11f9666b61 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:58:43.935529 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f443e505-0304-4a5e-8e7d-eb11f9666b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:43.948442 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:44.035286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 00:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:58:44.330246 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8a146-b9fb-4b4f-abdd-628c4f61d18f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:58:44.331818 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5eb8a146-b9fb-4b4f-abdd-628c4f61d18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:44.432585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8a146-b9fb-4b4f-abdd-628c4f61d18f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:58:44.446712 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:44.506217 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba87e5f-387c-413c-950c-d08f2a5fea77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:58:44.506813 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba87e5f-387c-413c-950c-d08f2a5fea77 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:44.507084 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba87e5f-387c-413c-950c-d08f2a5fea77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:44.507356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba87e5f-387c-413c-950c-d08f2a5fea77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:44.508922 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7ba87e5f-387c-413c-950c-d08f2a5fea77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:44.613332 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba87e5f-387c-413c-950c-d08f2a5fea77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:58:44.614728 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba87e5f-387c-413c-950c-d08f2a5fea77 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:58:44.632601 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 726/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:58:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:58:47.057587 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21104a09-faf7-4c20-acfb-2e71ee42570f None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:47.058153 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21104a09-faf7-4c20-acfb-2e71ee42570f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:47.058153 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21104a09-faf7-4c20-acfb-2e71ee42570f None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:47.059462 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 00:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:58:47.064814 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae0f44-653c-41d8-bb33-1e5224530f38 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:47.065247 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae0f44-653c-41d8-bb33-1e5224530f38 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:47.065361 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae0f44-653c-41d8-bb33-1e5224530f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:47.113863 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:47.131743 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-4cae0f44-653c-41d8-bb33-1e5224530f38 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:58:47.132952 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4cae0f44-653c-41d8-bb33-1e5224530f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:47.228669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 00:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:58:47.510316 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21104a09-faf7-4c20-acfb-2e71ee42570f None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:58:47.511846 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-21104a09-faf7-4c20-acfb-2e71ee42570f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:47.612920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21104a09-faf7-4c20-acfb-2e71ee42570f None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:58:47.652708 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:47.686494 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41922a2d-9033-4595-95af-05797c2e5d17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:58:47.687087 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41922a2d-9033-4595-95af-05797c2e5d17 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:47.687360 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41922a2d-9033-4595-95af-05797c2e5d17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:47.688133 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41922a2d-9033-4595-95af-05797c2e5d17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:47.689718 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-41922a2d-9033-4595-95af-05797c2e5d17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:47.797869 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41922a2d-9033-4595-95af-05797c2e5d17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:58:47.799292 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41922a2d-9033-4595-95af-05797c2e5d17 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:58:47.817081 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 722/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:58:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:58:50.060732 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d462f-780e-4cc9-9dec-5a0e1711b023 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:50.061253 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d462f-780e-4cc9-9dec-5a0e1711b023 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:50.061253 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d462f-780e-4cc9-9dec-5a0e1711b023 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:50.062766 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 00:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:58:50.068157 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0430ed3-8949-401a-a68c-a77ab74f704a None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:50.068590 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0430ed3-8949-401a-a68c-a77ab74f704a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:50.068719 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0430ed3-8949-401a-a68c-a77ab74f704a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:50.133721 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-b0430ed3-8949-401a-a68c-a77ab74f704a None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:58:50.134946 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b0430ed3-8949-401a-a68c-a77ab74f704a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:50.157360 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:50.231532 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 00:58:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:58:50.513106 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d462f-780e-4cc9-9dec-5a0e1711b023 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:58:50.514672 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-be5d462f-780e-4cc9-9dec-5a0e1711b023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:50.617376 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d462f-780e-4cc9-9dec-5a0e1711b023 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:58:50.637151 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:50.689643 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6251b02-fa77-4e22-b9d3-2c64e95f4e28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:58:50.690275 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6251b02-fa77-4e22-b9d3-2c64e95f4e28 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:50.690550 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6251b02-fa77-4e22-b9d3-2c64e95f4e28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:50.690818 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6251b02-fa77-4e22-b9d3-2c64e95f4e28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:50.692390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d6251b02-fa77-4e22-b9d3-2c64e95f4e28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:50.798755 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6251b02-fa77-4e22-b9d3-2c64e95f4e28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:58:50.800090 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6251b02-fa77-4e22-b9d3-2c64e95f4e28 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:58:50.817937 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 729/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:58:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:58:53.005474 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0303726-be09-40fc-b742-89f300718fe7 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:53.005937 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0303726-be09-40fc-b742-89f300718fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:53.006079 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0303726-be09-40fc-b742-89f300718fe7 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:53.007449 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 00:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:58:53.012851 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9575837-03d5-4ca3-83c8-0896c264d226 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:53.013262 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9575837-03d5-4ca3-83c8-0896c264d226 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:53.013395 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9575837-03d5-4ca3-83c8-0896c264d226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:53.075406 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:53.078820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-b9575837-03d5-4ca3-83c8-0896c264d226 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:58:53.080567 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b9575837-03d5-4ca3-83c8-0896c264d226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:53.179136 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 00:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:58:53.463868 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0303726-be09-40fc-b742-89f300718fe7 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:58:53.465386 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e0303726-be09-40fc-b742-89f300718fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:53.570297 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0303726-be09-40fc-b742-89f300718fe7 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:58:53.619404 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:53.644391 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5c5dc-55ba-4af5-afcc-40befbb0174a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:58:53.645006 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5c5dc-55ba-4af5-afcc-40befbb0174a service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:53.645277 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5c5dc-55ba-4af5-afcc-40befbb0174a service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:53.645541 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5c5dc-55ba-4af5-afcc-40befbb0174a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:53.647160 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-25e5c5dc-55ba-4af5-afcc-40befbb0174a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:53.754351 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5c5dc-55ba-4af5-afcc-40befbb0174a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:58:53.755758 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5c5dc-55ba-4af5-afcc-40befbb0174a service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:58:53.773137 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 725/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:58:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:58:56.007593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebe333-ffb1-4448-bd05-523dad355475 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:56.008084 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebe333-ffb1-4448-bd05-523dad355475 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:56.008191 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebe333-ffb1-4448-bd05-523dad355475 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:56.009515 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 00:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:58:56.015115 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147bdf4-89f2-497c-88b6-6bb3aa0c9bf8 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:56.015559 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147bdf4-89f2-497c-88b6-6bb3aa0c9bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:56.015676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147bdf4-89f2-497c-88b6-6bb3aa0c9bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:56.080721 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-9147bdf4-89f2-497c-88b6-6bb3aa0c9bf8 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:58:56.081942 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9147bdf4-89f2-497c-88b6-6bb3aa0c9bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:56.110742 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:56.176619 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 00:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:58:56.458507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebe333-ffb1-4448-bd05-523dad355475 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:58:56.460031 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c3ebe333-ffb1-4448-bd05-523dad355475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:56.559064 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebe333-ffb1-4448-bd05-523dad355475 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:58:56.587538 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:56.632272 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45179240-5c4e-4dad-9a53-8ce488ceb061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:58:56.632882 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45179240-5c4e-4dad-9a53-8ce488ceb061 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:56.633159 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45179240-5c4e-4dad-9a53-8ce488ceb061 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:56.633424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45179240-5c4e-4dad-9a53-8ce488ceb061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:56.635032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-45179240-5c4e-4dad-9a53-8ce488ceb061 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:56.740334 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45179240-5c4e-4dad-9a53-8ce488ceb061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:58:56.742037 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45179240-5c4e-4dad-9a53-8ce488ceb061 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:58:56.760467 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 732/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:58:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:58:59.011387 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aaf80b-5276-4209-bcad-4f59bf05c19a None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:59.011814 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aaf80b-5276-4209-bcad-4f59bf05c19a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:59.011980 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aaf80b-5276-4209-bcad-4f59bf05c19a None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:59.013314 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 00:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:58:59.019169 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4598b3-2a6e-4c63-bd34-e7872939cd57 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:59.019576 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4598b3-2a6e-4c63-bd34-e7872939cd57 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:59.019715 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4598b3-2a6e-4c63-bd34-e7872939cd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:59.083857 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ea4598b3-2a6e-4c63-bd34-e7872939cd57 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:58:59.085042 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ea4598b3-2a6e-4c63-bd34-e7872939cd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:59.093162 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:59.181592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 00:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:58:59.464910 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aaf80b-5276-4209-bcad-4f59bf05c19a None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:58:59.466474 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b8aaf80b-5276-4209-bcad-4f59bf05c19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:59.568289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aaf80b-5276-4209-bcad-4f59bf05c19a None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:58:59.623105 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:59.640945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a6439-6512-4eff-a832-92a2d3b1a4c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:58:59.641537 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a6439-6512-4eff-a832-92a2d3b1a4c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:58:59.641830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a6439-6512-4eff-a832-92a2d3b1a4c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:58:59.642106 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a6439-6512-4eff-a832-92a2d3b1a4c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:58:59.643686 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fe4a6439-6512-4eff-a832-92a2d3b1a4c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:58:59.751120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a6439-6512-4eff-a832-92a2d3b1a4c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:58:59.752548 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a6439-6512-4eff-a832-92a2d3b1a4c1 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:58:59.769973 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 728/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:58:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:59:01.982812 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15049f78-e1d6-4098-843a-111c674a66de None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:01.983354 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15049f78-e1d6-4098-843a-111c674a66de None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:01.983484 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15049f78-e1d6-4098-843a-111c674a66de None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:01.984764 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 00:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:59:01.990363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503ab0d-4131-4353-9e50-564813649074 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:01.990784 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503ab0d-4131-4353-9e50-564813649074 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:01.990911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503ab0d-4131-4353-9e50-564813649074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:02.058001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-0503ab0d-4131-4353-9e50-564813649074 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:59:02.059193 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-0503ab0d-4131-4353-9e50-564813649074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:02.096614 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:59:02.154623 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 00:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:59:02.434342 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15049f78-e1d6-4098-843a-111c674a66de None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:59:02.435976 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-15049f78-e1d6-4098-843a-111c674a66de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:02.537446 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15049f78-e1d6-4098-843a-111c674a66de None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:59:02.573656 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:59:02.608453 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3a43f-18ce-4f26-a4a1-18d332ad1fd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:59:02.609045 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3a43f-18ce-4f26-a4a1-18d332ad1fd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:02.609318 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3a43f-18ce-4f26-a4a1-18d332ad1fd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:02.609581 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3a43f-18ce-4f26-a4a1-18d332ad1fd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:02.611170 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2cf3a43f-18ce-4f26-a4a1-18d332ad1fd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:02.716456 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3a43f-18ce-4f26-a4a1-18d332ad1fd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:59:02.717896 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3a43f-18ce-4f26-a4a1-18d332ad1fd1 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:59:02.735733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 735/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:59:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:59:04.869444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27f37d-ed9e-4e14-bd4d-58a370ea1c5d None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:04.870055 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27f37d-ed9e-4e14-bd4d-58a370ea1c5d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:04.870055 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27f37d-ed9e-4e14-bd4d-58a370ea1c5d None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:04.871321 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 00:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:59:04.876692 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09029306-5113-4d29-9ef6-fcf852ebf4ec None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:04.877103 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09029306-5113-4d29-9ef6-fcf852ebf4ec None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:04.877247 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09029306-5113-4d29-9ef6-fcf852ebf4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:04.945360 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-09029306-5113-4d29-9ef6-fcf852ebf4ec None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:59:04.946616 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-09029306-5113-4d29-9ef6-fcf852ebf4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:04.964341 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:59:05.044609 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 00:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 00:59:05.323360 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27f37d-ed9e-4e14-bd4d-58a370ea1c5d None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:59:05.324878 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4c27f37d-ed9e-4e14-bd4d-58a370ea1c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:05.426982 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27f37d-ed9e-4e14-bd4d-58a370ea1c5d None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:59:05.492540 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:59:05.499884 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b3069-1642-4800-9c7f-bf7f78d0cc5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:59:05.500482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b3069-1642-4800-9c7f-bf7f78d0cc5e service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:05.500758 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b3069-1642-4800-9c7f-bf7f78d0cc5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:05.501026 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b3069-1642-4800-9c7f-bf7f78d0cc5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:05.502666 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-142b3069-1642-4800-9c7f-bf7f78d0cc5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:05.607566 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b3069-1642-4800-9c7f-bf7f78d0cc5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:59:05.608904 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b3069-1642-4800-9c7f-bf7f78d0cc5e service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:59:05.626693 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 731/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:59:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:59:07.763731 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386ffd3-0dfd-475f-99a2-5fe9301f000f None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:07.764282 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386ffd3-0dfd-475f-99a2-5fe9301f000f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:07.764282 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386ffd3-0dfd-475f-99a2-5fe9301f000f None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:07.766352 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 00:59:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:59:07.771509 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6da3c-e53b-4abf-b195-90a0b76829b3 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:07.771971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6da3c-e53b-4abf-b195-90a0b76829b3 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:07.772072 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6da3c-e53b-4abf-b195-90a0b76829b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:07.838475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-c8c6da3c-e53b-4abf-b195-90a0b76829b3 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:59:07.839732 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c8c6da3c-e53b-4abf-b195-90a0b76829b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:07.887295 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:59:07.935587 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 00:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:59:08.221854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386ffd3-0dfd-475f-99a2-5fe9301f000f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:59:08.223417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d386ffd3-0dfd-475f-99a2-5fe9301f000f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:08.323935 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386ffd3-0dfd-475f-99a2-5fe9301f000f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:59:08.370534 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:59:08.395966 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9719e9c-e50a-4c3e-abbd-763aa0ff443f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:59:08.396563 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9719e9c-e50a-4c3e-abbd-763aa0ff443f service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:08.396839 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9719e9c-e50a-4c3e-abbd-763aa0ff443f service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:08.397111 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9719e9c-e50a-4c3e-abbd-763aa0ff443f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:08.398734 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b9719e9c-e50a-4c3e-abbd-763aa0ff443f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:08.503720 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9719e9c-e50a-4c3e-abbd-763aa0ff443f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:59:08.505133 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9719e9c-e50a-4c3e-abbd-763aa0ff443f service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:59:08.522488 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 738/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:59:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:59:17.934006 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=22 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:59:18.520267 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=66 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:59:28.459168 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c435e40-38f9-41fd-8582-962b1b899c0f None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:28.459694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c435e40-38f9-41fd-8582-962b1b899c0f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:28.459694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c435e40-38f9-41fd-8582-962b1b899c0f None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:28.460957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 733/1471] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:59:28.466168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd21d2-bac4-40e4-8a2f-182d8bae4a85 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:28.466656 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd21d2-bac4-40e4-8a2f-182d8bae4a85 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:28.466796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd21d2-bac4-40e4-8a2f-182d8bae4a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:28.532252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-fccd21d2-bac4-40e4-8a2f-182d8bae4a85 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:59:28.533459 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-fccd21d2-bac4-40e4-8a2f-182d8bae4a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:28.634158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 739/1472] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:59:28.936857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46669d1e-56c6-4652-a470-b09ef0aa46c5 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:28.937152 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46669d1e-56c6-4652-a470-b09ef0aa46c5 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:28.937422 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46669d1e-56c6-4652-a470-b09ef0aa46c5 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:28.938791 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 734/1473] 10.222.0.20 () {54 vars in 966 bytes} [Wed Sep 14 00:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:59:28.943724 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574884c-1fab-4b00-b66f-ee8ced73e6ec None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:28.944031 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574884c-1fab-4b00-b66f-ee8ced73e6ec None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:28.944300 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574884c-1fab-4b00-b66f-ee8ced73e6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:29.019103 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-3574884c-1fab-4b00-b66f-ee8ced73e6ec None None] MFA Rules not processed for user `ee54ed3a092e4eef9082c4e86bd918a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:59:29.020305 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3574884c-1fab-4b00-b66f-ee8ced73e6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:29.040991 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:59:29.095556 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 740/1474] 10.222.0.20 () {58 vars in 1063 bytes} [Wed Sep 14 00:59:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:59:29.103213 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46669d1e-56c6-4652-a470-b09ef0aa46c5 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:59:29.104757 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-46669d1e-56c6-4652-a470-b09ef0aa46c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:29.206720 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46669d1e-56c6-4652-a470-b09ef0aa46c5 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:59:29.278544 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864e3c5-6a6f-4009-8551-3adab9bb7e3a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee54ed3a092e4eef9082c4e86bd918a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:59:29.279731 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864e3c5-6a6f-4009-8551-3adab9bb7e3a service glance] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:29.279998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864e3c5-6a6f-4009-8551-3adab9bb7e3a service glance] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:29.280258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864e3c5-6a6f-4009-8551-3adab9bb7e3a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:29.281835 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d864e3c5-6a6f-4009-8551-3adab9bb7e3a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:29.334571 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:59:29.389380 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864e3c5-6a6f-4009-8551-3adab9bb7e3a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:59:29.390815 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864e3c5-6a6f-4009-8551-3adab9bb7e3a service glance] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:59:29.409148 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 735/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:59:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:59:31.654820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94259a4-099c-4195-9c89-9203fee27145 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:31.655396 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94259a4-099c-4195-9c89-9203fee27145 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:31.655396 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94259a4-099c-4195-9c89-9203fee27145 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:31.656619 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 741/1476] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:59:31.662101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfa5c8-2f5c-4852-816b-ea70f04c7f5e None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:31.662522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfa5c8-2f5c-4852-816b-ea70f04c7f5e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:31.662625 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfa5c8-2f5c-4852-816b-ea70f04c7f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:31.729120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-bbbfa5c8-2f5c-4852-816b-ea70f04c7f5e None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:59:31.730366 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-bbbfa5c8-2f5c-4852-816b-ea70f04c7f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:31.825315 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 736/1477] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:59:32.109668 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94259a4-099c-4195-9c89-9203fee27145 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:59:32.111293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e94259a4-099c-4195-9c89-9203fee27145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:32.234891 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94259a4-099c-4195-9c89-9203fee27145 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:59:32.284867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:59:32.339583 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ba648-7045-4426-a73e-88351af52582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:59:32.340591 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ba648-7045-4426-a73e-88351af52582 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:32.341696 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ba648-7045-4426-a73e-88351af52582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:32.342210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ba648-7045-4426-a73e-88351af52582 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:32.343318 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ba648-7045-4426-a73e-88351af52582 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:59:32.346350 dv-cinder-857528-1-smb devstack@keystone.service[81475]: WARNING py.warnings [None req-e68ba648-7045-4426-a73e-88351af52582 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 00:59:32.346350 dv-cinder-857528-1-smb devstack@keystone.service[81475]: warnings.warn(msg) Sep 14 00:59:32.346350 dv-cinder-857528-1-smb devstack@keystone.service[81475]: Sep 14 00:59:32.347541 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ba648-7045-4426-a73e-88351af52582 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:59:32.368559 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 742/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 14 00:59:32 2022] GET /identity/v3/projects => generated 2553 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 00:59:34.499897 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31899e-8a03-45a7-bf24-830dda19e236 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:34.500482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31899e-8a03-45a7-bf24-830dda19e236 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:34.500482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31899e-8a03-45a7-bf24-830dda19e236 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:34.501791 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 737/1479] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:59:34.506952 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba3a2f-49a0-4423-a886-40ad2cd463b8 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:34.507378 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba3a2f-49a0-4423-a886-40ad2cd463b8 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:34.507529 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba3a2f-49a0-4423-a886-40ad2cd463b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:34.572221 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-54ba3a2f-49a0-4423-a886-40ad2cd463b8 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:59:34.573413 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-54ba3a2f-49a0-4423-a886-40ad2cd463b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:34.668330 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 743/1480] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 00:59:34.961107 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31899e-8a03-45a7-bf24-830dda19e236 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:59:34.962667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7f31899e-8a03-45a7-bf24-830dda19e236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:34.973001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:59:35.121090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31899e-8a03-45a7-bf24-830dda19e236 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:59:35.199898 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:59:35.233662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a79094-2857-4660-82fa-03d0446bf43f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:59:35.234285 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a79094-2857-4660-82fa-03d0446bf43f service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:35.234557 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a79094-2857-4660-82fa-03d0446bf43f service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:35.234820 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a79094-2857-4660-82fa-03d0446bf43f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:35.236387 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-44a79094-2857-4660-82fa-03d0446bf43f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:35.326082 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a79094-2857-4660-82fa-03d0446bf43f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:59:35.327710 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a79094-2857-4660-82fa-03d0446bf43f service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:59:35.346648 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 738/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:59:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:59:37.673120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52068feb-a2c8-47dd-b901-8ac69d79170a None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:37.673659 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52068feb-a2c8-47dd-b901-8ac69d79170a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:37.673659 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52068feb-a2c8-47dd-b901-8ac69d79170a None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:37.674955 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 744/1482] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:59:37.680287 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa835a-7974-4bca-9cde-67c98d2a6bac None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:37.680727 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa835a-7974-4bca-9cde-67c98d2a6bac None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:37.680860 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa835a-7974-4bca-9cde-67c98d2a6bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:37.748385 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-6faa835a-7974-4bca-9cde-67c98d2a6bac None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:59:37.750359 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6faa835a-7974-4bca-9cde-67c98d2a6bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:37.797127 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:59:37.846609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 739/1483] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:59:38.134241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52068feb-a2c8-47dd-b901-8ac69d79170a None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:59:38.135788 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-52068feb-a2c8-47dd-b901-8ac69d79170a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:38.160103 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:59:38.237407 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52068feb-a2c8-47dd-b901-8ac69d79170a None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:59:38.313082 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea252f1-7ae9-4060-aee2-26d155bd3765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:59:38.313603 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea252f1-7ae9-4060-aee2-26d155bd3765 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:38.313915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea252f1-7ae9-4060-aee2-26d155bd3765 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:38.314185 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea252f1-7ae9-4060-aee2-26d155bd3765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:38.315809 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-cea252f1-7ae9-4060-aee2-26d155bd3765 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:38.389255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:59:38.430739 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea252f1-7ae9-4060-aee2-26d155bd3765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:59:38.432157 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea252f1-7ae9-4060-aee2-26d155bd3765 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:59:38.450123 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 745/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:59:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:59:40.628694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa755e-fc3a-4225-bf73-52430288f870 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:40.629295 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa755e-fc3a-4225-bf73-52430288f870 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:40.629295 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa755e-fc3a-4225-bf73-52430288f870 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:40.630577 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 740/1485] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:59:40.635877 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621ebf7-5621-4802-844c-e108848d98d1 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:40.636295 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621ebf7-5621-4802-844c-e108848d98d1 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:40.636427 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621ebf7-5621-4802-844c-e108848d98d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:40.702186 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-c621ebf7-5621-4802-844c-e108848d98d1 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:59:40.703409 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c621ebf7-5621-4802-844c-e108848d98d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:40.806298 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 746/1486] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:59:41.099204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa755e-fc3a-4225-bf73-52430288f870 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:59:41.100728 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-29fa755e-fc3a-4225-bf73-52430288f870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:41.202918 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa755e-fc3a-4225-bf73-52430288f870 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:59:41.272866 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:59:41.274338 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f8894-2374-4e8f-b870-7f26d30a2660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:59:41.274909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f8894-2374-4e8f-b870-7f26d30a2660 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:41.275189 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f8894-2374-4e8f-b870-7f26d30a2660 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:41.275643 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f8894-2374-4e8f-b870-7f26d30a2660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:41.277562 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4e0f8894-2374-4e8f-b870-7f26d30a2660 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:41.390907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f8894-2374-4e8f-b870-7f26d30a2660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:59:41.392330 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f8894-2374-4e8f-b870-7f26d30a2660 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:59:41.411215 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 741/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:59:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:59:43.640366 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7043d4-feae-4a71-93a0-a519cc7af2b2 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:43.640898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7043d4-feae-4a71-93a0-a519cc7af2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:43.640898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7043d4-feae-4a71-93a0-a519cc7af2b2 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:43.642289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 747/1488] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:59:43.647600 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b04fc6-dd24-4857-ba7e-54f49a79626d None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:43.648036 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b04fc6-dd24-4857-ba7e-54f49a79626d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:43.648144 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b04fc6-dd24-4857-ba7e-54f49a79626d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:43.714986 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-c8b04fc6-dd24-4857-ba7e-54f49a79626d None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:59:43.716673 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c8b04fc6-dd24-4857-ba7e-54f49a79626d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:43.770100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:59:43.814069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 742/1489] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:59:44.114162 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7043d4-feae-4a71-93a0-a519cc7af2b2 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:59:44.115762 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-fd7043d4-feae-4a71-93a0-a519cc7af2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:44.151802 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:59:44.218398 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7043d4-feae-4a71-93a0-a519cc7af2b2 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:59:44.291387 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795e90e-0d21-40db-b320-d1d28b24c438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:59:44.291899 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795e90e-0d21-40db-b320-d1d28b24c438 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:44.292176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795e90e-0d21-40db-b320-d1d28b24c438 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:44.292444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795e90e-0d21-40db-b320-d1d28b24c438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:44.294070 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8795e90e-0d21-40db-b320-d1d28b24c438 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:44.373521 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:59:44.402535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795e90e-0d21-40db-b320-d1d28b24c438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:59:44.404886 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795e90e-0d21-40db-b320-d1d28b24c438 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:59:44.422311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 748/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:59:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:59:46.724611 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae93ee5-c375-4a31-8150-2f96d2e8d886 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:46.725194 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae93ee5-c375-4a31-8150-2f96d2e8d886 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:46.725194 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae93ee5-c375-4a31-8150-2f96d2e8d886 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:46.726497 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 743/1491] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 14 00:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 00:59:46.731738 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d63b8d-055f-44f5-b445-4d7f76a6dbd4 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:46.732164 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d63b8d-055f-44f5-b445-4d7f76a6dbd4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:46.732275 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d63b8d-055f-44f5-b445-4d7f76a6dbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:46.800728 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-78d63b8d-055f-44f5-b445-4d7f76a6dbd4 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 00:59:46.801972 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-78d63b8d-055f-44f5-b445-4d7f76a6dbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:46.895650 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 749/1492] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 14 00:59:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 00:59:47.189511 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae93ee5-c375-4a31-8150-2f96d2e8d886 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 00:59:47.191074 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9ae93ee5-c375-4a31-8150-2f96d2e8d886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:47.293069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae93ee5-c375-4a31-8150-2f96d2e8d886 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 00:59:47.369587 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be89dcf-588a-464b-aa34-e086f4b20f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 00:59:47.370242 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be89dcf-588a-464b-aa34-e086f4b20f22 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 00:59:47.370516 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be89dcf-588a-464b-aa34-e086f4b20f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 00:59:47.370780 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be89dcf-588a-464b-aa34-e086f4b20f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 00:59:47.372360 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9be89dcf-588a-464b-aa34-e086f4b20f22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 00:59:47.380996 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:59:47.482101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be89dcf-588a-464b-aa34-e086f4b20f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 00:59:47.483524 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be89dcf-588a-464b-aa34-e086f4b20f22 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 00:59:47.501515 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 744/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 00:59:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 00:59:56.894076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=82 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:59:57.499293 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=50 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:01:07.519132 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf91904-8d2e-4a3d-834e-4db09734da78 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:01:07.519673 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf91904-8d2e-4a3d-834e-4db09734da78 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:01:07.519673 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf91904-8d2e-4a3d-834e-4db09734da78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:01:07.595397 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-daf91904-8d2e-4a3d-834e-4db09734da78 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:01:07.596642 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-daf91904-8d2e-4a3d-834e-4db09734da78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:01:07.693087 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 750/1494] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:01:07.701090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934f63e-4d8a-48c2-8133-7a53f17f2a0c None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:01:07.701580 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934f63e-4d8a-48c2-8133-7a53f17f2a0c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:01:07.701687 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934f63e-4d8a-48c2-8133-7a53f17f2a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:01:07.778317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-8934f63e-4d8a-48c2-8133-7a53f17f2a0c None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:01:07.779518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8934f63e-4d8a-48c2-8133-7a53f17f2a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:01:07.992846 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 745/1495] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:01:07.997456 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf91904-8d2e-4a3d-834e-4db09734da78 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:01:07.998712 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-daf91904-8d2e-4a3d-834e-4db09734da78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:01:08.010521 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf91904-8d2e-4a3d-834e-4db09734da78 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:01:08.072876 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:01:08.106224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1818f-08b8-4ba4-ad3f-83bbcdd48d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:01:08.106824 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1818f-08b8-4ba4-ad3f-83bbcdd48d88 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:01:08.107104 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1818f-08b8-4ba4-ad3f-83bbcdd48d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:01:08.107376 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1818f-08b8-4ba4-ad3f-83bbcdd48d88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:01:08.108011 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1818f-08b8-4ba4-ad3f-83bbcdd48d88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:01:08.108312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1818f-08b8-4ba4-ad3f-83bbcdd48d88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:01:08.109308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: WARNING py.warnings [None req-bab1818f-08b8-4ba4-ad3f-83bbcdd48d88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 01:01:08.109308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: warnings.warn(msg) Sep 14 01:01:08.109308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: Sep 14 01:01:08.110225 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1818f-08b8-4ba4-ad3f-83bbcdd48d88 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:01:08.121269 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 751/1496] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:01:08.129425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934f63e-4d8a-48c2-8133-7a53f17f2a0c None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:01:08.138807 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934f63e-4d8a-48c2-8133-7a53f17f2a0c None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:01:08.198644 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:01:08.231453 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0217214-fa21-4b76-a882-74f7a76201df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:01:08.232044 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0217214-fa21-4b76-a882-74f7a76201df admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:01:08.232317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0217214-fa21-4b76-a882-74f7a76201df admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:01:08.232579 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0217214-fa21-4b76-a882-74f7a76201df admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:01:08.233478 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0217214-fa21-4b76-a882-74f7a76201df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:01:08.234941 dv-cinder-857528-1-smb devstack@keystone.service[81476]: WARNING py.warnings [None req-d0217214-fa21-4b76-a882-74f7a76201df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 01:01:08.234941 dv-cinder-857528-1-smb devstack@keystone.service[81476]: warnings.warn(msg) Sep 14 01:01:08.234941 dv-cinder-857528-1-smb devstack@keystone.service[81476]: Sep 14 01:01:08.236123 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0217214-fa21-4b76-a882-74f7a76201df admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:01:08.290944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 746/1497] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:01:08 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:01:08.294995 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1818f-08b8-4ba4-ad3f-83bbcdd48d88 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:01:08.296527 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-bab1818f-08b8-4ba4-ad3f-83bbcdd48d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:01:08.330160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1818f-08b8-4ba4-ad3f-83bbcdd48d88 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:01:08.422832 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b19de77-db35-4500-b1d7-df07586e9a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:01:08.423425 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19de77-db35-4500-b1d7-df07586e9a4a admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:01:08.423704 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19de77-db35-4500-b1d7-df07586e9a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:01:08.423974 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19de77-db35-4500-b1d7-df07586e9a4a admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:01:08.424603 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b19de77-db35-4500-b1d7-df07586e9a4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:01:08.425589 dv-cinder-857528-1-smb devstack@keystone.service[81475]: WARNING py.warnings [None req-6b19de77-db35-4500-b1d7-df07586e9a4a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 01:01:08.425589 dv-cinder-857528-1-smb devstack@keystone.service[81475]: warnings.warn(msg) Sep 14 01:01:08.425589 dv-cinder-857528-1-smb devstack@keystone.service[81475]: Sep 14 01:01:08.426815 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b19de77-db35-4500-b1d7-df07586e9a4a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:01:08.467948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 752/1498] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:01:08 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:01:08.471927 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0217214-fa21-4b76-a882-74f7a76201df admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:01:08.473406 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d0217214-fa21-4b76-a882-74f7a76201df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:01:08.538012 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0217214-fa21-4b76-a882-74f7a76201df admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:01:08.625622 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:01:08.637274 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd62c12-1d28-40c9-9bd5-cf14f9e1e8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:01:08.637896 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd62c12-1d28-40c9-9bd5-cf14f9e1e8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:01:08.638175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd62c12-1d28-40c9-9bd5-cf14f9e1e8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:01:08.638442 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd62c12-1d28-40c9-9bd5-cf14f9e1e8f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:01:08.639080 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd62c12-1d28-40c9-9bd5-cf14f9e1e8f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:01:08.640084 dv-cinder-857528-1-smb devstack@keystone.service[81476]: WARNING py.warnings [None req-bbd62c12-1d28-40c9-9bd5-cf14f9e1e8f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 01:01:08.640084 dv-cinder-857528-1-smb devstack@keystone.service[81476]: warnings.warn(msg) Sep 14 01:01:08.640084 dv-cinder-857528-1-smb devstack@keystone.service[81476]: Sep 14 01:01:08.640968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd62c12-1d28-40c9-9bd5-cf14f9e1e8f3 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:01:08.655116 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 747/1499] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:01:08.659207 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b19de77-db35-4500-b1d7-df07586e9a4a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:01:08.660729 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6b19de77-db35-4500-b1d7-df07586e9a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:01:08.672767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b19de77-db35-4500-b1d7-df07586e9a4a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:01:08.697361 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:01:08.768823 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9defebf-eee7-41e1-8a2b-c18b3cff1eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:01:08.769425 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9defebf-eee7-41e1-8a2b-c18b3cff1eeb admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:01:08.769701 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9defebf-eee7-41e1-8a2b-c18b3cff1eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:01:08.769997 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9defebf-eee7-41e1-8a2b-c18b3cff1eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:01:08.770935 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9defebf-eee7-41e1-8a2b-c18b3cff1eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:01:08.771937 dv-cinder-857528-1-smb devstack@keystone.service[81475]: WARNING py.warnings [None req-f9defebf-eee7-41e1-8a2b-c18b3cff1eeb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 01:01:08.771937 dv-cinder-857528-1-smb devstack@keystone.service[81475]: warnings.warn(msg) Sep 14 01:01:08.771937 dv-cinder-857528-1-smb devstack@keystone.service[81475]: Sep 14 01:01:08.772917 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9defebf-eee7-41e1-8a2b-c18b3cff1eeb admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:01:08.786206 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 753/1500] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:01:08.791107 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd62c12-1d28-40c9-9bd5-cf14f9e1e8f3 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:01:08.792621 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-bbd62c12-1d28-40c9-9bd5-cf14f9e1e8f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:01:08.825017 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd62c12-1d28-40c9-9bd5-cf14f9e1e8f3 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:01:08.916808 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568754c-611d-4470-b55b-09b959c58aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:01:08.917376 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568754c-611d-4470-b55b-09b959c58aef admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:01:08.917646 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568754c-611d-4470-b55b-09b959c58aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:01:08.917940 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568754c-611d-4470-b55b-09b959c58aef admin admin] PATH_INFO: `/v3/projects/bcd48386a64648988633b9cb3663ca91/users/8ff88594d3004b68bd1486fe3c7c20d3/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:01:08.939513 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568754c-611d-4470-b55b-09b959c58aef admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcd48386a64648988633b9cb3663ca91, user_id=8ff88594d3004b68bd1486fe3c7c20d3, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:01:08.940526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: WARNING py.warnings [None req-7568754c-611d-4470-b55b-09b959c58aef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 01:01:08.940526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: warnings.warn(msg) Sep 14 01:01:08.940526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: Sep 14 01:01:08.942549 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568754c-611d-4470-b55b-09b959c58aef admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:01:08.966818 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 748/1501] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:01:08 2022] PUT /identity/v3/projects/bcd48386a64648988633b9cb3663ca91/users/8ff88594d3004b68bd1486fe3c7c20d3/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:01:08.979043 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96da39-5eb8-4d84-a235-57daa7355531 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:01:08.979325 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96da39-5eb8-4d84-a235-57daa7355531 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:01:08.979617 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96da39-5eb8-4d84-a235-57daa7355531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:01:09.035794 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-2a96da39-5eb8-4d84-a235-57daa7355531 None None] MFA Rules not processed for user `8ff88594d3004b68bd1486fe3c7c20d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:01:09.037026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2a96da39-5eb8-4d84-a235-57daa7355531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:01:09.109952 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 754/1502] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:01:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:01:09.122767 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f7b39-177a-43d2-aa28-0509d27aceb1 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:01:09.123046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f7b39-177a-43d2-aa28-0509d27aceb1 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:01:09.123313 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f7b39-177a-43d2-aa28-0509d27aceb1 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:01:09.124606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 749/1503] 10.222.0.20 () {54 vars in 964 bytes} [Wed Sep 14 01:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 01:01:09.129164 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e555df-b8d6-4ebf-bd2b-d55599df311d None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:01:09.129449 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e555df-b8d6-4ebf-bd2b-d55599df311d None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:01:09.129720 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e555df-b8d6-4ebf-bd2b-d55599df311d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:01:09.161527 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:01:09.205689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-23e555df-b8d6-4ebf-bd2b-d55599df311d None None] MFA Rules not processed for user `50394b1ba51b45a6bf833b63ff7e423b`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:01:09.206851 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-23e555df-b8d6-4ebf-bd2b-d55599df311d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:01:09.280063 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 755/1504] 10.222.0.20 () {58 vars in 1061 bytes} [Wed Sep 14 01:01:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:01:09.287711 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f7b39-177a-43d2-aa28-0509d27aceb1 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:01:09.289246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d51f7b39-177a-43d2-aa28-0509d27aceb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:01:09.338979 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:01:09.391665 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f7b39-177a-43d2-aa28-0509d27aceb1 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:01:09.463082 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4b9ea-487d-48c8-8a16-8b4c41d48d6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:01:09.463628 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4b9ea-487d-48c8-8a16-8b4c41d48d6c service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:01:09.463902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4b9ea-487d-48c8-8a16-8b4c41d48d6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:01:09.464166 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4b9ea-487d-48c8-8a16-8b4c41d48d6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:01:09.465732 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1ff4b9ea-487d-48c8-8a16-8b4c41d48d6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:01:09.561064 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4b9ea-487d-48c8-8a16-8b4c41d48d6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:01:09.562510 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4b9ea-487d-48c8-8a16-8b4c41d48d6c service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:01:09.565864 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:01:09.580019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 750/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:01:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:01:09.625342 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f9681-0de1-46c0-ac97-cb57ada1e818 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:01:09.625626 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f9681-0de1-46c0-ac97-cb57ada1e818 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:01:09.625929 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f9681-0de1-46c0-ac97-cb57ada1e818 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:01:09.627203 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 756/1506] 10.222.0.20 () {52 vars in 830 bytes} [Wed Sep 14 01:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 01:01:09.630809 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4b9ea-487d-48c8-8a16-8b4c41d48d6c service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:01:09.632008 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1ff4b9ea-487d-48c8-8a16-8b4c41d48d6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:01:09.731408 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4b9ea-487d-48c8-8a16-8b4c41d48d6c service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:01:09.824632 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c47308-def6-477d-905d-bd04a571a3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:01:09.825324 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c47308-def6-477d-905d-bd04a571a3c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:01:09.825501 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c47308-def6-477d-905d-bd04a571a3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:01:09.825763 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c47308-def6-477d-905d-bd04a571a3c2 admin admin] PATH_INFO: `/v3/users/8ff88594d3004b68bd1486fe3c7c20d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:01:09.837562 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c47308-def6-477d-905d-bd04a571a3c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff88594d3004b68bd1486fe3c7c20d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:01:09.838601 dv-cinder-857528-1-smb devstack@keystone.service[81476]: WARNING py.warnings [None req-d7c47308-def6-477d-905d-bd04a571a3c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 01:01:09.838601 dv-cinder-857528-1-smb devstack@keystone.service[81476]: warnings.warn(msg) Sep 14 01:01:09.838601 dv-cinder-857528-1-smb devstack@keystone.service[81476]: Sep 14 01:01:09.839778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c47308-def6-477d-905d-bd04a571a3c2 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:01:09.849600 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:01:09.904709 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d7c47308-def6-477d-905d-bd04a571a3c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff88594d3004b68bd1486fe3c7c20d3'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:01:09.905138 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d7c47308-def6-477d-905d-bd04a571a3c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff88594d3004b68bd1486fe3c7c20d3'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:01:09.919201 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d7c47308-def6-477d-905d-bd04a571a3c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff88594d3004b68bd1486fe3c7c20d3'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:01:09.941060 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d7c47308-def6-477d-905d-bd04a571a3c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff88594d3004b68bd1486fe3c7c20d3'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:01:09.941588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d7c47308-def6-477d-905d-bd04a571a3c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff88594d3004b68bd1486fe3c7c20d3'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:01:09.957143 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 751/1507] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:01:09 2022] DELETE /identity/v3/users/8ff88594d3004b68bd1486fe3c7c20d3 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:01:09.962030 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38286f7-81f2-4a15-b304-a6ee41fd8278 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:01:09.962503 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38286f7-81f2-4a15-b304-a6ee41fd8278 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:01:09.962633 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38286f7-81f2-4a15-b304-a6ee41fd8278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:01:10.019372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-d38286f7-81f2-4a15-b304-a6ee41fd8278 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:01:10.020571 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d38286f7-81f2-4a15-b304-a6ee41fd8278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:01:10.095497 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:01:10.108922 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 757/1508] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:01:10.118543 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c47308-def6-477d-905d-bd04a571a3c2 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:01:10.119827 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d7c47308-def6-477d-905d-bd04a571a3c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:01:10.217412 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c47308-def6-477d-905d-bd04a571a3c2 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:01:10.270206 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:01:10.290722 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6b33a-e554-4bd8-bd38-fd72e5649869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:01:10.291320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6b33a-e554-4bd8-bd38-fd72e5649869 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:01:10.291592 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6b33a-e554-4bd8-bd38-fd72e5649869 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:01:10.291860 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6b33a-e554-4bd8-bd38-fd72e5649869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:01:10.293446 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e9a6b33a-e554-4bd8-bd38-fd72e5649869 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:01:10.400713 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6b33a-e554-4bd8-bd38-fd72e5649869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:01:10.402145 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6b33a-e554-4bd8-bd38-fd72e5649869 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:01:10.419478 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 752/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:01:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:01:10.755120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38286f7-81f2-4a15-b304-a6ee41fd8278 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:01:10.756422 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d38286f7-81f2-4a15-b304-a6ee41fd8278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:01:10.768747 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38286f7-81f2-4a15-b304-a6ee41fd8278 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:01:10.868950 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5c01a-94ac-44e0-8ff2-2bc47083ae08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:01:10.869568 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5c01a-94ac-44e0-8ff2-2bc47083ae08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:01:10.869866 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5c01a-94ac-44e0-8ff2-2bc47083ae08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:01:10.870134 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5c01a-94ac-44e0-8ff2-2bc47083ae08 admin admin] PATH_INFO: `/v3/projects/bcd48386a64648988633b9cb3663ca91` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:01:10.879833 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5c01a-94ac-44e0-8ff2-2bc47083ae08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcd48386a64648988633b9cb3663ca91)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:01:10.880844 dv-cinder-857528-1-smb devstack@keystone.service[81475]: WARNING py.warnings [None req-fdf5c01a-94ac-44e0-8ff2-2bc47083ae08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 01:01:10.880844 dv-cinder-857528-1-smb devstack@keystone.service[81475]: warnings.warn(msg) Sep 14 01:01:10.880844 dv-cinder-857528-1-smb devstack@keystone.service[81475]: Sep 14 01:01:10.882067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5c01a-94ac-44e0-8ff2-2bc47083ae08 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:01:10.940896 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fdf5c01a-94ac-44e0-8ff2-2bc47083ae08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcd48386a64648988633b9cb3663ca91', 'request_id': 'req-fdf5c01a-94ac-44e0-8ff2-2bc47083ae08'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:01:10.950859 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fdf5c01a-94ac-44e0-8ff2-2bc47083ae08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcd48386a64648988633b9cb3663ca91', 'request_id': 'req-fdf5c01a-94ac-44e0-8ff2-2bc47083ae08'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:01:10.963902 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fdf5c01a-94ac-44e0-8ff2-2bc47083ae08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcd48386a64648988633b9cb3663ca91', 'request_id': 'req-fdf5c01a-94ac-44e0-8ff2-2bc47083ae08'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:01:10.985949 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fdf5c01a-94ac-44e0-8ff2-2bc47083ae08 admin admin] The token cache is being invalidate because project bcd48386a64648988633b9cb3663ca91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:01:10.986238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fdf5c01a-94ac-44e0-8ff2-2bc47083ae08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:01:10.986786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fdf5c01a-94ac-44e0-8ff2-2bc47083ae08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:01:10.988087 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 758/1510] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:01:10 2022] DELETE /identity/v3/projects/bcd48386a64648988633b9cb3663ca91 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:01:20.417410 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=62 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:01:20.983889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:02:45.551670 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb14ea8-f334-4261-a5dd-d45044e72d0a None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:02:45.552246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb14ea8-f334-4261-a5dd-d45044e72d0a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:02:45.552246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb14ea8-f334-4261-a5dd-d45044e72d0a None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:02:45.553560 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 01:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 01:02:45.558869 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50118d48-2487-4fb6-8f51-7adbd00c4feb None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:02:45.559282 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50118d48-2487-4fb6-8f51-7adbd00c4feb None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:02:45.559484 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50118d48-2487-4fb6-8f51-7adbd00c4feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:02:45.637015 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-50118d48-2487-4fb6-8f51-7adbd00c4feb None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:02:45.638267 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-50118d48-2487-4fb6-8f51-7adbd00c4feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:02:45.743385 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 01:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:02:45.894314 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb14ea8-f334-4261-a5dd-d45044e72d0a None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:02:45.896444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7eb14ea8-f334-4261-a5dd-d45044e72d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:02:46.014322 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb14ea8-f334-4261-a5dd-d45044e72d0a None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:02:46.019710 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0256b-d31f-4d7a-8493-55dd9fbd945e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:02:46.020305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0256b-d31f-4d7a-8493-55dd9fbd945e service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:02:46.020582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0256b-d31f-4d7a-8493-55dd9fbd945e service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:02:46.020859 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0256b-d31f-4d7a-8493-55dd9fbd945e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:02:46.029562 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0256b-d31f-4d7a-8493-55dd9fbd945e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:02:46.031166 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0256b-d31f-4d7a-8493-55dd9fbd945e service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:02:46.041072 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 754/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:02:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:02:47.122270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc19aef-1a77-4cfc-b4a9-de0a15d36b30 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:02:47.122756 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc19aef-1a77-4cfc-b4a9-de0a15d36b30 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:02:47.122859 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc19aef-1a77-4cfc-b4a9-de0a15d36b30 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:02:47.124172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 01:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 01:02:47.131006 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e375e-cf06-46d1-84db-81f2f3e1d054 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:02:47.131515 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e375e-cf06-46d1-84db-81f2f3e1d054 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:02:47.131671 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e375e-cf06-46d1-84db-81f2f3e1d054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:02:47.150937 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-e09e375e-cf06-46d1-84db-81f2f3e1d054 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:02:47.152378 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e09e375e-cf06-46d1-84db-81f2f3e1d054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:02:47.160381 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 01:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:02:47.320205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc19aef-1a77-4cfc-b4a9-de0a15d36b30 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:02:47.334520 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc19aef-1a77-4cfc-b4a9-de0a15d36b30 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:02:47.340381 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6009b0-2d7f-4196-bc84-311fd23de123 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:02:47.341006 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6009b0-2d7f-4196-bc84-311fd23de123 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:02:47.341285 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6009b0-2d7f-4196-bc84-311fd23de123 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:02:47.341554 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6009b0-2d7f-4196-bc84-311fd23de123 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:02:47.349538 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6009b0-2d7f-4196-bc84-311fd23de123 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:02:47.351755 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6009b0-2d7f-4196-bc84-311fd23de123 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:02:47.360836 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 761/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:02:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:02:47.519886 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098bfa6-f08f-45f1-a602-e545fe428bbb None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:02:47.520170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098bfa6-f08f-45f1-a602-e545fe428bbb None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:02:47.520447 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098bfa6-f08f-45f1-a602-e545fe428bbb None None] PATH_INFO: `/v3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:02:47.521831 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 756/1517] 10.222.0.23 () {54 vars in 925 bytes} [Wed Sep 14 01:02:47 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:02:47.545833 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17664727-8059-43aa-ad1c-c0f211b0ef67 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:02:47.546133 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17664727-8059-43aa-ad1c-c0f211b0ef67 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:02:47.546409 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17664727-8059-43aa-ad1c-c0f211b0ef67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:02:47.610662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-17664727-8059-43aa-ad1c-c0f211b0ef67 None None] MFA Rules not processed for user `abf9ab5fafe94afdb3ebe98536b5cc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:02:47.611797 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-17664727-8059-43aa-ad1c-c0f211b0ef67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:02:47.628143 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:02:47.682956 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 762/1518] 10.222.0.23 () {58 vars in 1015 bytes} [Wed Sep 14 01:02:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:02:51.200621 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831b75a-2b93-40e9-94fa-20f65ad4ae32 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:02:51.201156 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831b75a-2b93-40e9-94fa-20f65ad4ae32 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:02:51.201156 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831b75a-2b93-40e9-94fa-20f65ad4ae32 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:02:51.202480 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 757/1519] 10.222.0.20 () {54 vars in 961 bytes} [Wed Sep 14 01:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 01:02:51.207335 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f6502-b095-433c-b100-c451f73fa967 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:02:51.207719 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f6502-b095-433c-b100-c451f73fa967 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:02:51.207879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f6502-b095-433c-b100-c451f73fa967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:02:51.228082 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-fb6f6502-b095-433c-b100-c451f73fa967 None None] MFA Rules not processed for user `abf9ab5fafe94afdb3ebe98536b5cc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:02:51.229296 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-fb6f6502-b095-433c-b100-c451f73fa967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:02:51.237712 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 763/1520] 10.222.0.20 () {58 vars in 1058 bytes} [Wed Sep 14 01:02:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:02:51.245558 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831b75a-2b93-40e9-94fa-20f65ad4ae32 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:02:51.268116 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831b75a-2b93-40e9-94fa-20f65ad4ae32 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:02:51.273615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231fae7-0d3f-413b-888e-cd8f75a1a1a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abf9ab5fafe94afdb3ebe98536b5cc3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:02:51.274262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231fae7-0d3f-413b-888e-cd8f75a1a1a0 service placement] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:02:51.274535 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231fae7-0d3f-413b-888e-cd8f75a1a1a0 service placement] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:02:51.274799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231fae7-0d3f-413b-888e-cd8f75a1a1a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:02:51.284824 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231fae7-0d3f-413b-888e-cd8f75a1a1a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:02:51.286446 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231fae7-0d3f-413b-888e-cd8f75a1a1a0 service placement] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:02:51.296867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 758/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:02:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:02:58.836043 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d1483-dc1a-4b50-8f0e-57013d3b609b None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:02:58.836610 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d1483-dc1a-4b50-8f0e-57013d3b609b None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:02:58.836610 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d1483-dc1a-4b50-8f0e-57013d3b609b None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:02:58.838026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 01:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 01:02:58.843980 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b53098-0d58-4a44-b50c-b503229798ed None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:02:58.844399 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b53098-0d58-4a44-b50c-b503229798ed None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:02:58.844542 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b53098-0d58-4a44-b50c-b503229798ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:02:58.863521 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-09b53098-0d58-4a44-b50c-b503229798ed None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:02:58.864707 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-09b53098-0d58-4a44-b50c-b503229798ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:02:58.873053 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 01:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:02:59.027484 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d1483-dc1a-4b50-8f0e-57013d3b609b None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:02:59.042726 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d1483-dc1a-4b50-8f0e-57013d3b609b None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:02:59.048020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04ae00-6662-46de-b76c-c49410f9ce83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:02:59.048604 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04ae00-6662-46de-b76c-c49410f9ce83 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:02:59.048880 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04ae00-6662-46de-b76c-c49410f9ce83 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:02:59.049148 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04ae00-6662-46de-b76c-c49410f9ce83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:02:59.057490 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04ae00-6662-46de-b76c-c49410f9ce83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:02:59.059114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04ae00-6662-46de-b76c-c49410f9ce83 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:02:59.068273 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 765/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:02:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:03:00.140080 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d45871-ad99-43fc-a1b1-fb0f51e361b3 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:03:00.140599 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d45871-ad99-43fc-a1b1-fb0f51e361b3 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:03:00.140726 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d45871-ad99-43fc-a1b1-fb0f51e361b3 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:03:00.142041 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 01:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 01:03:00.148667 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f5ace-8e41-45e7-a3c7-c4702beeec70 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:03:00.149114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f5ace-8e41-45e7-a3c7-c4702beeec70 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:03:00.149213 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f5ace-8e41-45e7-a3c7-c4702beeec70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:03:00.169443 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-912f5ace-8e41-45e7-a3c7-c4702beeec70 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:03:00.170692 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-912f5ace-8e41-45e7-a3c7-c4702beeec70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:03:00.178843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 01:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:03:00.329411 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d45871-ad99-43fc-a1b1-fb0f51e361b3 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:03:00.343777 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d45871-ad99-43fc-a1b1-fb0f51e361b3 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:03:00.349081 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80afb76-c5bb-452d-b27e-db819970ddf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:03:00.349660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80afb76-c5bb-452d-b27e-db819970ddf5 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:03:00.349973 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80afb76-c5bb-452d-b27e-db819970ddf5 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:03:00.350250 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80afb76-c5bb-452d-b27e-db819970ddf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:03:00.358691 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80afb76-c5bb-452d-b27e-db819970ddf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:03:00.360257 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80afb76-c5bb-452d-b27e-db819970ddf5 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:03:00.371340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 761/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:03:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:03:04.438007 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7e6f2-4628-4793-bb92-c8d6fd9a08b2 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:03:04.438564 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7e6f2-4628-4793-bb92-c8d6fd9a08b2 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:03:04.438564 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7e6f2-4628-4793-bb92-c8d6fd9a08b2 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:03:04.439844 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 01:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 01:03:04.444925 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c0c31-f5e1-41b0-b71b-b70a37f43140 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:03:04.445327 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c0c31-f5e1-41b0-b71b-b70a37f43140 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:03:04.445456 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c0c31-f5e1-41b0-b71b-b70a37f43140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:03:04.464233 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-665c0c31-f5e1-41b0-b71b-b70a37f43140 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:03:04.465404 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-665c0c31-f5e1-41b0-b71b-b70a37f43140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:03:04.472956 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 01:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:03:04.758464 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7e6f2-4628-4793-bb92-c8d6fd9a08b2 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:03:04.760184 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-91c7e6f2-4628-4793-bb92-c8d6fd9a08b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:03:04.837988 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7e6f2-4628-4793-bb92-c8d6fd9a08b2 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:03:04.841500 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bd0d0-c838-4b4f-a0eb-085c761d991c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:03:04.842129 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bd0d0-c838-4b4f-a0eb-085c761d991c service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:03:04.842409 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bd0d0-c838-4b4f-a0eb-085c761d991c service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:03:04.842680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bd0d0-c838-4b4f-a0eb-085c761d991c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:03:04.851407 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bd0d0-c838-4b4f-a0eb-085c761d991c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:03:04.852824 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bd0d0-c838-4b4f-a0eb-085c761d991c service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:03:04.862010 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 768/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:03:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:03:06.978615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc56d7-1920-42ab-8e06-d8e7dec8ccfe None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:03:06.979214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc56d7-1920-42ab-8e06-d8e7dec8ccfe None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:03:06.979214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc56d7-1920-42ab-8e06-d8e7dec8ccfe None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:03:06.980455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 01:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 01:03:06.985673 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84897f02-f3d4-4805-a459-9e48b9e58538 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:03:06.986171 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84897f02-f3d4-4805-a459-9e48b9e58538 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:03:06.986281 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84897f02-f3d4-4805-a459-9e48b9e58538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:03:07.005767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-84897f02-f3d4-4805-a459-9e48b9e58538 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:03:07.007018 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-84897f02-f3d4-4805-a459-9e48b9e58538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:03:07.015128 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 01:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:03:07.299409 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc56d7-1920-42ab-8e06-d8e7dec8ccfe None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:03:07.310196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc56d7-1920-42ab-8e06-d8e7dec8ccfe None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:03:07.313742 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b1569-8032-4cf2-bcdd-9a77f7fc43d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:03:07.314368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b1569-8032-4cf2-bcdd-9a77f7fc43d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:03:07.314645 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b1569-8032-4cf2-bcdd-9a77f7fc43d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:03:07.314912 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b1569-8032-4cf2-bcdd-9a77f7fc43d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:03:07.324137 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b1569-8032-4cf2-bcdd-9a77f7fc43d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:03:07.325553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b1569-8032-4cf2-bcdd-9a77f7fc43d4 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:03:07.335442 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 764/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:03:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:03:10.988673 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f643bcb-334b-4e35-807d-108440fd8629 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:03:10.989229 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f643bcb-334b-4e35-807d-108440fd8629 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:03:10.989229 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f643bcb-334b-4e35-807d-108440fd8629 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:03:10.990589 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 01:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 01:03:10.995814 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24060081-eb6c-491a-95f4-639cd84051e3 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:03:10.996262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24060081-eb6c-491a-95f4-639cd84051e3 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:03:10.996372 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24060081-eb6c-491a-95f4-639cd84051e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:03:11.003886 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=81 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:03:11.017085 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-24060081-eb6c-491a-95f4-639cd84051e3 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:03:11.018308 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-24060081-eb6c-491a-95f4-639cd84051e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:03:11.026962 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 01:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:03:11.325719 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f643bcb-334b-4e35-807d-108440fd8629 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:03:11.327408 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7f643bcb-334b-4e35-807d-108440fd8629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:03:11.392420 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:03:11.406332 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f643bcb-334b-4e35-807d-108440fd8629 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:03:11.410041 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef9618-fa70-4b34-8ab3-01c90e8a96fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:03:11.410645 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef9618-fa70-4b34-8ab3-01c90e8a96fe service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:03:11.410926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef9618-fa70-4b34-8ab3-01c90e8a96fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:03:11.411201 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef9618-fa70-4b34-8ab3-01c90e8a96fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:03:11.420025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef9618-fa70-4b34-8ab3-01c90e8a96fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:03:11.421431 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef9618-fa70-4b34-8ab3-01c90e8a96fe service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:03:11.431265 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 771/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:03:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:03:13.576524 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f0ae4-1fde-4976-bbc3-f64e35b67f65 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:03:13.577104 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f0ae4-1fde-4976-bbc3-f64e35b67f65 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:03:13.577104 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f0ae4-1fde-4976-bbc3-f64e35b67f65 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:03:13.578424 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 01:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 01:03:13.583576 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c2c0d-75c4-4aac-9512-2c4f29ca2f59 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:03:13.583986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c2c0d-75c4-4aac-9512-2c4f29ca2f59 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:03:13.584156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c2c0d-75c4-4aac-9512-2c4f29ca2f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:03:13.604064 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-f49c2c0d-75c4-4aac-9512-2c4f29ca2f59 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:03:13.605257 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f49c2c0d-75c4-4aac-9512-2c4f29ca2f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:03:13.612932 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 01:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:03:13.922820 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f0ae4-1fde-4976-bbc3-f64e35b67f65 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:03:13.924479 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-262f0ae4-1fde-4976-bbc3-f64e35b67f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:03:13.937830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f0ae4-1fde-4976-bbc3-f64e35b67f65 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:03:13.941256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d328933-fef9-4ea8-aaea-b44f1dd9e83e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:03:13.941872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d328933-fef9-4ea8-aaea-b44f1dd9e83e service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:03:13.942152 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d328933-fef9-4ea8-aaea-b44f1dd9e83e service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:03:13.942421 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d328933-fef9-4ea8-aaea-b44f1dd9e83e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:03:13.951050 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d328933-fef9-4ea8-aaea-b44f1dd9e83e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:03:13.952462 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d328933-fef9-4ea8-aaea-b44f1dd9e83e service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:03:13.961636 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 767/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:03:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:03:23.599350 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=11 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:03:23.957618 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=8 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:41.434371 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cf6a6-3d79-4acb-af1a-aceccea446b1 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:41.435503 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cf6a6-3d79-4acb-af1a-aceccea446b1 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:41.435503 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cf6a6-3d79-4acb-af1a-aceccea446b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:41.460905 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-371cf6a6-3d79-4acb-af1a-aceccea446b1 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:41.462217 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-371cf6a6-3d79-4acb-af1a-aceccea446b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:41.476470 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 773/1540] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:41.485695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d0eaa-4af3-4dce-ab18-731775994b29 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:41.486882 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d0eaa-4af3-4dce-ab18-731775994b29 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:41.487932 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d0eaa-4af3-4dce-ab18-731775994b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:41.513857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-484d0eaa-4af3-4dce-ab18-731775994b29 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:41.515292 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-484d0eaa-4af3-4dce-ab18-731775994b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:41.529482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 768/1541] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:41.534100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cf6a6-3d79-4acb-af1a-aceccea446b1 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:41.546332 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cf6a6-3d79-4acb-af1a-aceccea446b1 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:41.547254 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33197db-0112-4b65-b240-1f0e6f2a9519 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:41.547550 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33197db-0112-4b65-b240-1f0e6f2a9519 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:41.547847 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33197db-0112-4b65-b240-1f0e6f2a9519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:41.557689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955e531-1f97-4221-ab0f-87bb2a77d668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:41.558341 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955e531-1f97-4221-ab0f-87bb2a77d668 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:41.558630 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955e531-1f97-4221-ab0f-87bb2a77d668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:41.558910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955e531-1f97-4221-ab0f-87bb2a77d668 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:41.559564 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955e531-1f97-4221-ab0f-87bb2a77d668 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:04:41.559871 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955e531-1f97-4221-ab0f-87bb2a77d668 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:41.562808 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955e531-1f97-4221-ab0f-87bb2a77d668 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:41.580003 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-f33197db-0112-4b65-b240-1f0e6f2a9519 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:41.582351 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f33197db-0112-4b65-b240-1f0e6f2a9519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:41.585289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 774/1542] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:04:41.595392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955e531-1f97-4221-ab0f-87bb2a77d668 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:41.598736 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 769/1543] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:04:41.607910 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69d2e9-19b6-4e3f-b888-6cfd9f9e9067 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:41.608209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69d2e9-19b6-4e3f-b888-6cfd9f9e9067 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:41.608434 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69d2e9-19b6-4e3f-b888-6cfd9f9e9067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:41.609772 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955e531-1f97-4221-ab0f-87bb2a77d668 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:41.630514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4686a-7560-48d0-9a60-9048a2bdf7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:41.631144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4686a-7560-48d0-9a60-9048a2bdf7ca admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:41.631432 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4686a-7560-48d0-9a60-9048a2bdf7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:41.631717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4686a-7560-48d0-9a60-9048a2bdf7ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:41.632361 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4686a-7560-48d0-9a60-9048a2bdf7ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:41.633617 dv-cinder-857528-1-smb devstack@keystone.service[81475]: WARNING py.warnings [None req-39c4686a-7560-48d0-9a60-9048a2bdf7ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 01:04:41.633617 dv-cinder-857528-1-smb devstack@keystone.service[81475]: warnings.warn(msg) Sep 14 01:04:41.633617 dv-cinder-857528-1-smb devstack@keystone.service[81475]: Sep 14 01:04:41.634872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4686a-7560-48d0-9a60-9048a2bdf7ca admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:41.643040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-0e69d2e9-19b6-4e3f-b888-6cfd9f9e9067 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:41.644876 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-0e69d2e9-19b6-4e3f-b888-6cfd9f9e9067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:41.664861 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 770/1544] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:04:41.670722 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69d2e9-19b6-4e3f-b888-6cfd9f9e9067 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:41.681465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69d2e9-19b6-4e3f-b888-6cfd9f9e9067 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:41.691985 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4e190-cd15-47bb-82b8-792dcee94c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:41.692614 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4e190-cd15-47bb-82b8-792dcee94c97 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:41.692900 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4e190-cd15-47bb-82b8-792dcee94c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:41.693323 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4e190-cd15-47bb-82b8-792dcee94c97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:41.694012 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4e190-cd15-47bb-82b8-792dcee94c97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:04:41.694494 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4e190-cd15-47bb-82b8-792dcee94c97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:41.696469 dv-cinder-857528-1-smb devstack@keystone.service[81476]: WARNING py.warnings [None req-6da4e190-cd15-47bb-82b8-792dcee94c97 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 01:04:41.696469 dv-cinder-857528-1-smb devstack@keystone.service[81476]: warnings.warn(msg) Sep 14 01:04:41.696469 dv-cinder-857528-1-smb devstack@keystone.service[81476]: Sep 14 01:04:41.698364 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4e190-cd15-47bb-82b8-792dcee94c97 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:41.722952 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 771/1545] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 01:04:41.732352 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4e190-cd15-47bb-82b8-792dcee94c97 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:41.746627 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4e190-cd15-47bb-82b8-792dcee94c97 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:41.752142 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b950e-25b3-4311-978c-7955f4b7cb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:41.758188 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b950e-25b3-4311-978c-7955f4b7cb8b admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:41.758619 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b950e-25b3-4311-978c-7955f4b7cb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:41.758897 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b950e-25b3-4311-978c-7955f4b7cb8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:41.759568 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b950e-25b3-4311-978c-7955f4b7cb8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:41.762325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b950e-25b3-4311-978c-7955f4b7cb8b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:41.766037 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 775/1546] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:04:41 2022] POST /identity/v3/projects => generated 389 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:41.767347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f47b6-e73a-476a-b3a0-49bb871a8b3c None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:41.767636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f47b6-e73a-476a-b3a0-49bb871a8b3c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:41.768184 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f47b6-e73a-476a-b3a0-49bb871a8b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:41.803551 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 772/1547] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:04:41 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:41.805003 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd85ce3-0358-46a6-b3b3-c199a6e351b4 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:41.805291 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd85ce3-0358-46a6-b3b3-c199a6e351b4 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:41.805562 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd85ce3-0358-46a6-b3b3-c199a6e351b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:41.825874 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-7e4f47b6-e73a-476a-b3a0-49bb871a8b3c None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:41.828789 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7e4f47b6-e73a-476a-b3a0-49bb871a8b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:41.835353 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-ffd85ce3-0358-46a6-b3b3-c199a6e351b4 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:41.836536 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ffd85ce3-0358-46a6-b3b3-c199a6e351b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:41.907813 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 773/1548] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:41.909324 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd85ce3-0358-46a6-b3b3-c199a6e351b4 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:41.915300 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 776/1549] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:41.916801 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c876f66-96d1-4393-81a2-5b548b7977a3 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:41.917093 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c876f66-96d1-4393-81a2-5b548b7977a3 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:41.917373 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c876f66-96d1-4393-81a2-5b548b7977a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:41.919596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd85ce3-0358-46a6-b3b3-c199a6e351b4 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:41.924457 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d65a98-75bb-4e7f-9b97-57140c842dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:41.925590 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d65a98-75bb-4e7f-9b97-57140c842dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:41.925942 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d65a98-75bb-4e7f-9b97-57140c842dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:41.926492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d65a98-75bb-4e7f-9b97-57140c842dd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:41.927137 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d65a98-75bb-4e7f-9b97-57140c842dd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:41.929154 dv-cinder-857528-1-smb devstack@keystone.service[81476]: WARNING py.warnings [None req-35d65a98-75bb-4e7f-9b97-57140c842dd4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 01:04:41.929154 dv-cinder-857528-1-smb devstack@keystone.service[81476]: warnings.warn(msg) Sep 14 01:04:41.929154 dv-cinder-857528-1-smb devstack@keystone.service[81476]: Sep 14 01:04:41.930406 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d65a98-75bb-4e7f-9b97-57140c842dd4 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:41.938428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-0c876f66-96d1-4393-81a2-5b548b7977a3 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:41.939648 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0c876f66-96d1-4393-81a2-5b548b7977a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:41.947663 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 777/1550] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:41.948415 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c876f66-96d1-4393-81a2-5b548b7977a3 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:41.957273 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 774/1551] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:04:41 2022] POST /identity/v3/users => generated 295 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:41.958443 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c876f66-96d1-4393-81a2-5b548b7977a3 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:41.959265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca1d07-def2-4fc1-b71a-5bdad1cf1b19 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:41.959693 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca1d07-def2-4fc1-b71a-5bdad1cf1b19 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:41.960013 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca1d07-def2-4fc1-b71a-5bdad1cf1b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:41.963769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560902d-773b-4d5e-8586-0c5d1cc87947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:41.964354 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560902d-773b-4d5e-8586-0c5d1cc87947 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:41.964630 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560902d-773b-4d5e-8586-0c5d1cc87947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:41.964899 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560902d-773b-4d5e-8586-0c5d1cc87947 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:41.965535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560902d-773b-4d5e-8586-0c5d1cc87947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:41.967449 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560902d-773b-4d5e-8586-0c5d1cc87947 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:41.980719 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-31ca1d07-def2-4fc1-b71a-5bdad1cf1b19 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:41.985076 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-31ca1d07-def2-4fc1-b71a-5bdad1cf1b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:41.994213 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 775/1552] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:41.994213 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf0a92-0a16-4539-9331-cb7bb8ead6f8 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:41.994213 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf0a92-0a16-4539-9331-cb7bb8ead6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:41.994213 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf0a92-0a16-4539-9331-cb7bb8ead6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.002364 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 778/1553] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:04:41 2022] POST /identity/v3/users => generated 287 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:42.003781 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a0eb2-1336-4dab-9ae4-8f3488953184 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.004073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a0eb2-1336-4dab-9ae4-8f3488953184 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.004352 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a0eb2-1336-4dab-9ae4-8f3488953184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.012195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-d3cf0a92-0a16-4539-9331-cb7bb8ead6f8 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:42.013392 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d3cf0a92-0a16-4539-9331-cb7bb8ead6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:42.021474 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 776/1554] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:42.022490 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f75c8-2268-4081-8f83-71e832a3fa3c None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.022773 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f75c8-2268-4081-8f83-71e832a3fa3c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.023109 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f75c8-2268-4081-8f83-71e832a3fa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.024026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-b20a0eb2-1336-4dab-9ae4-8f3488953184 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:42.025244 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b20a0eb2-1336-4dab-9ae4-8f3488953184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:42.035812 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 779/1555] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:42.036844 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbab78-db3b-4ed5-b803-fab2ef2eb619 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.037130 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbab78-db3b-4ed5-b803-fab2ef2eb619 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.037397 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbab78-db3b-4ed5-b803-fab2ef2eb619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.044171 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-898f75c8-2268-4081-8f83-71e832a3fa3c None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:42.045425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-898f75c8-2268-4081-8f83-71e832a3fa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:42.053671 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 777/1556] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:42.054952 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7aee06-9093-4de6-aea3-d874c74b5eed None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.055236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7aee06-9093-4de6-aea3-d874c74b5eed None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.055506 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7aee06-9093-4de6-aea3-d874c74b5eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.056694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-d5cbab78-db3b-4ed5-b803-fab2ef2eb619 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:42.057981 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d5cbab78-db3b-4ed5-b803-fab2ef2eb619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:42.067296 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 780/1557] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:42.068475 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbab78-db3b-4ed5-b803-fab2ef2eb619 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:42.077646 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbab78-db3b-4ed5-b803-fab2ef2eb619 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:42.081496 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-fd7aee06-9093-4de6-aea3-d874c74b5eed None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:42.082781 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fd7aee06-9093-4de6-aea3-d874c74b5eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:42.082908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627d796-3379-4dd0-9885-0cd8fd4e0969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:42.083453 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627d796-3379-4dd0-9885-0cd8fd4e0969 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.083729 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627d796-3379-4dd0-9885-0cd8fd4e0969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.083997 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627d796-3379-4dd0-9885-0cd8fd4e0969 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.084622 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627d796-3379-4dd0-9885-0cd8fd4e0969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:42.086262 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627d796-3379-4dd0-9885-0cd8fd4e0969 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:42.090668 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 778/1558] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:42.095147 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e3fd5-08cd-4404-8470-65913a2e9833 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.095553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e3fd5-08cd-4404-8470-65913a2e9833 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.095834 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e3fd5-08cd-4404-8470-65913a2e9833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.099491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 781/1559] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:42.099491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627d796-3379-4dd0-9885-0cd8fd4e0969 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:42.106671 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627d796-3379-4dd0-9885-0cd8fd4e0969 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:42.111209 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9469dcc-6181-4f7d-9837-99981bd7853b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:42.111777 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9469dcc-6181-4f7d-9837-99981bd7853b admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.112071 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9469dcc-6181-4f7d-9837-99981bd7853b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.112342 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9469dcc-6181-4f7d-9837-99981bd7853b admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.112957 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9469dcc-6181-4f7d-9837-99981bd7853b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:42.114549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9469dcc-6181-4f7d-9837-99981bd7853b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:42.117144 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-381e3fd5-08cd-4404-8470-65913a2e9833 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:42.118357 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-381e3fd5-08cd-4404-8470-65913a2e9833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:42.126597 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 782/1560] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:42.126597 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1016c-204f-4f6c-adf9-0f0c371abf3b None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.126597 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1016c-204f-4f6c-adf9-0f0c371abf3b None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.126597 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1016c-204f-4f6c-adf9-0f0c371abf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.129244 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 779/1561] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:42.130008 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e3fd5-08cd-4404-8470-65913a2e9833 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:42.139679 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e3fd5-08cd-4404-8470-65913a2e9833 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:42.144866 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a7430-283b-4cd0-8e2f-44031a132da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:42.145003 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-a1f1016c-204f-4f6c-adf9-0f0c371abf3b None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:42.145440 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a7430-283b-4cd0-8e2f-44031a132da6 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.145721 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a7430-283b-4cd0-8e2f-44031a132da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.146021 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a7430-283b-4cd0-8e2f-44031a132da6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.146133 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a1f1016c-204f-4f6c-adf9-0f0c371abf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:42.146657 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a7430-283b-4cd0-8e2f-44031a132da6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:04:42.146956 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a7430-283b-4cd0-8e2f-44031a132da6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:42.148530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a7430-283b-4cd0-8e2f-44031a132da6 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:42.154248 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 783/1562] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:42.155393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af521d6-958f-45b5-8a6b-21295bb4681f None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.155679 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af521d6-958f-45b5-8a6b-21295bb4681f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.155948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af521d6-958f-45b5-8a6b-21295bb4681f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.170132 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 780/1563] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:04:42.170132 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a7430-283b-4cd0-8e2f-44031a132da6 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:42.175272 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-0af521d6-958f-45b5-8a6b-21295bb4681f None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:42.176450 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0af521d6-958f-45b5-8a6b-21295bb4681f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:42.180753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a7430-283b-4cd0-8e2f-44031a132da6 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:42.184237 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 784/1564] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:42.184843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af521d6-958f-45b5-8a6b-21295bb4681f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:42.185094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4b58b-8988-4184-87ac-aef248c2013e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:42.185683 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4b58b-8988-4184-87ac-aef248c2013e admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.186021 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4b58b-8988-4184-87ac-aef248c2013e admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.186295 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4b58b-8988-4184-87ac-aef248c2013e admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.186928 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4b58b-8988-4184-87ac-aef248c2013e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:04:42.187228 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4b58b-8988-4184-87ac-aef248c2013e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:42.188849 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4b58b-8988-4184-87ac-aef248c2013e admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:42.194953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af521d6-958f-45b5-8a6b-21295bb4681f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:42.199861 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88ec06-9b1b-4150-a91b-83e7b53a0aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:42.200448 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88ec06-9b1b-4150-a91b-83e7b53a0aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.200748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88ec06-9b1b-4150-a91b-83e7b53a0aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.201052 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 781/1565] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:04:42.201358 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88ec06-9b1b-4150-a91b-83e7b53a0aa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.201868 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4b58b-8988-4184-87ac-aef248c2013e admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:42.202124 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88ec06-9b1b-4150-a91b-83e7b53a0aa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:04:42.202463 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88ec06-9b1b-4150-a91b-83e7b53a0aa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:42.204120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88ec06-9b1b-4150-a91b-83e7b53a0aa0 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:42.212145 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4b58b-8988-4184-87ac-aef248c2013e admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:42.216756 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78c2cd-f8c3-4dca-9a9a-0588fd5ba36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:42.216926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 785/1566] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:04:42.217201 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78c2cd-f8c3-4dca-9a9a-0588fd5ba36a admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.217478 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78c2cd-f8c3-4dca-9a9a-0588fd5ba36a admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.217747 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78c2cd-f8c3-4dca-9a9a-0588fd5ba36a admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.218409 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78c2cd-f8c3-4dca-9a9a-0588fd5ba36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:42.219984 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78c2cd-f8c3-4dca-9a9a-0588fd5ba36a admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:42.222782 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88ec06-9b1b-4150-a91b-83e7b53a0aa0 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:42.232952 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 782/1567] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:42.232952 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78c2cd-f8c3-4dca-9a9a-0588fd5ba36a admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:42.235640 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88ec06-9b1b-4150-a91b-83e7b53a0aa0 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:42.240196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78c2cd-f8c3-4dca-9a9a-0588fd5ba36a admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:42.240749 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c91af-84d7-4818-a9ca-39f103f7b686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:42.241379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c91af-84d7-4818-a9ca-39f103f7b686 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.241686 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c91af-84d7-4818-a9ca-39f103f7b686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.241986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c91af-84d7-4818-a9ca-39f103f7b686 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.242615 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c91af-84d7-4818-a9ca-39f103f7b686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:42.244170 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c91af-84d7-4818-a9ca-39f103f7b686 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:42.245090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce116b-97cd-421b-9e24-b7287a50a01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:42.245657 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce116b-97cd-421b-9e24-b7287a50a01d admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.245978 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce116b-97cd-421b-9e24-b7287a50a01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.246249 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce116b-97cd-421b-9e24-b7287a50a01d admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.246872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce116b-97cd-421b-9e24-b7287a50a01d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:04:42.247171 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce116b-97cd-421b-9e24-b7287a50a01d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:42.248754 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce116b-97cd-421b-9e24-b7287a50a01d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:42.254654 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 786/1568] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:42.255442 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c91af-84d7-4818-a9ca-39f103f7b686 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:42.263178 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 783/1569] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:04:42.264138 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce116b-97cd-421b-9e24-b7287a50a01d admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:42.264782 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c91af-84d7-4818-a9ca-39f103f7b686 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:42.269865 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd212f99-35c1-4a75-a48d-9677045e54df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:42.270444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd212f99-35c1-4a75-a48d-9677045e54df admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.270827 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd212f99-35c1-4a75-a48d-9677045e54df admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.271012 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd212f99-35c1-4a75-a48d-9677045e54df admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.271603 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd212f99-35c1-4a75-a48d-9677045e54df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:04:42.271897 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd212f99-35c1-4a75-a48d-9677045e54df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:42.273469 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd212f99-35c1-4a75-a48d-9677045e54df admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:42.276909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:42.280845 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce116b-97cd-421b-9e24-b7287a50a01d admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:42.282519 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:42.286353 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 787/1570] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:04:42.287135 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd212f99-35c1-4a75-a48d-9677045e54df admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:42.287249 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e65e4f-2358-42a1-a731-ad22b2c13789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:42.287792 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e65e4f-2358-42a1-a731-ad22b2c13789 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.288071 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e65e4f-2358-42a1-a731-ad22b2c13789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.288340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e65e4f-2358-42a1-a731-ad22b2c13789 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.288958 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e65e4f-2358-42a1-a731-ad22b2c13789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:42.290882 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e65e4f-2358-42a1-a731-ad22b2c13789 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:42.304138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd212f99-35c1-4a75-a48d-9677045e54df admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:42.309110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba28cd-9ec4-4e6b-af8a-0e53b9c2f592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:42.309703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba28cd-9ec4-4e6b-af8a-0e53b9c2f592 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.310015 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba28cd-9ec4-4e6b-af8a-0e53b9c2f592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.310306 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba28cd-9ec4-4e6b-af8a-0e53b9c2f592 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.310935 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba28cd-9ec4-4e6b-af8a-0e53b9c2f592 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:04:42.311263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba28cd-9ec4-4e6b-af8a-0e53b9c2f592 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:42.312796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba28cd-9ec4-4e6b-af8a-0e53b9c2f592 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:42.318071 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 784/1571] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:04:42 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:42.318869 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e65e4f-2358-42a1-a731-ad22b2c13789 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:42.325273 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 788/1572] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:04:42.325273 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba28cd-9ec4-4e6b-af8a-0e53b9c2f592 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:42.338301 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba28cd-9ec4-4e6b-af8a-0e53b9c2f592 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:42.381097 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e65e4f-2358-42a1-a731-ad22b2c13789 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:42.385850 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b5b73-a0b3-4164-880d-eb439972075c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:42.386451 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b5b73-a0b3-4164-880d-eb439972075c admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.386733 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b5b73-a0b3-4164-880d-eb439972075c admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.387004 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b5b73-a0b3-4164-880d-eb439972075c admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.387625 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b5b73-a0b3-4164-880d-eb439972075c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:42.389532 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b5b73-a0b3-4164-880d-eb439972075c admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:42.396230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef976d8-d1ba-4ceb-a7b9-7ffdeb2ee7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:42.396838 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef976d8-d1ba-4ceb-a7b9-7ffdeb2ee7e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.397119 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef976d8-d1ba-4ceb-a7b9-7ffdeb2ee7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.397388 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef976d8-d1ba-4ceb-a7b9-7ffdeb2ee7e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.398041 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef976d8-d1ba-4ceb-a7b9-7ffdeb2ee7e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:42.399929 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef976d8-d1ba-4ceb-a7b9-7ffdeb2ee7e5 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:42.419878 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 785/1573] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:04:42 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:42.420944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b5b73-a0b3-4164-880d-eb439972075c admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:42.433748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 789/1574] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:04:42 2022] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:42.433748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef976d8-d1ba-4ceb-a7b9-7ffdeb2ee7e5 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:42.488001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b5b73-a0b3-4164-880d-eb439972075c admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:42.490225 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef976d8-d1ba-4ceb-a7b9-7ffdeb2ee7e5 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:42.492551 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1834547-096f-4f1c-84fb-6ad425010a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:42.493196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1834547-096f-4f1c-84fb-6ad425010a46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.493473 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1834547-096f-4f1c-84fb-6ad425010a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.493743 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1834547-096f-4f1c-84fb-6ad425010a46 admin admin] PATH_INFO: `/v3/projects/bed53281565444618feb8a98df16f5a7/users/bfd8052af6ab43beae0e8d6bb3af5bb0/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.494752 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6fe75-4161-4811-8a94-0341c843e322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:42.495399 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6fe75-4161-4811-8a94-0341c843e322 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.495676 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6fe75-4161-4811-8a94-0341c843e322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.495943 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6fe75-4161-4811-8a94-0341c843e322 admin admin] PATH_INFO: `/v3/projects/726dba76e5dc40169fe5d84551638ced/users/ab3b4141c9c64f05884d291f17ddb2ac/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.508389 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1834547-096f-4f1c-84fb-6ad425010a46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bed53281565444618feb8a98df16f5a7, user_id=bfd8052af6ab43beae0e8d6bb3af5bb0, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:42.510020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6fe75-4161-4811-8a94-0341c843e322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=726dba76e5dc40169fe5d84551638ced, user_id=ab3b4141c9c64f05884d291f17ddb2ac, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:42.511031 dv-cinder-857528-1-smb devstack@keystone.service[81475]: WARNING py.warnings [None req-e9d6fe75-4161-4811-8a94-0341c843e322 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 01:04:42.511031 dv-cinder-857528-1-smb devstack@keystone.service[81475]: warnings.warn(msg) Sep 14 01:04:42.511031 dv-cinder-857528-1-smb devstack@keystone.service[81475]: Sep 14 01:04:42.511308 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1834547-096f-4f1c-84fb-6ad425010a46 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:42.512947 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6fe75-4161-4811-8a94-0341c843e322 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:42.524494 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 786/1575] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:04:42 2022] PUT /identity/v3/projects/bed53281565444618feb8a98df16f5a7/users/bfd8052af6ab43beae0e8d6bb3af5bb0/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:42.524682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 790/1576] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:04:42 2022] PUT /identity/v3/projects/726dba76e5dc40169fe5d84551638ced/users/ab3b4141c9c64f05884d291f17ddb2ac/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:42.525433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6fe75-4161-4811-8a94-0341c843e322 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:42.526053 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1834547-096f-4f1c-84fb-6ad425010a46 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:42.589140 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:42.594046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:42.595404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6fe75-4161-4811-8a94-0341c843e322 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:42.601438 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e221aef-8a9a-462e-ad21-d682353bafa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:42.602073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e221aef-8a9a-462e-ad21-d682353bafa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.602354 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e221aef-8a9a-462e-ad21-d682353bafa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.602617 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e221aef-8a9a-462e-ad21-d682353bafa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.603335 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e221aef-8a9a-462e-ad21-d682353bafa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:42.605229 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e221aef-8a9a-462e-ad21-d682353bafa3 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:42.607091 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1834547-096f-4f1c-84fb-6ad425010a46 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:42.612606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb78d63-46da-497b-ae36-ca064fbdaf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:42.613211 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb78d63-46da-497b-ae36-ca064fbdaf9b admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.613488 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb78d63-46da-497b-ae36-ca064fbdaf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.613758 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb78d63-46da-497b-ae36-ca064fbdaf9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.614415 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb78d63-46da-497b-ae36-ca064fbdaf9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:42.616289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb78d63-46da-497b-ae36-ca064fbdaf9b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:42.635222 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 791/1577] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:04:42 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:42.638841 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e221aef-8a9a-462e-ad21-d682353bafa3 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:42.653888 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 787/1578] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:04:42 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:42.653888 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb78d63-46da-497b-ae36-ca064fbdaf9b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:42.704019 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e221aef-8a9a-462e-ad21-d682353bafa3 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:42.708518 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b16860-6113-493a-af8b-e17c04dbb2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:42.709122 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b16860-6113-493a-af8b-e17c04dbb2fb admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.709401 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b16860-6113-493a-af8b-e17c04dbb2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.709672 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b16860-6113-493a-af8b-e17c04dbb2fb admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.710338 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b16860-6113-493a-af8b-e17c04dbb2fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:42.711260 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb78d63-46da-497b-ae36-ca064fbdaf9b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:42.712249 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b16860-6113-493a-af8b-e17c04dbb2fb admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:42.715670 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f210b-e028-4e54-b1ed-617b59eb43a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:42.716289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f210b-e028-4e54-b1ed-617b59eb43a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.716560 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f210b-e028-4e54-b1ed-617b59eb43a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.716823 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f210b-e028-4e54-b1ed-617b59eb43a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.717434 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f210b-e028-4e54-b1ed-617b59eb43a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:42.719355 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f210b-e028-4e54-b1ed-617b59eb43a6 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:42.737857 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 792/1579] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:04:42 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:42.737857 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b16860-6113-493a-af8b-e17c04dbb2fb admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:42.746386 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b16860-6113-493a-af8b-e17c04dbb2fb admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:42.753308 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 788/1580] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:04:42 2022] POST /identity/v3/projects => generated 405 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:42.753308 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f210b-e028-4e54-b1ed-617b59eb43a6 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:42.753572 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093694bb-6b7e-4da4-a29d-eaae36c8b3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:42.753572 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093694bb-6b7e-4da4-a29d-eaae36c8b3d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.753572 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093694bb-6b7e-4da4-a29d-eaae36c8b3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.753572 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093694bb-6b7e-4da4-a29d-eaae36c8b3d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.753915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093694bb-6b7e-4da4-a29d-eaae36c8b3d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:42.754991 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093694bb-6b7e-4da4-a29d-eaae36c8b3d3 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:42.777370 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 793/1581] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:04:42 2022] POST /identity/v3/users => generated 290 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:42.778610 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ed344-942b-4464-a596-075df0bc94ac None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.778896 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ed344-942b-4464-a596-075df0bc94ac None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.779174 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ed344-942b-4464-a596-075df0bc94ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.800602 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-4f7ed344-942b-4464-a596-075df0bc94ac None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:42.802136 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4f7ed344-942b-4464-a596-075df0bc94ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:42.820750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f210b-e028-4e54-b1ed-617b59eb43a6 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:42.825261 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6bb81-0171-4160-83e4-18fd8fc59194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:42.825879 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6bb81-0171-4160-83e4-18fd8fc59194 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.826157 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6bb81-0171-4160-83e4-18fd8fc59194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.826424 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6bb81-0171-4160-83e4-18fd8fc59194 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.827039 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6bb81-0171-4160-83e4-18fd8fc59194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:42.828979 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6bb81-0171-4160-83e4-18fd8fc59194 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:42.850865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 789/1582] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:04:42 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:42.852229 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87606dc7-1784-40de-b621-c81beca8ac58 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.852516 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87606dc7-1784-40de-b621-c81beca8ac58 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.852788 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87606dc7-1784-40de-b621-c81beca8ac58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.865870 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 794/1583] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:42.866790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ed344-942b-4464-a596-075df0bc94ac None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:42.875827 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ed344-942b-4464-a596-075df0bc94ac None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:42.880613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3859e-bf19-44f9-9e3a-869f93e55379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:42.881209 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3859e-bf19-44f9-9e3a-869f93e55379 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.881488 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3859e-bf19-44f9-9e3a-869f93e55379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.881757 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3859e-bf19-44f9-9e3a-869f93e55379 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.882411 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3859e-bf19-44f9-9e3a-869f93e55379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:42.884319 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3859e-bf19-44f9-9e3a-869f93e55379 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:42.885678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-87606dc7-1784-40de-b621-c81beca8ac58 None None] MFA Rules not processed for user `ab3b4141c9c64f05884d291f17ddb2ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:42.887029 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-87606dc7-1784-40de-b621-c81beca8ac58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:42.907533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 795/1584] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:04:42 2022] POST /identity/v3/users => generated 283 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:42.908146 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3859e-bf19-44f9-9e3a-869f93e55379 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:42.917943 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3859e-bf19-44f9-9e3a-869f93e55379 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:42.922898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d47709-b9bc-4e86-9a41-90c85080af35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:42.923507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d47709-b9bc-4e86-9a41-90c85080af35 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.923786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d47709-b9bc-4e86-9a41-90c85080af35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.924058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d47709-b9bc-4e86-9a41-90c85080af35 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.924764 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d47709-b9bc-4e86-9a41-90c85080af35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:42.926772 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d47709-b9bc-4e86-9a41-90c85080af35 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:42.933385 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:42.949596 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 796/1585] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:04:42 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:42.950680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d47709-b9bc-4e86-9a41-90c85080af35 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:42.963026 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 790/1586] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:42.963195 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d47709-b9bc-4e86-9a41-90c85080af35 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:42.963848 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87606dc7-1784-40de-b621-c81beca8ac58 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:42.969151 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65614484-828b-4000-bb70-3acb137bd747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:42.969873 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65614484-828b-4000-bb70-3acb137bd747 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.970234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65614484-828b-4000-bb70-3acb137bd747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.970583 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65614484-828b-4000-bb70-3acb137bd747 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.971895 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65614484-828b-4000-bb70-3acb137bd747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:42.973622 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65614484-828b-4000-bb70-3acb137bd747 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:42.975464 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87606dc7-1784-40de-b621-c81beca8ac58 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:42.981475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f1ad1-d4ab-46bf-9664-ac9794e17db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:42.982229 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f1ad1-d4ab-46bf-9664-ac9794e17db3 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:42.982468 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f1ad1-d4ab-46bf-9664-ac9794e17db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:42.982636 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f1ad1-d4ab-46bf-9664-ac9794e17db3 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:42.983266 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f1ad1-d4ab-46bf-9664-ac9794e17db3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:42.985187 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f1ad1-d4ab-46bf-9664-ac9794e17db3 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:42.992011 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 797/1587] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:42.993295 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65614484-828b-4000-bb70-3acb137bd747 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:43.005079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65614484-828b-4000-bb70-3acb137bd747 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:43.011278 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e933f25-6058-4573-ad14-30e473cdac8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:43.011945 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e933f25-6058-4573-ad14-30e473cdac8d admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:43.012232 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e933f25-6058-4573-ad14-30e473cdac8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:43.012530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e933f25-6058-4573-ad14-30e473cdac8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:43.013171 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e933f25-6058-4573-ad14-30e473cdac8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:43.014789 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e933f25-6058-4573-ad14-30e473cdac8d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:43.018832 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 791/1588] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:04:42 2022] POST /identity/v3/users => generated 303 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:43.018832 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f1ad1-d4ab-46bf-9664-ac9794e17db3 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:43.019056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:43.027451 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f1ad1-d4ab-46bf-9664-ac9794e17db3 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:43.028665 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 798/1589] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:43.029698 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e933f25-6058-4573-ad14-30e473cdac8d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:43.033691 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ea484-6bc4-46ee-91b8-e8be7d52c6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:43.034389 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ea484-6bc4-46ee-91b8-e8be7d52c6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:43.034666 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ea484-6bc4-46ee-91b8-e8be7d52c6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:43.034935 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ea484-6bc4-46ee-91b8-e8be7d52c6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:43.035646 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ea484-6bc4-46ee-91b8-e8be7d52c6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:43.037234 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ea484-6bc4-46ee-91b8-e8be7d52c6a3 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:43.047846 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 792/1590] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:43.048623 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ea484-6bc4-46ee-91b8-e8be7d52c6a3 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:43.060554 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ea484-6bc4-46ee-91b8-e8be7d52c6a3 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:43.066098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d1016-1e9a-4f4c-a218-fbabcefbaa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:43.066666 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d1016-1e9a-4f4c-a218-fbabcefbaa5b admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:43.066941 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d1016-1e9a-4f4c-a218-fbabcefbaa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:43.067211 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d1016-1e9a-4f4c-a218-fbabcefbaa5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:43.067833 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d1016-1e9a-4f4c-a218-fbabcefbaa5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:43.069652 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d1016-1e9a-4f4c-a218-fbabcefbaa5b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:43.079951 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 793/1591] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:43.080785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d1016-1e9a-4f4c-a218-fbabcefbaa5b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:43.088312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e933f25-6058-4573-ad14-30e473cdac8d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:43.089733 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d1016-1e9a-4f4c-a218-fbabcefbaa5b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:43.091966 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b2dd4-6c69-4d40-b467-991a970eb975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:43.092572 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b2dd4-6c69-4d40-b467-991a970eb975 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:43.092853 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b2dd4-6c69-4d40-b467-991a970eb975 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:43.093129 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b2dd4-6c69-4d40-b467-991a970eb975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:43.094364 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a566e-09db-47fc-8063-c02244c3b63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:43.095021 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a566e-09db-47fc-8063-c02244c3b63f admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:43.095302 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a566e-09db-47fc-8063-c02244c3b63f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:43.095574 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a566e-09db-47fc-8063-c02244c3b63f admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:43.096259 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a566e-09db-47fc-8063-c02244c3b63f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:43.097873 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a566e-09db-47fc-8063-c02244c3b63f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:43.102105 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b2dd4-6c69-4d40-b467-991a970eb975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:43.103542 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b2dd4-6c69-4d40-b467-991a970eb975 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:43.107590 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 794/1592] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:43.111007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d2e80-a37d-4ec1-be3f-868155b6e668 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:43.111287 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d2e80-a37d-4ec1-be3f-868155b6e668 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:43.111556 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d2e80-a37d-4ec1-be3f-868155b6e668 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:43.113290 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 795/1593] 10.222.0.20 () {54 vars in 962 bytes} [Wed Sep 14 01:04:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 01:04:43.113979 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 799/1594] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:04:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:04:43.114109 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d2e80-a37d-4ec1-be3f-868155b6e668 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:43.114841 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b2dd4-6c69-4d40-b467-991a970eb975 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:43.126076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b2dd4-6c69-4d40-b467-991a970eb975 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:43.127301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d2e80-a37d-4ec1-be3f-868155b6e668 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:43.130798 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e9b3e-ee6b-4b18-b569-70477101cf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:43.131385 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e9b3e-ee6b-4b18-b569-70477101cf1c admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:43.131662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e9b3e-ee6b-4b18-b569-70477101cf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:43.131934 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e9b3e-ee6b-4b18-b569-70477101cf1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:43.132327 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb4c6c-58e2-471b-a3a0-d20ffc8c56f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:43.132560 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e9b3e-ee6b-4b18-b569-70477101cf1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:43.133156 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb4c6c-58e2-471b-a3a0-d20ffc8c56f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:43.133297 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb4c6c-58e2-471b-a3a0-d20ffc8c56f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:43.133495 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb4c6c-58e2-471b-a3a0-d20ffc8c56f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:43.134146 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb4c6c-58e2-471b-a3a0-d20ffc8c56f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:43.134272 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e9b3e-ee6b-4b18-b569-70477101cf1c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:43.135721 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb4c6c-58e2-471b-a3a0-d20ffc8c56f0 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:43.144939 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 800/1595] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:43.145635 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e9b3e-ee6b-4b18-b569-70477101cf1c admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:43.154532 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 796/1596] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:43.154532 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb4c6c-58e2-471b-a3a0-d20ffc8c56f0 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:43.157194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e9b3e-ee6b-4b18-b569-70477101cf1c admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:43.164710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b9f4c-0a32-4e6a-af09-0b9c4a8ab794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:43.164902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb4c6c-58e2-471b-a3a0-d20ffc8c56f0 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:43.165472 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b9f4c-0a32-4e6a-af09-0b9c4a8ab794 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:43.165688 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b9f4c-0a32-4e6a-af09-0b9c4a8ab794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:43.166009 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b9f4c-0a32-4e6a-af09-0b9c4a8ab794 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:43.166759 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b9f4c-0a32-4e6a-af09-0b9c4a8ab794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:43.168605 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b9f4c-0a32-4e6a-af09-0b9c4a8ab794 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:43.169795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc5056-5be5-4f38-bc1b-a3e3418c9104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:43.170452 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc5056-5be5-4f38-bc1b-a3e3418c9104 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:43.170724 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc5056-5be5-4f38-bc1b-a3e3418c9104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:43.170994 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc5056-5be5-4f38-bc1b-a3e3418c9104 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:43.171681 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc5056-5be5-4f38-bc1b-a3e3418c9104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:43.173289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc5056-5be5-4f38-bc1b-a3e3418c9104 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:43.181504 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 801/1597] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:43.182327 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b9f4c-0a32-4e6a-af09-0b9c4a8ab794 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:43.186851 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 797/1598] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:43.187714 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc5056-5be5-4f38-bc1b-a3e3418c9104 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:43.197266 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b9f4c-0a32-4e6a-af09-0b9c4a8ab794 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:43.199696 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc5056-5be5-4f38-bc1b-a3e3418c9104 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:43.203256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a5b5c-c1b4-4c81-8a92-9724050070ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:43.203865 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a5b5c-c1b4-4c81-8a92-9724050070ae admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:43.204217 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a5b5c-c1b4-4c81-8a92-9724050070ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:43.204425 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a5b5c-c1b4-4c81-8a92-9724050070ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:43.204775 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978bbd3-a425-4a82-82f4-9d4996d2b7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:43.205064 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a5b5c-c1b4-4c81-8a92-9724050070ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:43.205509 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978bbd3-a425-4a82-82f4-9d4996d2b7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:43.206542 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978bbd3-a425-4a82-82f4-9d4996d2b7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:43.206819 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978bbd3-a425-4a82-82f4-9d4996d2b7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:43.207274 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a5b5c-c1b4-4c81-8a92-9724050070ae admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:43.207465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978bbd3-a425-4a82-82f4-9d4996d2b7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:43.209043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978bbd3-a425-4a82-82f4-9d4996d2b7b1 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:43.219057 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 802/1599] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:43.223491 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 798/1600] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:43.223491 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978bbd3-a425-4a82-82f4-9d4996d2b7b1 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:43.224394 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8dbd8-92f1-4702-9930-d587fcca47d1 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:43.224697 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8dbd8-92f1-4702-9930-d587fcca47d1 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:43.224943 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8dbd8-92f1-4702-9930-d587fcca47d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:43.238635 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978bbd3-a425-4a82-82f4-9d4996d2b7b1 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:43.243933 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8cbdc-c5d4-4010-aea6-98076ca65d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:43.244915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8cbdc-c5d4-4010-aea6-98076ca65d5b admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:43.245349 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8cbdc-c5d4-4010-aea6-98076ca65d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:43.246615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8cbdc-c5d4-4010-aea6-98076ca65d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:43.247458 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8cbdc-c5d4-4010-aea6-98076ca65d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:43.249234 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8cbdc-c5d4-4010-aea6-98076ca65d5b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:43.261490 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 799/1601] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:43.262324 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8cbdc-c5d4-4010-aea6-98076ca65d5b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:43.269112 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-96a8dbd8-92f1-4702-9930-d587fcca47d1 None None] MFA Rules not processed for user `c05caac9e8b9498583780306887734be`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:43.270821 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-96a8dbd8-92f1-4702-9930-d587fcca47d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:43.274623 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8cbdc-c5d4-4010-aea6-98076ca65d5b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:43.279808 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045fc38-4d6d-4db4-b679-e702ac1d4452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:43.280449 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045fc38-4d6d-4db4-b679-e702ac1d4452 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:43.280766 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045fc38-4d6d-4db4-b679-e702ac1d4452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:43.281053 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045fc38-4d6d-4db4-b679-e702ac1d4452 admin admin] PATH_INFO: `/v3/projects/a096c51fd3034ca9ae0b71a8cbb1af17/users/2b5730c49e61438884e3d9f4451e3b9a/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:43.298815 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045fc38-4d6d-4db4-b679-e702ac1d4452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a096c51fd3034ca9ae0b71a8cbb1af17, user_id=2b5730c49e61438884e3d9f4451e3b9a, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:43.301672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045fc38-4d6d-4db4-b679-e702ac1d4452 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:43.316923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 800/1602] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:04:43 2022] PUT /identity/v3/projects/a096c51fd3034ca9ae0b71a8cbb1af17/users/2b5730c49e61438884e3d9f4451e3b9a/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:43.318643 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045fc38-4d6d-4db4-b679-e702ac1d4452 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:43.358831 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 803/1603] 10.222.0.20 () {58 vars in 1059 bytes} [Wed Sep 14 01:04:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:43.363152 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8dbd8-92f1-4702-9930-d587fcca47d1 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:43.376435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8dbd8-92f1-4702-9930-d587fcca47d1 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:43.397601 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045fc38-4d6d-4db4-b679-e702ac1d4452 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:43.402639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4069e-6966-4091-8f09-e36ae6c2a449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:43.403363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4069e-6966-4091-8f09-e36ae6c2a449 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:43.403703 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4069e-6966-4091-8f09-e36ae6c2a449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:43.404032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4069e-6966-4091-8f09-e36ae6c2a449 admin admin] PATH_INFO: `/v3/projects/432ef291111b4c1fba8630190dff0c53/users/0cf99358484c49c8bb4b55f4d0d852bd/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:43.420217 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4069e-6966-4091-8f09-e36ae6c2a449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=432ef291111b4c1fba8630190dff0c53, user_id=0cf99358484c49c8bb4b55f4d0d852bd, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:43.422950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4069e-6966-4091-8f09-e36ae6c2a449 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:43.423980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:43.438596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 801/1604] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:04:43 2022] PUT /identity/v3/projects/432ef291111b4c1fba8630190dff0c53/users/0cf99358484c49c8bb4b55f4d0d852bd/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:43.439420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4069e-6966-4091-8f09-e36ae6c2a449 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:43.445608 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:43.445850 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7cdfe8-f2fc-47ac-9ab3-ce431ed22430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:43.447159 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7cdfe8-f2fc-47ac-9ab3-ce431ed22430 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:43.447300 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7cdfe8-f2fc-47ac-9ab3-ce431ed22430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:43.447624 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7cdfe8-f2fc-47ac-9ab3-ce431ed22430 admin admin] PATH_INFO: `/v3/projects/1f0d081d730748f587aa7a3e93653c13/users/c6b688a53f9547eba0aa9cbb1b764b63/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:43.467911 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7cdfe8-f2fc-47ac-9ab3-ce431ed22430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f0d081d730748f587aa7a3e93653c13, user_id=c6b688a53f9547eba0aa9cbb1b764b63, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:43.472252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7cdfe8-f2fc-47ac-9ab3-ce431ed22430 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:43.489457 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 804/1605] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:04:43 2022] PUT /identity/v3/projects/1f0d081d730748f587aa7a3e93653c13/users/c6b688a53f9547eba0aa9cbb1b764b63/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:43.490227 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7cdfe8-f2fc-47ac-9ab3-ce431ed22430 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:43.515431 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4069e-6966-4091-8f09-e36ae6c2a449 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:43.572448 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7cdfe8-f2fc-47ac-9ab3-ce431ed22430 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:43.578554 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd246a-29cf-444f-9f8d-370311479cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:43.579258 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd246a-29cf-444f-9f8d-370311479cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:43.579794 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd246a-29cf-444f-9f8d-370311479cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:43.579953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd246a-29cf-444f-9f8d-370311479cc8 admin admin] PATH_INFO: `/v3/projects/548dcbaeea97445e9a1572cd3f069fb7/users/9db51bde7f6f404a86ebb27042efa0f4/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:43.587079 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66764a53-1b0f-495d-9617-0becded408c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:43.587955 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66764a53-1b0f-495d-9617-0becded408c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:43.588411 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66764a53-1b0f-495d-9617-0becded408c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:43.588844 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66764a53-1b0f-495d-9617-0becded408c6 admin admin] PATH_INFO: `/v3/projects/534146e04a5d492c9e2c52ce6eea64bc/users/80a18a920da747a9ae963578da37aa10/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:43.596735 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd246a-29cf-444f-9f8d-370311479cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=548dcbaeea97445e9a1572cd3f069fb7, user_id=9db51bde7f6f404a86ebb27042efa0f4, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:43.599565 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd246a-29cf-444f-9f8d-370311479cc8 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:43.608743 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66764a53-1b0f-495d-9617-0becded408c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=534146e04a5d492c9e2c52ce6eea64bc, user_id=80a18a920da747a9ae963578da37aa10, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:43.614417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66764a53-1b0f-495d-9617-0becded408c6 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:43.615767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 805/1606] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:04:43 2022] PUT /identity/v3/projects/548dcbaeea97445e9a1572cd3f069fb7/users/9db51bde7f6f404a86ebb27042efa0f4/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:43.616615 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd246a-29cf-444f-9f8d-370311479cc8 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:43.647878 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 802/1607] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:04:43 2022] PUT /identity/v3/projects/534146e04a5d492c9e2c52ce6eea64bc/users/80a18a920da747a9ae963578da37aa10/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:43.649382 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692adba-17ae-40dc-b90e-77f2d5da6574 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:43.650209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692adba-17ae-40dc-b90e-77f2d5da6574 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:43.650581 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692adba-17ae-40dc-b90e-77f2d5da6574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:43.674272 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-4692adba-17ae-40dc-b90e-77f2d5da6574 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:43.677007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4692adba-17ae-40dc-b90e-77f2d5da6574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:43.693110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd246a-29cf-444f-9f8d-370311479cc8 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:43.753411 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:43.757340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 803/1608] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:43.758426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692adba-17ae-40dc-b90e-77f2d5da6574 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:43.767602 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196b5d0-427e-4b90-9b76-706475be6d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:43.768955 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196b5d0-427e-4b90-9b76-706475be6d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:43.769165 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196b5d0-427e-4b90-9b76-706475be6d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:43.769451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196b5d0-427e-4b90-9b76-706475be6d1a admin admin] PATH_INFO: `/v3/projects/94b668e5b6934e2ab39416b8877a58a2/users/3e6d02a32f7940c5a7263d2054e4c96c/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:43.786449 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196b5d0-427e-4b90-9b76-706475be6d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b668e5b6934e2ab39416b8877a58a2, user_id=3e6d02a32f7940c5a7263d2054e4c96c, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:43.789194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196b5d0-427e-4b90-9b76-706475be6d1a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:43.809842 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:43.810641 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 806/1609] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:04:43 2022] PUT /identity/v3/projects/94b668e5b6934e2ab39416b8877a58a2/users/3e6d02a32f7940c5a7263d2054e4c96c/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:43.812262 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46a284-af07-42db-80d4-b9758a11a786 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:43.812719 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46a284-af07-42db-80d4-b9758a11a786 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:43.812999 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46a284-af07-42db-80d4-b9758a11a786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:43.844046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ec46a284-af07-42db-80d4-b9758a11a786 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:43.845417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ec46a284-af07-42db-80d4-b9758a11a786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:43.857719 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692adba-17ae-40dc-b90e-77f2d5da6574 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:43.919253 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 807/1610] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:43.919253 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd454e-88e6-47d4-96b5-102ba4a0215b None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:43.919253 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd454e-88e6-47d4-96b5-102ba4a0215b None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:43.919253 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd454e-88e6-47d4-96b5-102ba4a0215b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:43.942595 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-f0cd454e-88e6-47d4-96b5-102ba4a0215b None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:43.944189 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f0cd454e-88e6-47d4-96b5-102ba4a0215b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:43.953207 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae569c08-017e-42ca-a600-4f377be5a8a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:43.954164 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae569c08-017e-42ca-a600-4f377be5a8a2 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:43.954301 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 808/1611] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:43.954441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae569c08-017e-42ca-a600-4f377be5a8a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:43.954895 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae569c08-017e-42ca-a600-4f377be5a8a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:43.955541 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af54e3-0983-4c46-be0c-aa5581090047 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:43.956455 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af54e3-0983-4c46-be0c-aa5581090047 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:43.956775 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af54e3-0983-4c46-be0c-aa5581090047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:43.996005 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-94af54e3-0983-4c46-be0c-aa5581090047 None None] MFA Rules not processed for user `9db51bde7f6f404a86ebb27042efa0f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:43.997701 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-94af54e3-0983-4c46-be0c-aa5581090047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:44.053431 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae569c08-017e-42ca-a600-4f377be5a8a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:44.056299 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae569c08-017e-42ca-a600-4f377be5a8a2 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:44.070821 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 804/1612] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:04:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:04:44.086372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 809/1613] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:44.087286 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af54e3-0983-4c46-be0c-aa5581090047 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:44.090182 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3f04a-5b3d-4417-8d51-40ebd42a1d5b None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:44.092691 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3f04a-5b3d-4417-8d51-40ebd42a1d5b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:44.093050 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3f04a-5b3d-4417-8d51-40ebd42a1d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:44.130619 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-90b3f04a-5b3d-4417-8d51-40ebd42a1d5b None None] MFA Rules not processed for user `80a18a920da747a9ae963578da37aa10`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:44.132075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-90b3f04a-5b3d-4417-8d51-40ebd42a1d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:44.191898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af54e3-0983-4c46-be0c-aa5581090047 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:44.201754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfd0f5-aef2-4afb-8cb2-c4579958269b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:44.202647 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfd0f5-aef2-4afb-8cb2-c4579958269b service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:44.203111 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfd0f5-aef2-4afb-8cb2-c4579958269b service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:44.203576 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfd0f5-aef2-4afb-8cb2-c4579958269b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:44.215384 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:44.219541 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 805/1614] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:44.219541 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99221b4c-04b7-4301-99f8-815bd3f45c16 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:44.219541 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99221b4c-04b7-4301-99f8-815bd3f45c16 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:44.219541 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99221b4c-04b7-4301-99f8-815bd3f45c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:44.225141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfd0f5-aef2-4afb-8cb2-c4579958269b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:44.239937 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfd0f5-aef2-4afb-8cb2-c4579958269b service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:44.264457 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 810/1615] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:04:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:04:44.266950 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfd0f5-aef2-4afb-8cb2-c4579958269b service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:44.271080 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-62cfd0f5-aef2-4afb-8cb2-c4579958269b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:44.277047 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-99221b4c-04b7-4301-99f8-815bd3f45c16 None None] MFA Rules not processed for user `3e6d02a32f7940c5a7263d2054e4c96c`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:44.279537 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-99221b4c-04b7-4301-99f8-815bd3f45c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:44.291917 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfd0f5-aef2-4afb-8cb2-c4579958269b service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:44.297317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e16bc-d2e7-48f9-8412-fec528c5f1f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:44.298369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e16bc-d2e7-48f9-8412-fec528c5f1f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:44.298723 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e16bc-d2e7-48f9-8412-fec528c5f1f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:44.299189 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e16bc-d2e7-48f9-8412-fec528c5f1f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:44.306956 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:44.311790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e16bc-d2e7-48f9-8412-fec528c5f1f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:44.313565 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e16bc-d2e7-48f9-8412-fec528c5f1f9 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:44.348246 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 811/1616] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:04:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:04:44.349353 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e16bc-d2e7-48f9-8412-fec528c5f1f9 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:44.369626 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e16bc-d2e7-48f9-8412-fec528c5f1f9 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:44.378738 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aca241-cb72-4eae-867f-2e8d4748a024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:44.380375 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aca241-cb72-4eae-867f-2e8d4748a024 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:44.380828 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aca241-cb72-4eae-867f-2e8d4748a024 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:44.381154 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aca241-cb72-4eae-867f-2e8d4748a024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:44.408318 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aca241-cb72-4eae-867f-2e8d4748a024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:44.412947 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aca241-cb72-4eae-867f-2e8d4748a024 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:44.423864 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 806/1617] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:44 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:44.430185 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99221b4c-04b7-4301-99f8-815bd3f45c16 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:44.435000 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 812/1618] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:04:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:04:44.436278 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a783f59-8c1e-495a-ba9c-81422af2d15c None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:44.436568 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a783f59-8c1e-495a-ba9c-81422af2d15c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:44.436830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a783f59-8c1e-495a-ba9c-81422af2d15c None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:44.447661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99221b4c-04b7-4301-99f8-815bd3f45c16 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:44.453360 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 813/1619] 10.222.0.20 () {54 vars in 962 bytes} [Wed Sep 14 01:04:44 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 01:04:44.454930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669e022-947b-49da-a3a9-d789b3b30c6c None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:44.455229 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669e022-947b-49da-a3a9-d789b3b30c6c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:44.455502 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669e022-947b-49da-a3a9-d789b3b30c6c None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:44.457486 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 814/1620] 10.222.0.20 () {54 vars in 912 bytes} [Wed Sep 14 01:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 01:04:44.458060 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669e022-947b-49da-a3a9-d789b3b30c6c None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:44.465493 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece4fd4-1ecd-417c-b281-b594a1841350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:44.466789 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece4fd4-1ecd-417c-b281-b594a1841350 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:44.467447 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece4fd4-1ecd-417c-b281-b594a1841350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:44.468219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece4fd4-1ecd-417c-b281-b594a1841350 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:44.469175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece4fd4-1ecd-417c-b281-b594a1841350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:44.472496 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece4fd4-1ecd-417c-b281-b594a1841350 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:44.485509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669e022-947b-49da-a3a9-d789b3b30c6c None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:44.497425 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5309e2-1646-4084-aabc-a6d6424242ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:44.498592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5309e2-1646-4084-aabc-a6d6424242ad admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:44.498592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5309e2-1646-4084-aabc-a6d6424242ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:44.498873 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5309e2-1646-4084-aabc-a6d6424242ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:44.499435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5309e2-1646-4084-aabc-a6d6424242ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:44.501444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5309e2-1646-4084-aabc-a6d6424242ad admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:44.534385 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 807/1621] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:04:44 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:44.540437 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c7454-685f-4023-b94d-817376c0e9fc None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:44.542853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c7454-685f-4023-b94d-817376c0e9fc None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:44.543723 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c7454-685f-4023-b94d-817376c0e9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:44.573790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 815/1622] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:04:44 2022] POST /identity/v3/projects => generated 403 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:44.581455 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e019dba-8e3d-4ba9-9ae6-3e61bf987d54 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:44.584445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e019dba-8e3d-4ba9-9ae6-3e61bf987d54 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:44.584733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e019dba-8e3d-4ba9-9ae6-3e61bf987d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:44.592849 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-c93c7454-685f-4023-b94d-817376c0e9fc None None] MFA Rules not processed for user `c05caac9e8b9498583780306887734be`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:44.594794 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c93c7454-685f-4023-b94d-817376c0e9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:44.636116 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-9e019dba-8e3d-4ba9-9ae6-3e61bf987d54 None None] MFA Rules not processed for user `c05caac9e8b9498583780306887734be`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:44.638655 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-9e019dba-8e3d-4ba9-9ae6-3e61bf987d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:44.775526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 808/1623] 10.222.0.20 () {58 vars in 1059 bytes} [Wed Sep 14 01:04:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:44.776780 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c7454-685f-4023-b94d-817376c0e9fc None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:44.813088 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 816/1624] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 14 01:04:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:44.828739 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e019dba-8e3d-4ba9-9ae6-3e61bf987d54 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:44.885306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c7454-685f-4023-b94d-817376c0e9fc None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:44.891946 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71f245-64da-4a3c-b0b1-33307053ab9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:44.892306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71f245-64da-4a3c-b0b1-33307053ab9f admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:44.892580 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71f245-64da-4a3c-b0b1-33307053ab9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:44.892845 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71f245-64da-4a3c-b0b1-33307053ab9f admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:44.893708 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71f245-64da-4a3c-b0b1-33307053ab9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:44.895770 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71f245-64da-4a3c-b0b1-33307053ab9f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:44.906761 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:44.913121 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e019dba-8e3d-4ba9-9ae6-3e61bf987d54 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:44.925751 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1912bd-4527-4fd5-8e64-b5e180ed1b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:44.927872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1912bd-4527-4fd5-8e64-b5e180ed1b95 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:44.928770 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1912bd-4527-4fd5-8e64-b5e180ed1b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:44.929049 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1912bd-4527-4fd5-8e64-b5e180ed1b95 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:44.930669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1912bd-4527-4fd5-8e64-b5e180ed1b95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:44.935354 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1912bd-4527-4fd5-8e64-b5e180ed1b95 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:44.935675 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 809/1625] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:04:44 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:44.937077 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71f245-64da-4a3c-b0b1-33307053ab9f admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:44.962626 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71f245-64da-4a3c-b0b1-33307053ab9f admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:44.971150 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a55bc-f143-4c73-80a5-d8521ce804e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:44.972421 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a55bc-f143-4c73-80a5-d8521ce804e7 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:44.972824 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a55bc-f143-4c73-80a5-d8521ce804e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:44.973278 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a55bc-f143-4c73-80a5-d8521ce804e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:44.993231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 817/1626] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:04:44 2022] POST /identity/v3/users => generated 308 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:44.994745 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1912bd-4527-4fd5-8e64-b5e180ed1b95 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:45.094776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:45.122311 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a55bc-f143-4c73-80a5-d8521ce804e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:45.125318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a55bc-f143-4c73-80a5-d8521ce804e7 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:45.132303 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1912bd-4527-4fd5-8e64-b5e180ed1b95 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:45.138196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 810/1627] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:04:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:04:45.139729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a55bc-f143-4c73-80a5-d8521ce804e7 service nova] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:45.141026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473673a4-acc2-4ac9-8de7-167357147139 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:45.141724 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473673a4-acc2-4ac9-8de7-167357147139 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:45.142085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473673a4-acc2-4ac9-8de7-167357147139 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:45.143905 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473673a4-acc2-4ac9-8de7-167357147139 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:45.173870 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473673a4-acc2-4ac9-8de7-167357147139 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:45.176853 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473673a4-acc2-4ac9-8de7-167357147139 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:45.183190 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a55bc-f143-4c73-80a5-d8521ce804e7 service nova] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:45.195542 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e9957-3117-4d62-b177-0829a1b658ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:45.196224 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e9957-3117-4d62-b177-0829a1b658ff admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:45.196501 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e9957-3117-4d62-b177-0829a1b658ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:45.196768 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e9957-3117-4d62-b177-0829a1b658ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:45.197423 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e9957-3117-4d62-b177-0829a1b658ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:45.202836 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e9957-3117-4d62-b177-0829a1b658ff admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:45.206255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 818/1628] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:04:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:04:45.208579 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473673a4-acc2-4ac9-8de7-167357147139 service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:45.229925 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 811/1629] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:45.232600 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e9957-3117-4d62-b177-0829a1b658ff admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:45.236537 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473673a4-acc2-4ac9-8de7-167357147139 service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:45.243312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b528e-9075-45ed-967e-f0ea9cf9fa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:45.244104 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b528e-9075-45ed-967e-f0ea9cf9fa96 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:45.245643 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b528e-9075-45ed-967e-f0ea9cf9fa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:45.246072 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b528e-9075-45ed-967e-f0ea9cf9fa96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:45.247864 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b528e-9075-45ed-967e-f0ea9cf9fa96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:45.255107 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b528e-9075-45ed-967e-f0ea9cf9fa96 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:45.264173 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e9957-3117-4d62-b177-0829a1b658ff admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:45.287497 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 819/1630] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:45.287713 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5e747-e888-48e9-bd5a-67b5b716e944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:45.288181 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5e747-e888-48e9-bd5a-67b5b716e944 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:45.288466 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5e747-e888-48e9-bd5a-67b5b716e944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:45.291770 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5e747-e888-48e9-bd5a-67b5b716e944 admin admin] PATH_INFO: `/v3/projects/3d211a8b46f2499b9318c27127e1bb32/users/a804bf092f9b4109aad1d73a07941bf8/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:45.292983 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b528e-9075-45ed-967e-f0ea9cf9fa96 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:45.394174 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b528e-9075-45ed-967e-f0ea9cf9fa96 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:45.396975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5e747-e888-48e9-bd5a-67b5b716e944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d211a8b46f2499b9318c27127e1bb32, user_id=a804bf092f9b4109aad1d73a07941bf8, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:45.396975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5e747-e888-48e9-bd5a-67b5b716e944 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:45.397416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d26246-7d44-4025-9899-77cb33f07601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:45.397416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d26246-7d44-4025-9899-77cb33f07601 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:45.397416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d26246-7d44-4025-9899-77cb33f07601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:45.397416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d26246-7d44-4025-9899-77cb33f07601 admin admin] PATH_INFO: `/v3/projects/bb167cb341ad4619a393c7fe820d0d04/users/7c17be5943654c12a55f6090f7cb109a/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:45.411022 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 812/1631] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:04:45 2022] PUT /identity/v3/projects/3d211a8b46f2499b9318c27127e1bb32/users/a804bf092f9b4109aad1d73a07941bf8/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:45.420911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5e747-e888-48e9-bd5a-67b5b716e944 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:45.473428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d26246-7d44-4025-9899-77cb33f07601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb167cb341ad4619a393c7fe820d0d04, user_id=7c17be5943654c12a55f6090f7cb109a, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:45.489696 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d26246-7d44-4025-9899-77cb33f07601 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:45.525513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 820/1632] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:04:45 2022] PUT /identity/v3/projects/bb167cb341ad4619a393c7fe820d0d04/users/7c17be5943654c12a55f6090f7cb109a/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:45.529624 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d26246-7d44-4025-9899-77cb33f07601 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:45.531710 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5e747-e888-48e9-bd5a-67b5b716e944 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:45.661990 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d26246-7d44-4025-9899-77cb33f07601 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:45.669671 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36af80d-7f36-4b83-9e7f-44fc86760230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:45.670341 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36af80d-7f36-4b83-9e7f-44fc86760230 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:45.670341 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36af80d-7f36-4b83-9e7f-44fc86760230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:45.670952 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36af80d-7f36-4b83-9e7f-44fc86760230 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:45.671486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36af80d-7f36-4b83-9e7f-44fc86760230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:45.674135 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36af80d-7f36-4b83-9e7f-44fc86760230 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:45.675942 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:45.680162 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7cb68-0f37-40d1-9720-c9886d67a06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:45.680162 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7cb68-0f37-40d1-9720-c9886d67a06d admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:45.680162 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7cb68-0f37-40d1-9720-c9886d67a06d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:45.680162 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7cb68-0f37-40d1-9720-c9886d67a06d admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:45.682263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7cb68-0f37-40d1-9720-c9886d67a06d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:45.682263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7cb68-0f37-40d1-9720-c9886d67a06d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:45.707957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 813/1633] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:45.708159 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 821/1634] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:45.708277 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36af80d-7f36-4b83-9e7f-44fc86760230 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:45.710201 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7cb68-0f37-40d1-9720-c9886d67a06d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:45.731188 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36af80d-7f36-4b83-9e7f-44fc86760230 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:45.732390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7cb68-0f37-40d1-9720-c9886d67a06d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:45.740692 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a394ddd-7c68-4410-8a9c-bb270b33d077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:45.741757 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a394ddd-7c68-4410-8a9c-bb270b33d077 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:45.742086 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a394ddd-7c68-4410-8a9c-bb270b33d077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:45.742366 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a394ddd-7c68-4410-8a9c-bb270b33d077 admin admin] PATH_INFO: `/v3/projects/bb167cb341ad4619a393c7fe820d0d04/users/7c17be5943654c12a55f6090f7cb109a/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:45.746808 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a394ddd-7c68-4410-8a9c-bb270b33d077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb167cb341ad4619a393c7fe820d0d04, user_id=7c17be5943654c12a55f6090f7cb109a, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:45.747784 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dcbc53-d975-4ed3-89b4-872a86b1dfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:45.748606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcbc53-d975-4ed3-89b4-872a86b1dfd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:45.748887 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcbc53-d975-4ed3-89b4-872a86b1dfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:45.749158 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcbc53-d975-4ed3-89b4-872a86b1dfd9 admin admin] PATH_INFO: `/v3/projects/3d211a8b46f2499b9318c27127e1bb32/users/a804bf092f9b4109aad1d73a07941bf8/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:45.751081 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a394ddd-7c68-4410-8a9c-bb270b33d077 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:45.751941 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dcbc53-d975-4ed3-89b4-872a86b1dfd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d211a8b46f2499b9318c27127e1bb32, user_id=a804bf092f9b4109aad1d73a07941bf8, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:45.754862 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dcbc53-d975-4ed3-89b4-872a86b1dfd9 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:45.792199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 822/1636] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:04:45 2022] PUT /identity/v3/projects/bb167cb341ad4619a393c7fe820d0d04/users/7c17be5943654c12a55f6090f7cb109a/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:04:45.795052 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 814/1636] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:04:45 2022] PUT /identity/v3/projects/3d211a8b46f2499b9318c27127e1bb32/users/a804bf092f9b4109aad1d73a07941bf8/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:45.795551 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9f968-1b25-4f3b-a1fd-dd22f9d25540 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:45.795849 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9f968-1b25-4f3b-a1fd-dd22f9d25540 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:45.796126 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9f968-1b25-4f3b-a1fd-dd22f9d25540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:45.799152 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c5adc-f098-4b01-af5c-037b43157782 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:45.800071 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c5adc-f098-4b01-af5c-037b43157782 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:45.800347 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c5adc-f098-4b01-af5c-037b43157782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:45.844231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-27f9f968-1b25-4f3b-a1fd-dd22f9d25540 None None] MFA Rules not processed for user `7c17be5943654c12a55f6090f7cb109a`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:45.846920 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-27f9f968-1b25-4f3b-a1fd-dd22f9d25540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:45.865025 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-719c5adc-f098-4b01-af5c-037b43157782 None None] MFA Rules not processed for user `a804bf092f9b4109aad1d73a07941bf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:45.869513 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-719c5adc-f098-4b01-af5c-037b43157782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:46.067189 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 823/1637] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:45 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:46.070860 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 815/1638] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:46.085357 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9f968-1b25-4f3b-a1fd-dd22f9d25540 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:46.121650 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:46.172356 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ce454-c767-48e5-a1c0-e4e687c46891 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:46.172356 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ce454-c767-48e5-a1c0-e4e687c46891 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:46.172653 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ce454-c767-48e5-a1c0-e4e687c46891 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:46.174908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 816/1639] 10.222.0.20 () {54 vars in 912 bytes} [Wed Sep 14 01:04:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 01:04:46.182243 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4be38-c782-4d90-a114-cc50194527ad None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:46.183223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4be38-c782-4d90-a114-cc50194527ad None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:46.183503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4be38-c782-4d90-a114-cc50194527ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:46.218093 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9f968-1b25-4f3b-a1fd-dd22f9d25540 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:46.232103 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827dfa3-db4e-4f43-b455-8c9966d7193e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:46.235386 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827dfa3-db4e-4f43-b455-8c9966d7193e service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:46.235680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827dfa3-db4e-4f43-b455-8c9966d7193e service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:46.236815 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827dfa3-db4e-4f43-b455-8c9966d7193e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:46.242429 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-33f4be38-c782-4d90-a114-cc50194527ad None None] MFA Rules not processed for user `c05caac9e8b9498583780306887734be`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:46.244671 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-33f4be38-c782-4d90-a114-cc50194527ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:46.264548 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827dfa3-db4e-4f43-b455-8c9966d7193e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:46.269213 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827dfa3-db4e-4f43-b455-8c9966d7193e service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:46.309166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 824/1640] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:04:46 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:04:46.440183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827dfa3-db4e-4f43-b455-8c9966d7193e service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:46.474148 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827dfa3-db4e-4f43-b455-8c9966d7193e service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:46.487732 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9a897-d89e-4652-85f0-22617c54778b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:46.488731 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9a897-d89e-4652-85f0-22617c54778b service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:46.489882 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9a897-d89e-4652-85f0-22617c54778b service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:46.490414 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9a897-d89e-4652-85f0-22617c54778b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:46.501202 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 817/1641] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 14 01:04:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:04:46.511568 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9a897-d89e-4652-85f0-22617c54778b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:46.514326 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9a897-d89e-4652-85f0-22617c54778b service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:46.545559 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 825/1642] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:04:46 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 01:04:46.699870 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4be38-c782-4d90-a114-cc50194527ad None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:46.713458 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4be38-c782-4d90-a114-cc50194527ad None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:46.725916 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f1201-db15-45bd-96bd-5cf56486dcd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:46.726557 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f1201-db15-45bd-96bd-5cf56486dcd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:46.726833 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f1201-db15-45bd-96bd-5cf56486dcd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:46.727100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f1201-db15-45bd-96bd-5cf56486dcd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:46.748510 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f1201-db15-45bd-96bd-5cf56486dcd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:46.750123 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f1201-db15-45bd-96bd-5cf56486dcd2 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:46.791252 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 818/1643] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:04:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:04:46.994980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9a897-d89e-4652-85f0-22617c54778b service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:47.093662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9a897-d89e-4652-85f0-22617c54778b service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:47.111626 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e5113-adf0-43fe-86fa-f6f8dff83757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:47.113964 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e5113-adf0-43fe-86fa-f6f8dff83757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:47.114261 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e5113-adf0-43fe-86fa-f6f8dff83757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:47.114932 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e5113-adf0-43fe-86fa-f6f8dff83757 admin admin] PATH_INFO: `/v3/users/3e6d02a32f7940c5a7263d2054e4c96c` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:47.170333 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e5113-adf0-43fe-86fa-f6f8dff83757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e6d02a32f7940c5a7263d2054e4c96c)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:47.170333 dv-cinder-857528-1-smb devstack@keystone.service[81475]: WARNING py.warnings [None req-8b9e5113-adf0-43fe-86fa-f6f8dff83757 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 01:04:47.170333 dv-cinder-857528-1-smb devstack@keystone.service[81475]: warnings.warn(msg) Sep 14 01:04:47.170333 dv-cinder-857528-1-smb devstack@keystone.service[81475]: Sep 14 01:04:47.170333 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e5113-adf0-43fe-86fa-f6f8dff83757 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:47.301238 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f1201-db15-45bd-96bd-5cf56486dcd2 service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:47.311532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-8b9e5113-adf0-43fe-86fa-f6f8dff83757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e6d02a32f7940c5a7263d2054e4c96c'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:47.322581 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f1201-db15-45bd-96bd-5cf56486dcd2 service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:47.336498 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-8b9e5113-adf0-43fe-86fa-f6f8dff83757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e6d02a32f7940c5a7263d2054e4c96c'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:47.339419 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d89291-f131-4687-9085-9b3ef4a9b835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:47.343170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d89291-f131-4687-9085-9b3ef4a9b835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:47.343664 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d89291-f131-4687-9085-9b3ef4a9b835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:47.344783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d89291-f131-4687-9085-9b3ef4a9b835 admin admin] PATH_INFO: `/v3/users/80a18a920da747a9ae963578da37aa10` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:47.350069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d89291-f131-4687-9085-9b3ef4a9b835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80a18a920da747a9ae963578da37aa10)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:47.353302 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d89291-f131-4687-9085-9b3ef4a9b835 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:47.390903 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-8b9e5113-adf0-43fe-86fa-f6f8dff83757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e6d02a32f7940c5a7263d2054e4c96c'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:47.391840 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-8b9e5113-adf0-43fe-86fa-f6f8dff83757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e6d02a32f7940c5a7263d2054e4c96c'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:47.392399 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-8b9e5113-adf0-43fe-86fa-f6f8dff83757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e6d02a32f7940c5a7263d2054e4c96c'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:47.426167 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 826/1644] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:04:46 2022] DELETE /identity/v3/users/3e6d02a32f7940c5a7263d2054e4c96c => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:47.428395 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c10cb-ed31-42d2-9f08-100377f74ed1 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:47.430657 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c10cb-ed31-42d2-9f08-100377f74ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:47.431122 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c10cb-ed31-42d2-9f08-100377f74ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:47.432841 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:47.441973 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-59d89291-f131-4687-9085-9b3ef4a9b835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80a18a920da747a9ae963578da37aa10'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:47.443632 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-59d89291-f131-4687-9085-9b3ef4a9b835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80a18a920da747a9ae963578da37aa10'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:47.455396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-59d89291-f131-4687-9085-9b3ef4a9b835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80a18a920da747a9ae963578da37aa10'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:47.485116 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-59d89291-f131-4687-9085-9b3ef4a9b835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80a18a920da747a9ae963578da37aa10'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:47.485116 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-59d89291-f131-4687-9085-9b3ef4a9b835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80a18a920da747a9ae963578da37aa10'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:47.485708 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-eb1c10cb-ed31-42d2-9f08-100377f74ed1 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:47.485708 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-eb1c10cb-ed31-42d2-9f08-100377f74ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:47.538540 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 819/1645] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:04:47 2022] DELETE /identity/v3/users/80a18a920da747a9ae963578da37aa10 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:47.543425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f97332-5da6-4816-b94e-0c4121986001 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:47.543710 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f97332-5da6-4816-b94e-0c4121986001 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:47.543979 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f97332-5da6-4816-b94e-0c4121986001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:47.560231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:47.623944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-96f97332-5da6-4816-b94e-0c4121986001 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:47.627838 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-96f97332-5da6-4816-b94e-0c4121986001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:47.705341 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 827/1646] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:47.746635 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c10cb-ed31-42d2-9f08-100377f74ed1 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:47.749100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-eb1c10cb-ed31-42d2-9f08-100377f74ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:47.782535 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 820/1647] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:47.795617 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f97332-5da6-4816-b94e-0c4121986001 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:47.797163 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-96f97332-5da6-4816-b94e-0c4121986001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:47.875784 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c10cb-ed31-42d2-9f08-100377f74ed1 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:47.876555 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f97332-5da6-4816-b94e-0c4121986001 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:47.881397 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f6a2f-f9f3-490c-bf2e-20e216591197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:47.882264 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f6a2f-f9f3-490c-bf2e-20e216591197 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:47.882708 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f6a2f-f9f3-490c-bf2e-20e216591197 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:47.883109 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f6a2f-f9f3-490c-bf2e-20e216591197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:47.884407 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7afccd1-2800-44e4-bf58-1567a3ea4b90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:47.885042 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afccd1-2800-44e4-bf58-1567a3ea4b90 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:47.885327 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afccd1-2800-44e4-bf58-1567a3ea4b90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:47.885600 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afccd1-2800-44e4-bf58-1567a3ea4b90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:47.905602 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7afccd1-2800-44e4-bf58-1567a3ea4b90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:47.907087 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7afccd1-2800-44e4-bf58-1567a3ea4b90 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:47.909868 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f6a2f-f9f3-490c-bf2e-20e216591197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:47.911953 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f6a2f-f9f3-490c-bf2e-20e216591197 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:47.926754 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 821/1648] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:04:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 01:04:47.928160 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f6a2f-f9f3-490c-bf2e-20e216591197 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:47.930661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-317f6a2f-f9f3-490c-bf2e-20e216591197 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:47.935862 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 828/1649] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:04:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:04:47.951094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f6a2f-f9f3-490c-bf2e-20e216591197 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:47.957156 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24aaa9-09c4-4769-b710-96180b1aea0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:47.957899 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24aaa9-09c4-4769-b710-96180b1aea0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:47.958178 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24aaa9-09c4-4769-b710-96180b1aea0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:47.958588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24aaa9-09c4-4769-b710-96180b1aea0c admin admin] PATH_INFO: `/v3/users/9db51bde7f6f404a86ebb27042efa0f4` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:47.959768 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24aaa9-09c4-4769-b710-96180b1aea0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9db51bde7f6f404a86ebb27042efa0f4)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:47.962899 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24aaa9-09c4-4769-b710-96180b1aea0c admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:48.056194 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-7e24aaa9-09c4-4769-b710-96180b1aea0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9db51bde7f6f404a86ebb27042efa0f4'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:48.057240 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-7e24aaa9-09c4-4769-b710-96180b1aea0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9db51bde7f6f404a86ebb27042efa0f4'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:48.066746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-7e24aaa9-09c4-4769-b710-96180b1aea0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9db51bde7f6f404a86ebb27042efa0f4'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:48.068137 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:48.085836 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-7e24aaa9-09c4-4769-b710-96180b1aea0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9db51bde7f6f404a86ebb27042efa0f4'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:48.086726 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-7e24aaa9-09c4-4769-b710-96180b1aea0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9db51bde7f6f404a86ebb27042efa0f4'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:48.108245 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 822/1650] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:04:47 2022] DELETE /identity/v3/users/9db51bde7f6f404a86ebb27042efa0f4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:48.108719 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd71e1c-b5e9-467c-a150-b169841f9288 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:48.109512 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd71e1c-b5e9-467c-a150-b169841f9288 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:48.110587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd71e1c-b5e9-467c-a150-b169841f9288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:48.156082 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-5cd71e1c-b5e9-467c-a150-b169841f9288 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:48.157447 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5cd71e1c-b5e9-467c-a150-b169841f9288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:48.285090 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 829/1651] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:04:48.359380 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24aaa9-09c4-4769-b710-96180b1aea0c admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:48.364193 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7e24aaa9-09c4-4769-b710-96180b1aea0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:48.537979 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24aaa9-09c4-4769-b710-96180b1aea0c admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:48.550339 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc25f1-1594-45fb-8e34-658fae5954ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:48.550985 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc25f1-1594-45fb-8e34-658fae5954ee service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:48.551265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc25f1-1594-45fb-8e34-658fae5954ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:48.551537 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc25f1-1594-45fb-8e34-658fae5954ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:48.573074 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc25f1-1594-45fb-8e34-658fae5954ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:48.574578 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc25f1-1594-45fb-8e34-658fae5954ee service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:48.601974 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 823/1652] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:04:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:04:49.506553 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd71e1c-b5e9-467c-a150-b169841f9288 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:49.508176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5cd71e1c-b5e9-467c-a150-b169841f9288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:49.533062 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd71e1c-b5e9-467c-a150-b169841f9288 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:49.542651 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611b897-4f18-46f8-892b-81ec67a3193e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:49.543939 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611b897-4f18-46f8-892b-81ec67a3193e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:49.544441 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611b897-4f18-46f8-892b-81ec67a3193e admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:49.544717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611b897-4f18-46f8-892b-81ec67a3193e admin admin] PATH_INFO: `/v3/projects/534146e04a5d492c9e2c52ce6eea64bc` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:49.547190 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611b897-4f18-46f8-892b-81ec67a3193e admin admin] RBAC: Authorizing `identity:delete_project(project_id=534146e04a5d492c9e2c52ce6eea64bc)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:49.553980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611b897-4f18-46f8-892b-81ec67a3193e admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:49.677513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f611b897-4f18-46f8-892b-81ec67a3193e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '534146e04a5d492c9e2c52ce6eea64bc', 'request_id': 'req-f611b897-4f18-46f8-892b-81ec67a3193e'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:49.696941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f611b897-4f18-46f8-892b-81ec67a3193e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '534146e04a5d492c9e2c52ce6eea64bc', 'request_id': 'req-f611b897-4f18-46f8-892b-81ec67a3193e'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:49.710181 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f611b897-4f18-46f8-892b-81ec67a3193e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '534146e04a5d492c9e2c52ce6eea64bc', 'request_id': 'req-f611b897-4f18-46f8-892b-81ec67a3193e'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:49.716317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:49.732543 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f611b897-4f18-46f8-892b-81ec67a3193e admin admin] The token cache is being invalidate because project 534146e04a5d492c9e2c52ce6eea64bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:04:49.732543 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f611b897-4f18-46f8-892b-81ec67a3193e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:49.733418 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f611b897-4f18-46f8-892b-81ec67a3193e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:49.740607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 830/1653] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:04:49 2022] DELETE /identity/v3/projects/534146e04a5d492c9e2c52ce6eea64bc => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:49.742420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef25697-6af2-4a36-a411-b7e34d61067c None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:49.743828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef25697-6af2-4a36-a411-b7e34d61067c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:49.744455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef25697-6af2-4a36-a411-b7e34d61067c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:49.784746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-eef25697-6af2-4a36-a411-b7e34d61067c None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:49.786908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-eef25697-6af2-4a36-a411-b7e34d61067c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:49.869337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611b897-4f18-46f8-892b-81ec67a3193e admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:49.871111 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f611b897-4f18-46f8-892b-81ec67a3193e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:49.902903 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 824/1654] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:49.906605 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd4cf9-dd52-47da-bf72-762516d1b831 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:49.911659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd4cf9-dd52-47da-bf72-762516d1b831 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:49.911659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd4cf9-dd52-47da-bf72-762516d1b831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:49.968592 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-95dd4cf9-dd52-47da-bf72-762516d1b831 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:49.968592 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-95dd4cf9-dd52-47da-bf72-762516d1b831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:49.988671 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 825/1655] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:49.995156 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd4cf9-dd52-47da-bf72-762516d1b831 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:50.016225 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd4cf9-dd52-47da-bf72-762516d1b831 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:50.032363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a12f8-89c5-454e-b12a-313d85b2a0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:50.033072 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a12f8-89c5-454e-b12a-313d85b2a0fb admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:50.034024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a12f8-89c5-454e-b12a-313d85b2a0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:50.034357 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a12f8-89c5-454e-b12a-313d85b2a0fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:50.035096 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a12f8-89c5-454e-b12a-313d85b2a0fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:04:50.036751 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a12f8-89c5-454e-b12a-313d85b2a0fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:50.038531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a12f8-89c5-454e-b12a-313d85b2a0fb admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:50.044131 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611b897-4f18-46f8-892b-81ec67a3193e admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:50.059629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000d27a-472c-4143-97b2-42eba1268d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:50.060452 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000d27a-472c-4143-97b2-42eba1268d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:50.060802 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000d27a-472c-4143-97b2-42eba1268d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:50.061085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000d27a-472c-4143-97b2-42eba1268d6a admin admin] PATH_INFO: `/v3/projects/94b668e5b6934e2ab39416b8877a58a2` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:50.064052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000d27a-472c-4143-97b2-42eba1268d6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=94b668e5b6934e2ab39416b8877a58a2)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:50.066649 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000d27a-472c-4143-97b2-42eba1268d6a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:50.072962 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 826/1656] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:04:50.075092 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a12f8-89c5-454e-b12a-313d85b2a0fb admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:50.100730 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a12f8-89c5-454e-b12a-313d85b2a0fb admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:50.118588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45a3b4-3488-4524-a91b-c2bed51e85b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:50.119435 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45a3b4-3488-4524-a91b-c2bed51e85b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:50.119808 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45a3b4-3488-4524-a91b-c2bed51e85b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:50.120236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45a3b4-3488-4524-a91b-c2bed51e85b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:50.121045 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45a3b4-3488-4524-a91b-c2bed51e85b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:50.128221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45a3b4-3488-4524-a91b-c2bed51e85b2 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:50.184152 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 827/1657] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:04:50 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:50.185231 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45a3b4-3488-4524-a91b-c2bed51e85b2 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:50.191097 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ab45a3b4-3488-4524-a91b-c2bed51e85b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:50.194125 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1000d27a-472c-4143-97b2-42eba1268d6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94b668e5b6934e2ab39416b8877a58a2', 'request_id': 'req-1000d27a-472c-4143-97b2-42eba1268d6a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:50.215971 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1000d27a-472c-4143-97b2-42eba1268d6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94b668e5b6934e2ab39416b8877a58a2', 'request_id': 'req-1000d27a-472c-4143-97b2-42eba1268d6a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:50.223964 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1000d27a-472c-4143-97b2-42eba1268d6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94b668e5b6934e2ab39416b8877a58a2', 'request_id': 'req-1000d27a-472c-4143-97b2-42eba1268d6a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:50.264803 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1000d27a-472c-4143-97b2-42eba1268d6a admin admin] The token cache is being invalidate because project 94b668e5b6934e2ab39416b8877a58a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:04:50.265107 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1000d27a-472c-4143-97b2-42eba1268d6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:50.266481 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1000d27a-472c-4143-97b2-42eba1268d6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:50.278964 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 831/1658] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:04:49 2022] DELETE /identity/v3/projects/94b668e5b6934e2ab39416b8877a58a2 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:04:50.280151 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000d27a-472c-4143-97b2-42eba1268d6a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:50.285699 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1000d27a-472c-4143-97b2-42eba1268d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:50.291467 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:50.349641 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45a3b4-3488-4524-a91b-c2bed51e85b2 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:50.366097 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78dda9-8bd6-49df-ac9b-18589a846a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:50.366866 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78dda9-8bd6-49df-ac9b-18589a846a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:50.367282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78dda9-8bd6-49df-ac9b-18589a846a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:50.367746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78dda9-8bd6-49df-ac9b-18589a846a87 admin admin] PATH_INFO: `/v3/users/ab3b4141c9c64f05884d291f17ddb2ac` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:50.369238 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78dda9-8bd6-49df-ac9b-18589a846a87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab3b4141c9c64f05884d291f17ddb2ac)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:50.372427 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78dda9-8bd6-49df-ac9b-18589a846a87 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:50.520473 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000d27a-472c-4143-97b2-42eba1268d6a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:50.528999 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13428b-c72f-4bae-9bda-d0db890c81a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:50.530391 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13428b-c72f-4bae-9bda-d0db890c81a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:50.530684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13428b-c72f-4bae-9bda-d0db890c81a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:50.531268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13428b-c72f-4bae-9bda-d0db890c81a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:50.531621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13428b-c72f-4bae-9bda-d0db890c81a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:50.533949 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13428b-c72f-4bae-9bda-d0db890c81a4 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:50.550748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9e78dda9-8bd6-49df-ac9b-18589a846a87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab3b4141c9c64f05884d291f17ddb2ac'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:50.552776 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9e78dda9-8bd6-49df-ac9b-18589a846a87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab3b4141c9c64f05884d291f17ddb2ac'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:50.579208 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 832/1659] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:04:50 2022] POST /identity/v3/users => generated 286 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:50.580643 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13428b-c72f-4bae-9bda-d0db890c81a4 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:50.582056 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9e78dda9-8bd6-49df-ac9b-18589a846a87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab3b4141c9c64f05884d291f17ddb2ac'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:50.592266 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7a13428b-c72f-4bae-9bda-d0db890c81a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:50.608054 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13428b-c72f-4bae-9bda-d0db890c81a4 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:50.608730 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9e78dda9-8bd6-49df-ac9b-18589a846a87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab3b4141c9c64f05884d291f17ddb2ac'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:50.610328 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9e78dda9-8bd6-49df-ac9b-18589a846a87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab3b4141c9c64f05884d291f17ddb2ac'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:50.627749 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c0ea6-42a7-456d-ab98-44ad192d4c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:50.628885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c0ea6-42a7-456d-ab98-44ad192d4c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:50.629483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c0ea6-42a7-456d-ab98-44ad192d4c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:50.629960 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c0ea6-42a7-456d-ab98-44ad192d4c54 admin admin] PATH_INFO: `/v3/users/7c17be5943654c12a55f6090f7cb109a` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:50.633253 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c0ea6-42a7-456d-ab98-44ad192d4c54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c17be5943654c12a55f6090f7cb109a)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:50.636745 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c0ea6-42a7-456d-ab98-44ad192d4c54 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:50.643639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 828/1660] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:04:50 2022] DELETE /identity/v3/users/ab3b4141c9c64f05884d291f17ddb2ac => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:50.645117 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78dda9-8bd6-49df-ac9b-18589a846a87 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:50.648800 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9e78dda9-8bd6-49df-ac9b-18589a846a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:50.658353 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:50.783404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e72c0ea6-42a7-456d-ab98-44ad192d4c54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c17be5943654c12a55f6090f7cb109a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:50.796886 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e72c0ea6-42a7-456d-ab98-44ad192d4c54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c17be5943654c12a55f6090f7cb109a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:50.819875 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78dda9-8bd6-49df-ac9b-18589a846a87 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:50.831014 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50399ad-f76b-4fbc-89ec-0427cda8fbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:50.831639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50399ad-f76b-4fbc-89ec-0427cda8fbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:50.831919 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50399ad-f76b-4fbc-89ec-0427cda8fbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:50.832184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50399ad-f76b-4fbc-89ec-0427cda8fbb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:50.832837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50399ad-f76b-4fbc-89ec-0427cda8fbb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:50.834536 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50399ad-f76b-4fbc-89ec-0427cda8fbb7 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:50.843066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e72c0ea6-42a7-456d-ab98-44ad192d4c54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c17be5943654c12a55f6090f7cb109a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:50.844883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e72c0ea6-42a7-456d-ab98-44ad192d4c54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c17be5943654c12a55f6090f7cb109a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:50.847103 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e72c0ea6-42a7-456d-ab98-44ad192d4c54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c17be5943654c12a55f6090f7cb109a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:50.873533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 829/1661] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:50.876350 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cb022-0054-4a3b-955f-97dbc271bdb9 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:50.876350 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cb022-0054-4a3b-955f-97dbc271bdb9 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:50.876350 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cb022-0054-4a3b-955f-97dbc271bdb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:50.884173 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 833/1662] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:04:50 2022] DELETE /identity/v3/users/7c17be5943654c12a55f6090f7cb109a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:50.885204 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c0ea6-42a7-456d-ab98-44ad192d4c54 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:50.889348 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e72c0ea6-42a7-456d-ab98-44ad192d4c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:50.922765 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-733cb022-0054-4a3b-955f-97dbc271bdb9 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:50.924151 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-733cb022-0054-4a3b-955f-97dbc271bdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:51.039772 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c0ea6-42a7-456d-ab98-44ad192d4c54 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:51.047164 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1379a1-6d69-40e4-ab2c-c849c8a355c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:51.048017 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1379a1-6d69-40e4-ab2c-c849c8a355c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:51.048438 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1379a1-6d69-40e4-ab2c-c849c8a355c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:51.049245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1379a1-6d69-40e4-ab2c-c849c8a355c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:51.050094 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1379a1-6d69-40e4-ab2c-c849c8a355c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:51.053753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1379a1-6d69-40e4-ab2c-c849c8a355c3 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:51.062743 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:51.077487 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 834/1663] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:51.079976 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51e174-8c21-4410-ae84-5c7506f09c27 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:51.081052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51e174-8c21-4410-ae84-5c7506f09c27 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:51.081521 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51e174-8c21-4410-ae84-5c7506f09c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:51.119065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 830/1664] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:51.129476 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733cb022-0054-4a3b-955f-97dbc271bdb9 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:51.149200 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-7d51e174-8c21-4410-ae84-5c7506f09c27 None None] MFA Rules not processed for user `bfd8052af6ab43beae0e8d6bb3af5bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:51.150506 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7d51e174-8c21-4410-ae84-5c7506f09c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:51.163424 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733cb022-0054-4a3b-955f-97dbc271bdb9 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:51.183350 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c0856-b564-42db-bbb9-5e932098474b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:51.186292 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c0856-b564-42db-bbb9-5e932098474b admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:51.187043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c0856-b564-42db-bbb9-5e932098474b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:51.187671 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c0856-b564-42db-bbb9-5e932098474b admin admin] PATH_INFO: `/v3/projects/10c4eac053ae4842845e4228339afcd6/users/4cbd96a861dc43c59889bdec3edbc1d3/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:51.233247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c0856-b564-42db-bbb9-5e932098474b admin admin] RBAC: Authorizing `identity:create_grant(project_id=10c4eac053ae4842845e4228339afcd6, user_id=4cbd96a861dc43c59889bdec3edbc1d3, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:51.243359 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c0856-b564-42db-bbb9-5e932098474b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:51.274256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 831/1665] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:04:51 2022] PUT /identity/v3/projects/10c4eac053ae4842845e4228339afcd6/users/4cbd96a861dc43c59889bdec3edbc1d3/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:51.276420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c0856-b564-42db-bbb9-5e932098474b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:51.278723 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-df8c0856-b564-42db-bbb9-5e932098474b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:51.397654 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 835/1666] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:51.407831 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674802e7-ef5c-47a6-a95b-6703aac966d1 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:51.408103 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674802e7-ef5c-47a6-a95b-6703aac966d1 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:51.408413 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674802e7-ef5c-47a6-a95b-6703aac966d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:51.450062 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c0856-b564-42db-bbb9-5e932098474b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:51.454529 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8584d-fb70-42b4-be6f-d8e080a0e8b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:51.455150 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8584d-fb70-42b4-be6f-d8e080a0e8b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:51.455495 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8584d-fb70-42b4-be6f-d8e080a0e8b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:51.455815 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8584d-fb70-42b4-be6f-d8e080a0e8b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:51.463325 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:51.485428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-674802e7-ef5c-47a6-a95b-6703aac966d1 None None] MFA Rules not processed for user `4cbd96a861dc43c59889bdec3edbc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:51.487922 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-674802e7-ef5c-47a6-a95b-6703aac966d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:51.629172 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8584d-fb70-42b4-be6f-d8e080a0e8b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:51.630698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8584d-fb70-42b4-be6f-d8e080a0e8b6 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:51.662157 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 832/1667] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:04:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:04:51.663329 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8584d-fb70-42b4-be6f-d8e080a0e8b6 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:51.664853 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 836/1668] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:51.665733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674802e7-ef5c-47a6-a95b-6703aac966d1 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:51.667082 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-674802e7-ef5c-47a6-a95b-6703aac966d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:51.670783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-35d8584d-fb70-42b4-be6f-d8e080a0e8b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:51.697187 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674802e7-ef5c-47a6-a95b-6703aac966d1 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:51.711372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15fdf5-4b00-4447-b297-b0f607f867c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:51.711372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15fdf5-4b00-4447-b297-b0f607f867c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:51.711582 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15fdf5-4b00-4447-b297-b0f607f867c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:51.712636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15fdf5-4b00-4447-b297-b0f607f867c2 admin admin] PATH_INFO: `/v3/projects/548dcbaeea97445e9a1572cd3f069fb7` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:51.714577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15fdf5-4b00-4447-b297-b0f607f867c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=548dcbaeea97445e9a1572cd3f069fb7)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:51.716418 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15fdf5-4b00-4447-b297-b0f607f867c2 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:51.874150 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7b15fdf5-4b00-4447-b297-b0f607f867c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '548dcbaeea97445e9a1572cd3f069fb7', 'request_id': 'req-7b15fdf5-4b00-4447-b297-b0f607f867c2'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:51.904183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7b15fdf5-4b00-4447-b297-b0f607f867c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '548dcbaeea97445e9a1572cd3f069fb7', 'request_id': 'req-7b15fdf5-4b00-4447-b297-b0f607f867c2'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:51.917524 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7b15fdf5-4b00-4447-b297-b0f607f867c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '548dcbaeea97445e9a1572cd3f069fb7', 'request_id': 'req-7b15fdf5-4b00-4447-b297-b0f607f867c2'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:51.923607 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8584d-fb70-42b4-be6f-d8e080a0e8b6 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:51.953900 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7b15fdf5-4b00-4447-b297-b0f607f867c2 admin admin] The token cache is being invalidate because project 548dcbaeea97445e9a1572cd3f069fb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:04:51.953900 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7b15fdf5-4b00-4447-b297-b0f607f867c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:51.961544 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7b15fdf5-4b00-4447-b297-b0f607f867c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:51.966110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 837/1669] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:04:51 2022] DELETE /identity/v3/projects/548dcbaeea97445e9a1572cd3f069fb7 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:51.966110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15fdf5-4b00-4447-b297-b0f607f867c2 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:51.971030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:51.975682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7b15fdf5-4b00-4447-b297-b0f607f867c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:52.123243 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03d4c1-b7b8-4cba-bd96-0fe90b06dfef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:52.123873 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03d4c1-b7b8-4cba-bd96-0fe90b06dfef service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:52.124151 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03d4c1-b7b8-4cba-bd96-0fe90b06dfef service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:52.124423 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03d4c1-b7b8-4cba-bd96-0fe90b06dfef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:52.130714 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4e03d4c1-b7b8-4cba-bd96-0fe90b06dfef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:52.172445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15fdf5-4b00-4447-b297-b0f607f867c2 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:52.191710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72168280-4aee-41d9-8227-e74a4dc1b282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:52.192372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72168280-4aee-41d9-8227-e74a4dc1b282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:52.192653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72168280-4aee-41d9-8227-e74a4dc1b282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:52.192928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72168280-4aee-41d9-8227-e74a4dc1b282 admin admin] PATH_INFO: `/v3/projects/bb167cb341ad4619a393c7fe820d0d04` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:52.195608 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72168280-4aee-41d9-8227-e74a4dc1b282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb167cb341ad4619a393c7fe820d0d04)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:52.199994 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72168280-4aee-41d9-8227-e74a4dc1b282 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:52.281576 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:52.342347 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03d4c1-b7b8-4cba-bd96-0fe90b06dfef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:52.344705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03d4c1-b7b8-4cba-bd96-0fe90b06dfef service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:52.359429 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-72168280-4aee-41d9-8227-e74a4dc1b282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb167cb341ad4619a393c7fe820d0d04', 'request_id': 'req-72168280-4aee-41d9-8227-e74a4dc1b282'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:52.376995 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 833/1670] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:04:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:04:52.382168 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03d4c1-b7b8-4cba-bd96-0fe90b06dfef service nova] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:52.383896 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-72168280-4aee-41d9-8227-e74a4dc1b282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb167cb341ad4619a393c7fe820d0d04', 'request_id': 'req-72168280-4aee-41d9-8227-e74a4dc1b282'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:52.385624 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4e03d4c1-b7b8-4cba-bd96-0fe90b06dfef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:52.399197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-72168280-4aee-41d9-8227-e74a4dc1b282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb167cb341ad4619a393c7fe820d0d04', 'request_id': 'req-72168280-4aee-41d9-8227-e74a4dc1b282'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:52.429775 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-72168280-4aee-41d9-8227-e74a4dc1b282 admin admin] The token cache is being invalidate because project bb167cb341ad4619a393c7fe820d0d04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:04:52.430205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-72168280-4aee-41d9-8227-e74a4dc1b282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:52.431404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-72168280-4aee-41d9-8227-e74a4dc1b282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:52.438796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 838/1671] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:04:51 2022] DELETE /identity/v3/projects/bb167cb341ad4619a393c7fe820d0d04 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:52.440241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72168280-4aee-41d9-8227-e74a4dc1b282 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:52.445976 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03d4c1-b7b8-4cba-bd96-0fe90b06dfef service nova] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:52.449713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-72168280-4aee-41d9-8227-e74a4dc1b282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:52.615889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72168280-4aee-41d9-8227-e74a4dc1b282 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:52.635179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b8074-b973-4e4f-9d51-38b0dfd9bbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:52.637647 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b8074-b973-4e4f-9d51-38b0dfd9bbe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:52.638577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b8074-b973-4e4f-9d51-38b0dfd9bbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:52.639038 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b8074-b973-4e4f-9d51-38b0dfd9bbe3 admin admin] PATH_INFO: `/v3/users/a804bf092f9b4109aad1d73a07941bf8` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:52.646242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b8074-b973-4e4f-9d51-38b0dfd9bbe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a804bf092f9b4109aad1d73a07941bf8)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:52.653139 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b8074-b973-4e4f-9d51-38b0dfd9bbe3 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:52.654550 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de13eef-f484-4501-ae28-c4459c903a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:52.655531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de13eef-f484-4501-ae28-c4459c903a97 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:52.656066 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de13eef-f484-4501-ae28-c4459c903a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:52.656730 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de13eef-f484-4501-ae28-c4459c903a97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:52.658770 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de13eef-f484-4501-ae28-c4459c903a97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:52.663436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de13eef-f484-4501-ae28-c4459c903a97 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:52.725538 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 834/1672] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:04:52 2022] POST /identity/v3/projects => generated 371 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:52.728701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2061c3-3b55-4a0f-ac15-af90c76d8d61 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:52.728985 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2061c3-3b55-4a0f-ac15-af90c76d8d61 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:52.730303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2061c3-3b55-4a0f-ac15-af90c76d8d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:52.757568 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-947b8074-b973-4e4f-9d51-38b0dfd9bbe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a804bf092f9b4109aad1d73a07941bf8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:52.768346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-947b8074-b973-4e4f-9d51-38b0dfd9bbe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a804bf092f9b4109aad1d73a07941bf8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:52.782794 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-7c2061c3-3b55-4a0f-ac15-af90c76d8d61 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:52.787488 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7c2061c3-3b55-4a0f-ac15-af90c76d8d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:52.815929 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-947b8074-b973-4e4f-9d51-38b0dfd9bbe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a804bf092f9b4109aad1d73a07941bf8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:52.816900 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-947b8074-b973-4e4f-9d51-38b0dfd9bbe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a804bf092f9b4109aad1d73a07941bf8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:52.817726 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-947b8074-b973-4e4f-9d51-38b0dfd9bbe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a804bf092f9b4109aad1d73a07941bf8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:52.843161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 839/1673] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:04:52 2022] DELETE /identity/v3/users/a804bf092f9b4109aad1d73a07941bf8 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:52.844126 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b8074-b973-4e4f-9d51-38b0dfd9bbe3 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:52.845718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-947b8074-b973-4e4f-9d51-38b0dfd9bbe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:52.881087 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:52.898692 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:52.954123 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 835/1674] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:52.955365 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2061c3-3b55-4a0f-ac15-af90c76d8d61 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:52.959264 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7c2061c3-3b55-4a0f-ac15-af90c76d8d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:52.970433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b8074-b973-4e4f-9d51-38b0dfd9bbe3 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:52.981177 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a803907-2fc4-4463-95b2-f3efa0adb2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:52.983537 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a803907-2fc4-4463-95b2-f3efa0adb2d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:52.983816 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a803907-2fc4-4463-95b2-f3efa0adb2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:52.984086 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a803907-2fc4-4463-95b2-f3efa0adb2d9 admin admin] PATH_INFO: `/v3/projects/726dba76e5dc40169fe5d84551638ced` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:52.985422 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2061c3-3b55-4a0f-ac15-af90c76d8d61 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:52.986867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a803907-2fc4-4463-95b2-f3efa0adb2d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=726dba76e5dc40169fe5d84551638ced)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:52.988800 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a803907-2fc4-4463-95b2-f3efa0adb2d9 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:52.995502 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77d396-ea87-4da1-aa7a-d1a43ac3eed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:52.997571 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77d396-ea87-4da1-aa7a-d1a43ac3eed3 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:52.997871 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77d396-ea87-4da1-aa7a-d1a43ac3eed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:52.998193 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77d396-ea87-4da1-aa7a-d1a43ac3eed3 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:53.004064 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77d396-ea87-4da1-aa7a-d1a43ac3eed3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:53.016167 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77d396-ea87-4da1-aa7a-d1a43ac3eed3 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:53.074940 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 836/1675] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:04:52 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:53.077494 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965adc7c-1f0e-41ae-972c-b779c05b9751 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:53.077685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965adc7c-1f0e-41ae-972c-b779c05b9751 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:53.078018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965adc7c-1f0e-41ae-972c-b779c05b9751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:53.125234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-9a803907-2fc4-4463-95b2-f3efa0adb2d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '726dba76e5dc40169fe5d84551638ced', 'request_id': 'req-9a803907-2fc4-4463-95b2-f3efa0adb2d9'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:53.135909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-965adc7c-1f0e-41ae-972c-b779c05b9751 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:53.139705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-965adc7c-1f0e-41ae-972c-b779c05b9751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:53.146530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-9a803907-2fc4-4463-95b2-f3efa0adb2d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '726dba76e5dc40169fe5d84551638ced', 'request_id': 'req-9a803907-2fc4-4463-95b2-f3efa0adb2d9'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:53.163007 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-9a803907-2fc4-4463-95b2-f3efa0adb2d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '726dba76e5dc40169fe5d84551638ced', 'request_id': 'req-9a803907-2fc4-4463-95b2-f3efa0adb2d9'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:53.195761 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-9a803907-2fc4-4463-95b2-f3efa0adb2d9 admin admin] The token cache is being invalidate because project 726dba76e5dc40169fe5d84551638ced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:04:53.196076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-9a803907-2fc4-4463-95b2-f3efa0adb2d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:53.199751 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-9a803907-2fc4-4463-95b2-f3efa0adb2d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:53.206251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 840/1676] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:04:52 2022] DELETE /identity/v3/projects/726dba76e5dc40169fe5d84551638ced => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:53.208580 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a803907-2fc4-4463-95b2-f3efa0adb2d9 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:53.211768 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-9a803907-2fc4-4463-95b2-f3efa0adb2d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:53.313018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 837/1677] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:53.317307 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477d34d-508b-445e-9ed1-7e79b7937a0c None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:53.317307 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477d34d-508b-445e-9ed1-7e79b7937a0c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:53.317307 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477d34d-508b-445e-9ed1-7e79b7937a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:53.359929 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-3477d34d-508b-445e-9ed1-7e79b7937a0c None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:53.364274 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3477d34d-508b-445e-9ed1-7e79b7937a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:53.376164 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a803907-2fc4-4463-95b2-f3efa0adb2d9 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:53.387644 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c79e02-215b-4777-abb4-a6bf7527fbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:53.388292 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c79e02-215b-4777-abb4-a6bf7527fbfe admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:53.388573 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c79e02-215b-4777-abb4-a6bf7527fbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:53.388846 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c79e02-215b-4777-abb4-a6bf7527fbfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:53.389511 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c79e02-215b-4777-abb4-a6bf7527fbfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:53.391740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c79e02-215b-4777-abb4-a6bf7527fbfe admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:53.404114 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 838/1678] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:53.405352 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477d34d-508b-445e-9ed1-7e79b7937a0c None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:53.423613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 841/1679] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:53.423613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1a995-91ec-4087-a56d-eba071c0b1dc None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:53.423613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1a995-91ec-4087-a56d-eba071c0b1dc None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:53.425090 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1a995-91ec-4087-a56d-eba071c0b1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:53.441411 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477d34d-508b-445e-9ed1-7e79b7937a0c None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:53.448856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8fe63-e8f2-4924-b870-01f0686b01cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:53.457323 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8fe63-e8f2-4924-b870-01f0686b01cb admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:53.458070 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8fe63-e8f2-4924-b870-01f0686b01cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:53.458587 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8fe63-e8f2-4924-b870-01f0686b01cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:53.459625 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8fe63-e8f2-4924-b870-01f0686b01cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:04:53.460171 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8fe63-e8f2-4924-b870-01f0686b01cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:53.462506 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8fe63-e8f2-4924-b870-01f0686b01cb admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:53.472940 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-46d1a995-91ec-4087-a56d-eba071c0b1dc None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:53.478393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-46d1a995-91ec-4087-a56d-eba071c0b1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:53.485365 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 839/1680] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:04:53.487258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8fe63-e8f2-4924-b870-01f0686b01cb admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:53.497428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 842/1681] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:53.500914 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1a995-91ec-4087-a56d-eba071c0b1dc None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:53.502380 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8fe63-e8f2-4924-b870-01f0686b01cb admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:53.513052 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02deb1b-a0cf-4bb8-925b-8acf1f111916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:53.515459 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02deb1b-a0cf-4bb8-925b-8acf1f111916 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:53.516093 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02deb1b-a0cf-4bb8-925b-8acf1f111916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:53.517568 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02deb1b-a0cf-4bb8-925b-8acf1f111916 admin admin] PATH_INFO: `/v3/projects/23bd664a93794f538e0a4cc676d8a31f/users/976aa897e47f4018a31410a37e625e6f/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:53.537746 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1a995-91ec-4087-a56d-eba071c0b1dc None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:53.559897 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02deb1b-a0cf-4bb8-925b-8acf1f111916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23bd664a93794f538e0a4cc676d8a31f, user_id=976aa897e47f4018a31410a37e625e6f, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:53.563828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02deb1b-a0cf-4bb8-925b-8acf1f111916 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:53.573142 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e8890-4ecf-4322-aa96-37a661dd2d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:53.573975 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e8890-4ecf-4322-aa96-37a661dd2d3b admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:53.576921 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e8890-4ecf-4322-aa96-37a661dd2d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:53.584705 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e8890-4ecf-4322-aa96-37a661dd2d3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:53.586719 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e8890-4ecf-4322-aa96-37a661dd2d3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:53.589087 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e8890-4ecf-4322-aa96-37a661dd2d3b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:53.595739 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 840/1682] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:04:53 2022] PUT /identity/v3/projects/23bd664a93794f538e0a4cc676d8a31f/users/976aa897e47f4018a31410a37e625e6f/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:53.600285 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02deb1b-a0cf-4bb8-925b-8acf1f111916 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:53.656990 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 843/1683] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:04:53 2022] POST /identity/v3/projects => generated 363 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:53.659293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e8890-4ecf-4322-aa96-37a661dd2d3b admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:53.757597 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:53.806862 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02deb1b-a0cf-4bb8-925b-8acf1f111916 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:53.822030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae845d88-9820-4909-a6d7-6b977e56454f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:53.822695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae845d88-9820-4909-a6d7-6b977e56454f admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:53.823065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae845d88-9820-4909-a6d7-6b977e56454f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:53.823436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae845d88-9820-4909-a6d7-6b977e56454f admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:53.824820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e8890-4ecf-4322-aa96-37a661dd2d3b admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:53.825197 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae845d88-9820-4909-a6d7-6b977e56454f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:04:53.825517 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae845d88-9820-4909-a6d7-6b977e56454f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:53.833536 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae845d88-9820-4909-a6d7-6b977e56454f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:53.835265 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b382d7-c81e-4e76-b07e-747dae5ab8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:53.835970 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b382d7-c81e-4e76-b07e-747dae5ab8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:53.836254 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b382d7-c81e-4e76-b07e-747dae5ab8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:53.836524 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b382d7-c81e-4e76-b07e-747dae5ab8f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:53.837230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b382d7-c81e-4e76-b07e-747dae5ab8f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:53.839096 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b382d7-c81e-4e76-b07e-747dae5ab8f9 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:53.853742 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 844/1684] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:53.854962 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b382d7-c81e-4e76-b07e-747dae5ab8f9 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:53.867134 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b382d7-c81e-4e76-b07e-747dae5ab8f9 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:53.868139 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 841/1685] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:04:53.870193 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae845d88-9820-4909-a6d7-6b977e56454f admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:53.877201 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d1d43-2179-42fd-9e0d-2bc3e985f626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:53.877928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d1d43-2179-42fd-9e0d-2bc3e985f626 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:53.878194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d1d43-2179-42fd-9e0d-2bc3e985f626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:53.878467 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d1d43-2179-42fd-9e0d-2bc3e985f626 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:53.879166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d1d43-2179-42fd-9e0d-2bc3e985f626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:53.881126 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d1d43-2179-42fd-9e0d-2bc3e985f626 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:53.892022 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae845d88-9820-4909-a6d7-6b977e56454f admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:53.909711 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d184370-135c-4e7d-8001-785348063e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:53.910928 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d184370-135c-4e7d-8001-785348063e88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:53.911485 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d184370-135c-4e7d-8001-785348063e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:53.911965 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d184370-135c-4e7d-8001-785348063e88 admin admin] PATH_INFO: `/v3/projects/23bd664a93794f538e0a4cc676d8a31f/users/976aa897e47f4018a31410a37e625e6f/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:53.915027 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d184370-135c-4e7d-8001-785348063e88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23bd664a93794f538e0a4cc676d8a31f, user_id=976aa897e47f4018a31410a37e625e6f, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:53.918252 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d184370-135c-4e7d-8001-785348063e88 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:53.919609 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 845/1686] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:04:53 2022] POST /identity/v3/users => generated 282 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:53.920444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d1d43-2179-42fd-9e0d-2bc3e985f626 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:53.930376 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:53.942452 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d1d43-2179-42fd-9e0d-2bc3e985f626 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:53.955074 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 842/1687] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:04:53 2022] PUT /identity/v3/projects/23bd664a93794f538e0a4cc676d8a31f/users/976aa897e47f4018a31410a37e625e6f/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:53.956131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d184370-135c-4e7d-8001-785348063e88 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:53.965595 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8d184370-135c-4e7d-8001-785348063e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:54.088645 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea928eb8-57e5-4763-a80f-50fab4255398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:54.089655 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea928eb8-57e5-4763-a80f-50fab4255398 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:54.089655 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea928eb8-57e5-4763-a80f-50fab4255398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:54.089655 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea928eb8-57e5-4763-a80f-50fab4255398 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:54.090624 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea928eb8-57e5-4763-a80f-50fab4255398 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:54.094111 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea928eb8-57e5-4763-a80f-50fab4255398 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:54.119860 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d184370-135c-4e7d-8001-785348063e88 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:54.127794 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eeb1e9-0ac4-4930-a6b9-fffcfc5f8ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:54.128814 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eeb1e9-0ac4-4930-a6b9-fffcfc5f8ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:54.129288 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eeb1e9-0ac4-4930-a6b9-fffcfc5f8ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:54.129750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eeb1e9-0ac4-4930-a6b9-fffcfc5f8ed6 admin admin] PATH_INFO: `/v3/projects/3d211a8b46f2499b9318c27127e1bb32` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:54.131464 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eeb1e9-0ac4-4930-a6b9-fffcfc5f8ed6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d211a8b46f2499b9318c27127e1bb32)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:54.132591 dv-cinder-857528-1-smb devstack@keystone.service[81476]: WARNING py.warnings [None req-57eeb1e9-0ac4-4930-a6b9-fffcfc5f8ed6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 01:04:54.132591 dv-cinder-857528-1-smb devstack@keystone.service[81476]: warnings.warn(msg) Sep 14 01:04:54.132591 dv-cinder-857528-1-smb devstack@keystone.service[81476]: Sep 14 01:04:54.134605 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eeb1e9-0ac4-4930-a6b9-fffcfc5f8ed6 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:54.164933 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 846/1688] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:04:53 2022] POST /identity/v3/projects => generated 403 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:54.166653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea928eb8-57e5-4763-a80f-50fab4255398 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:54.259360 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-57eeb1e9-0ac4-4930-a6b9-fffcfc5f8ed6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d211a8b46f2499b9318c27127e1bb32', 'request_id': 'req-57eeb1e9-0ac4-4930-a6b9-fffcfc5f8ed6'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:54.271282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-57eeb1e9-0ac4-4930-a6b9-fffcfc5f8ed6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d211a8b46f2499b9318c27127e1bb32', 'request_id': 'req-57eeb1e9-0ac4-4930-a6b9-fffcfc5f8ed6'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:54.277640 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea928eb8-57e5-4763-a80f-50fab4255398 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:54.293763 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-57eeb1e9-0ac4-4930-a6b9-fffcfc5f8ed6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d211a8b46f2499b9318c27127e1bb32', 'request_id': 'req-57eeb1e9-0ac4-4930-a6b9-fffcfc5f8ed6'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:54.318865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-57eeb1e9-0ac4-4930-a6b9-fffcfc5f8ed6 admin admin] The token cache is being invalidate because project 3d211a8b46f2499b9318c27127e1bb32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:04:54.319195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-57eeb1e9-0ac4-4930-a6b9-fffcfc5f8ed6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:54.322162 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-57eeb1e9-0ac4-4930-a6b9-fffcfc5f8ed6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:54.325754 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 843/1689] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:04:53 2022] DELETE /identity/v3/projects/3d211a8b46f2499b9318c27127e1bb32 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:54.331563 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062cefff-00f9-467e-84b9-5fa34372bc2e None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:54.331846 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062cefff-00f9-467e-84b9-5fa34372bc2e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:54.332114 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062cefff-00f9-467e-84b9-5fa34372bc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:54.348030 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:54.376872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-062cefff-00f9-467e-84b9-5fa34372bc2e None None] MFA Rules not processed for user `976aa897e47f4018a31410a37e625e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:54.378966 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-062cefff-00f9-467e-84b9-5fa34372bc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:54.379611 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838db86-b1b6-4780-b193-9e4cd7423f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:54.380315 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838db86-b1b6-4780-b193-9e4cd7423f03 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:54.380597 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838db86-b1b6-4780-b193-9e4cd7423f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:54.380870 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838db86-b1b6-4780-b193-9e4cd7423f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:54.381662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838db86-b1b6-4780-b193-9e4cd7423f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:54.384358 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838db86-b1b6-4780-b193-9e4cd7423f03 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:54.402700 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 847/1690] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:54.402700 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838db86-b1b6-4780-b193-9e4cd7423f03 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:54.403761 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d838db86-b1b6-4780-b193-9e4cd7423f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:54.436184 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838db86-b1b6-4780-b193-9e4cd7423f03 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:54.442003 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec99523-3f98-481f-b7e1-b5bd8775e28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:54.442940 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec99523-3f98-481f-b7e1-b5bd8775e28b admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:54.443867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec99523-3f98-481f-b7e1-b5bd8775e28b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:54.444295 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec99523-3f98-481f-b7e1-b5bd8775e28b admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:54.445203 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec99523-3f98-481f-b7e1-b5bd8775e28b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:54.448630 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec99523-3f98-481f-b7e1-b5bd8775e28b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:54.482662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 848/1691] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:04:54 2022] POST /identity/v3/users => generated 302 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:54.482662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1ffc9-ce45-4b06-8959-445479b5314c None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:54.482662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1ffc9-ce45-4b06-8959-445479b5314c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:54.482662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1ffc9-ce45-4b06-8959-445479b5314c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:54.486718 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 844/1692] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:54.487685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062cefff-00f9-467e-84b9-5fa34372bc2e None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:54.489831 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-062cefff-00f9-467e-84b9-5fa34372bc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:54.507193 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062cefff-00f9-467e-84b9-5fa34372bc2e None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:54.509660 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-52a1ffc9-ce45-4b06-8959-445479b5314c None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:54.511669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-52a1ffc9-ce45-4b06-8959-445479b5314c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:54.513878 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4fa5a-a6bc-45cb-bbee-74a5d0fbd8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:54.514553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4fa5a-a6bc-45cb-bbee-74a5d0fbd8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:54.514835 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4fa5a-a6bc-45cb-bbee-74a5d0fbd8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:54.515083 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4fa5a-a6bc-45cb-bbee-74a5d0fbd8e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:54.515938 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4fa5a-a6bc-45cb-bbee-74a5d0fbd8e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:54.518310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4fa5a-a6bc-45cb-bbee-74a5d0fbd8e0 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:54.521503 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 849/1693] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:54.522469 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1ffc9-ce45-4b06-8959-445479b5314c None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:54.535682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1ffc9-ce45-4b06-8959-445479b5314c None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:54.541462 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26997a-da00-4d50-b71a-94bfc5349dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:54.542244 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26997a-da00-4d50-b71a-94bfc5349dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:54.542590 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26997a-da00-4d50-b71a-94bfc5349dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:54.542944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26997a-da00-4d50-b71a-94bfc5349dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:54.543640 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26997a-da00-4d50-b71a-94bfc5349dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:54.545488 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26997a-da00-4d50-b71a-94bfc5349dc7 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:54.563952 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 850/1694] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:54.565264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26997a-da00-4d50-b71a-94bfc5349dc7 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:54.565641 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 845/1695] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:54.567536 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696cbe8-d533-4ed6-9edb-656cf5ce03ea None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:54.567986 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696cbe8-d533-4ed6-9edb-656cf5ce03ea None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:54.570946 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696cbe8-d533-4ed6-9edb-656cf5ce03ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:54.572302 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7a26997a-da00-4d50-b71a-94bfc5349dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:54.582996 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:54.623473 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-6696cbe8-d533-4ed6-9edb-656cf5ce03ea None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:54.624842 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6696cbe8-d533-4ed6-9edb-656cf5ce03ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:54.638327 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 846/1696] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:54.638538 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696cbe8-d533-4ed6-9edb-656cf5ce03ea None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:54.668786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696cbe8-d533-4ed6-9edb-656cf5ce03ea None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:54.675995 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671fcc2-6a4d-449e-ae8c-fe6ffcbe6df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:54.676826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671fcc2-6a4d-449e-ae8c-fe6ffcbe6df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:54.677102 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671fcc2-6a4d-449e-ae8c-fe6ffcbe6df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:54.677371 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671fcc2-6a4d-449e-ae8c-fe6ffcbe6df1 admin admin] PATH_INFO: `/v3/projects/3472a8a1e7e149a8892dae8869a5544e/users/0aee7cc5bbd1487cbd5a81c8a43cd8de/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:54.699195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671fcc2-6a4d-449e-ae8c-fe6ffcbe6df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3472a8a1e7e149a8892dae8869a5544e, user_id=0aee7cc5bbd1487cbd5a81c8a43cd8de, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:54.703604 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671fcc2-6a4d-449e-ae8c-fe6ffcbe6df1 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:54.713725 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26997a-da00-4d50-b71a-94bfc5349dc7 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:54.718587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea53f9-56df-4c1e-9d9c-77430d81d843 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:54.719412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea53f9-56df-4c1e-9d9c-77430d81d843 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:54.719791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea53f9-56df-4c1e-9d9c-77430d81d843 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:54.720321 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea53f9-56df-4c1e-9d9c-77430d81d843 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:54.729933 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 847/1697] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:04:54 2022] PUT /identity/v3/projects/3472a8a1e7e149a8892dae8869a5544e/users/0aee7cc5bbd1487cbd5a81c8a43cd8de/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:54.731035 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671fcc2-6a4d-449e-ae8c-fe6ffcbe6df1 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:54.740050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea53f9-56df-4c1e-9d9c-77430d81d843 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:54.742242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea53f9-56df-4c1e-9d9c-77430d81d843 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:54.759752 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 851/1698] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:04:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:04:54.760726 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea53f9-56df-4c1e-9d9c-77430d81d843 service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:54.778848 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea53f9-56df-4c1e-9d9c-77430d81d843 service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:54.923145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc539421-a302-4911-970e-5eb07c85837d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:54.924689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc539421-a302-4911-970e-5eb07c85837d admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:54.925179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc539421-a302-4911-970e-5eb07c85837d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:54.925652 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc539421-a302-4911-970e-5eb07c85837d admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:54.926530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc539421-a302-4911-970e-5eb07c85837d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:04:54.927046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc539421-a302-4911-970e-5eb07c85837d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:54.929490 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc539421-a302-4911-970e-5eb07c85837d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:54.944309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 852/1699] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:04:54.947308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47430502-c63a-41d2-a576-8d92dc918eb0 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:54.947835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47430502-c63a-41d2-a576-8d92dc918eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:54.948563 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47430502-c63a-41d2-a576-8d92dc918eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:54.975296 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671fcc2-6a4d-449e-ae8c-fe6ffcbe6df1 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:54.985892 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0180a0c-71f1-4b4c-b5fd-73d6f227fa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:54.987109 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0180a0c-71f1-4b4c-b5fd-73d6f227fa77 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:54.987395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0180a0c-71f1-4b4c-b5fd-73d6f227fa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:54.987778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0180a0c-71f1-4b4c-b5fd-73d6f227fa77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:54.988717 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0180a0c-71f1-4b4c-b5fd-73d6f227fa77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:54.996311 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0180a0c-71f1-4b4c-b5fd-73d6f227fa77 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:55.008103 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 848/1700] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:55.009221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0180a0c-71f1-4b4c-b5fd-73d6f227fa77 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:55.020605 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0180a0c-71f1-4b4c-b5fd-73d6f227fa77 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:55.025390 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f5e3f-43cd-475b-b92f-4e414190161d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:55.026290 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f5e3f-43cd-475b-b92f-4e414190161d admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:55.026563 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f5e3f-43cd-475b-b92f-4e414190161d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:55.026827 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f5e3f-43cd-475b-b92f-4e414190161d admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:55.027054 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-47430502-c63a-41d2-a576-8d92dc918eb0 None None] MFA Rules not processed for user `0aee7cc5bbd1487cbd5a81c8a43cd8de`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:55.027450 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f5e3f-43cd-475b-b92f-4e414190161d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:55.028932 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-47430502-c63a-41d2-a576-8d92dc918eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:55.029678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f5e3f-43cd-475b-b92f-4e414190161d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:55.072395 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:55.100731 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 849/1701] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:04:55 2022] POST /identity/v3/projects => generated 357 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:55.103661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f5e3f-43cd-475b-b92f-4e414190161d admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:55.142040 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 853/1702] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:55.143005 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47430502-c63a-41d2-a576-8d92dc918eb0 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:55.155741 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47430502-c63a-41d2-a576-8d92dc918eb0 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:55.302585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15efc4-2e78-4885-93e0-2d3109595c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:55.303214 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15efc4-2e78-4885-93e0-2d3109595c8f admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:55.304970 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15efc4-2e78-4885-93e0-2d3109595c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:55.305254 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15efc4-2e78-4885-93e0-2d3109595c8f admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:55.306587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15efc4-2e78-4885-93e0-2d3109595c8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:55.310216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15efc4-2e78-4885-93e0-2d3109595c8f admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:55.331859 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f5e3f-43cd-475b-b92f-4e414190161d admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:55.348462 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db74c8-aec4-45bd-be8b-79f11a8f69aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:55.349152 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db74c8-aec4-45bd-be8b-79f11a8f69aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:55.349429 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db74c8-aec4-45bd-be8b-79f11a8f69aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:55.349701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db74c8-aec4-45bd-be8b-79f11a8f69aa admin admin] PATH_INFO: `/v3/projects/3a0bce892e7f4a3e8fcb7eb15bb26d73/users/555e4a5f9bac4668a9e08fdcacfbc23a/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:55.382613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 854/1703] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:04:55 2022] POST /identity/v3/users => generated 279 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:55.383665 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15efc4-2e78-4885-93e0-2d3109595c8f admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:55.395546 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db74c8-aec4-45bd-be8b-79f11a8f69aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0bce892e7f4a3e8fcb7eb15bb26d73, user_id=555e4a5f9bac4668a9e08fdcacfbc23a, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:55.399746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db74c8-aec4-45bd-be8b-79f11a8f69aa admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:55.404894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15efc4-2e78-4885-93e0-2d3109595c8f admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:55.412959 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29db76c-9f78-44f6-b574-44423ef3e21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:55.413711 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29db76c-9f78-44f6-b574-44423ef3e21b admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:55.417171 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29db76c-9f78-44f6-b574-44423ef3e21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:55.418981 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29db76c-9f78-44f6-b574-44423ef3e21b admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:55.419672 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29db76c-9f78-44f6-b574-44423ef3e21b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:55.422917 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29db76c-9f78-44f6-b574-44423ef3e21b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:55.429621 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 850/1704] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:04:55 2022] PUT /identity/v3/projects/3a0bce892e7f4a3e8fcb7eb15bb26d73/users/555e4a5f9bac4668a9e08fdcacfbc23a/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:55.430657 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db74c8-aec4-45bd-be8b-79f11a8f69aa admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:55.494150 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 855/1705] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:04:55 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:55.495434 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2007d-9870-4cde-81de-b5b241d30836 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:55.495716 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2007d-9870-4cde-81de-b5b241d30836 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:55.495987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2007d-9870-4cde-81de-b5b241d30836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:55.501487 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:55.549990 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-aed2007d-9870-4cde-81de-b5b241d30836 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:55.553210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-aed2007d-9870-4cde-81de-b5b241d30836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:55.570647 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db74c8-aec4-45bd-be8b-79f11a8f69aa admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:55.679262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a2769-d3a2-438a-9fdf-7b236ed7eac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:55.680205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a2769-d3a2-438a-9fdf-7b236ed7eac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:55.680716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a2769-d3a2-438a-9fdf-7b236ed7eac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:55.681108 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a2769-d3a2-438a-9fdf-7b236ed7eac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:55.682702 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a2769-d3a2-438a-9fdf-7b236ed7eac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:55.690473 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a2769-d3a2-438a-9fdf-7b236ed7eac7 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:55.711884 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 856/1706] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:55.712787 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2007d-9870-4cde-81de-b5b241d30836 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:55.720056 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 851/1707] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:55.721601 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a2769-d3a2-438a-9fdf-7b236ed7eac7 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:55.727831 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-689a2769-d3a2-438a-9fdf-7b236ed7eac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:55.738500 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2007d-9870-4cde-81de-b5b241d30836 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:55.745301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a2769-d3a2-438a-9fdf-7b236ed7eac7 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:55.751690 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b900bd9-f271-4ce5-a060-22c48d0f9a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:55.753109 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b900bd9-f271-4ce5-a060-22c48d0f9a84 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:55.753390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b900bd9-f271-4ce5-a060-22c48d0f9a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:55.753657 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b900bd9-f271-4ce5-a060-22c48d0f9a84 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:55.754436 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b900bd9-f271-4ce5-a060-22c48d0f9a84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:55.760007 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b900bd9-f271-4ce5-a060-22c48d0f9a84 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:55.760632 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a49377-2649-4af0-ad70-a94f780e0197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:55.761656 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a49377-2649-4af0-ad70-a94f780e0197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:55.763380 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a49377-2649-4af0-ad70-a94f780e0197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:55.764043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a49377-2649-4af0-ad70-a94f780e0197 admin admin] PATH_INFO: `/v3/users/4cbd96a861dc43c59889bdec3edbc1d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:55.772052 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a49377-2649-4af0-ad70-a94f780e0197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cbd96a861dc43c59889bdec3edbc1d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:55.777336 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a49377-2649-4af0-ad70-a94f780e0197 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:55.841091 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 857/1708] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:04:55 2022] POST /identity/v3/users => generated 289 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:55.842047 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b900bd9-f271-4ce5-a060-22c48d0f9a84 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:55.872489 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b900bd9-f271-4ce5-a060-22c48d0f9a84 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:55.884737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e0a49377-2649-4af0-ad70-a94f780e0197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cbd96a861dc43c59889bdec3edbc1d3'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:55.885388 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f21ad3-0154-4b27-942c-d3bf359447e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:55.885973 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e0a49377-2649-4af0-ad70-a94f780e0197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cbd96a861dc43c59889bdec3edbc1d3'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:55.886498 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f21ad3-0154-4b27-942c-d3bf359447e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:55.887900 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f21ad3-0154-4b27-942c-d3bf359447e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:55.888405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f21ad3-0154-4b27-942c-d3bf359447e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:55.890320 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f21ad3-0154-4b27-942c-d3bf359447e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:55.893658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f21ad3-0154-4b27-942c-d3bf359447e7 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:55.904839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e0a49377-2649-4af0-ad70-a94f780e0197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cbd96a861dc43c59889bdec3edbc1d3'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:55.922349 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 858/1709] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:55.923280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f21ad3-0154-4b27-942c-d3bf359447e7 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:55.927021 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d6f21ad3-0154-4b27-942c-d3bf359447e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:55.930801 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e0a49377-2649-4af0-ad70-a94f780e0197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cbd96a861dc43c59889bdec3edbc1d3'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:55.931521 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e0a49377-2649-4af0-ad70-a94f780e0197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cbd96a861dc43c59889bdec3edbc1d3'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:55.952081 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:55.963343 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 852/1710] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:04:55 2022] DELETE /identity/v3/users/4cbd96a861dc43c59889bdec3edbc1d3 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:55.968074 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a49377-2649-4af0-ad70-a94f780e0197 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:55.972023 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e0a49377-2649-4af0-ad70-a94f780e0197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:56.074431 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f21ad3-0154-4b27-942c-d3bf359447e7 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:56.095578 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:56.118519 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a49377-2649-4af0-ad70-a94f780e0197 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:56.125128 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee1fec-2730-4661-bf2c-4bd484d57482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:56.126114 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee1fec-2730-4661-bf2c-4bd484d57482 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:56.126928 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee1fec-2730-4661-bf2c-4bd484d57482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:56.128086 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee1fec-2730-4661-bf2c-4bd484d57482 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:56.128927 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee1fec-2730-4661-bf2c-4bd484d57482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:56.132329 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee1fec-2730-4661-bf2c-4bd484d57482 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:56.153568 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 853/1711] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:56.154742 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee1fec-2730-4661-bf2c-4bd484d57482 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:56.160580 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c5ee1fec-2730-4661-bf2c-4bd484d57482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:56.179926 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee1fec-2730-4661-bf2c-4bd484d57482 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:56.187342 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74192a-8786-48a1-930d-a23d0545278a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:56.188159 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74192a-8786-48a1-930d-a23d0545278a admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:56.191067 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74192a-8786-48a1-930d-a23d0545278a admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:56.191497 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74192a-8786-48a1-930d-a23d0545278a admin admin] PATH_INFO: `/v3/projects/e4affa3577b64010b9a1be2e9e7e1a48/users/17148c16add84a2b870f6ce086805614/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:56.234026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150db56-2ddb-49a0-aebd-dc432ff4a567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:56.234822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150db56-2ddb-49a0-aebd-dc432ff4a567 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:56.235216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150db56-2ddb-49a0-aebd-dc432ff4a567 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:56.235500 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150db56-2ddb-49a0-aebd-dc432ff4a567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:56.238348 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74192a-8786-48a1-930d-a23d0545278a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4affa3577b64010b9a1be2e9e7e1a48, user_id=17148c16add84a2b870f6ce086805614, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:56.241693 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7150db56-2ddb-49a0-aebd-dc432ff4a567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:56.247818 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74192a-8786-48a1-930d-a23d0545278a admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:56.272491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150db56-2ddb-49a0-aebd-dc432ff4a567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:56.278358 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150db56-2ddb-49a0-aebd-dc432ff4a567 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:56.306903 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 854/1713] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:04:56 2022] PUT /identity/v3/projects/e4affa3577b64010b9a1be2e9e7e1a48/users/17148c16add84a2b870f6ce086805614/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:56.307269 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 859/1713] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:04:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:04:56.308171 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150db56-2ddb-49a0-aebd-dc432ff4a567 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:56.331155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150db56-2ddb-49a0-aebd-dc432ff4a567 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:56.360696 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209a76d-904d-4c73-8754-2a48cf7bc1b2 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:56.364472 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209a76d-904d-4c73-8754-2a48cf7bc1b2 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:56.365361 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209a76d-904d-4c73-8754-2a48cf7bc1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:56.450713 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-0209a76d-904d-4c73-8754-2a48cf7bc1b2 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:56.455671 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-0209a76d-904d-4c73-8754-2a48cf7bc1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:56.481388 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753606c5-5671-4acd-a4b3-3331d1ac5d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:56.482281 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753606c5-5671-4acd-a4b3-3331d1ac5d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:56.482652 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753606c5-5671-4acd-a4b3-3331d1ac5d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:56.482872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753606c5-5671-4acd-a4b3-3331d1ac5d4f admin admin] PATH_INFO: `/v3/projects/4f4994e542504ef6ac6fac7999d9c3b8/users/558aa93c1ea24b9baf5f48b4a49f361c/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:56.512733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753606c5-5671-4acd-a4b3-3331d1ac5d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f4994e542504ef6ac6fac7999d9c3b8, user_id=558aa93c1ea24b9baf5f48b4a49f361c, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:56.517359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753606c5-5671-4acd-a4b3-3331d1ac5d4f admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:56.544345 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 860/1714] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:04:56 2022] PUT /identity/v3/projects/4f4994e542504ef6ac6fac7999d9c3b8/users/558aa93c1ea24b9baf5f48b4a49f361c/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:56.546254 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb658932-5c20-406c-896c-0c4b7d019ba0 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:56.546540 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb658932-5c20-406c-896c-0c4b7d019ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:56.549609 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb658932-5c20-406c-896c-0c4b7d019ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:56.616343 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-bb658932-5c20-406c-896c-0c4b7d019ba0 None None] MFA Rules not processed for user `17148c16add84a2b870f6ce086805614`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:56.617744 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-bb658932-5c20-406c-896c-0c4b7d019ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:56.634242 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 855/1715] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:56.640680 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209a76d-904d-4c73-8754-2a48cf7bc1b2 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:56.675806 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209a76d-904d-4c73-8754-2a48cf7bc1b2 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:56.710550 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:56.782859 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 861/1716] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:56.791315 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb658932-5c20-406c-896c-0c4b7d019ba0 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:56.795055 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-bb658932-5c20-406c-896c-0c4b7d019ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:56.832880 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277da737-37e9-449a-82dc-dadad13bfb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:56.834166 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277da737-37e9-449a-82dc-dadad13bfb5b admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:56.834720 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277da737-37e9-449a-82dc-dadad13bfb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:56.835169 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277da737-37e9-449a-82dc-dadad13bfb5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:56.836294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277da737-37e9-449a-82dc-dadad13bfb5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:56.838577 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277da737-37e9-449a-82dc-dadad13bfb5b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:56.859942 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 856/1717] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:56.863962 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277da737-37e9-449a-82dc-dadad13bfb5b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:56.889523 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277da737-37e9-449a-82dc-dadad13bfb5b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:56.894941 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ef184-ae9a-4a3c-b8e1-8fccd7a5728a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:56.895797 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ef184-ae9a-4a3c-b8e1-8fccd7a5728a admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:56.896280 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ef184-ae9a-4a3c-b8e1-8fccd7a5728a admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:56.896757 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ef184-ae9a-4a3c-b8e1-8fccd7a5728a admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:56.897720 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ef184-ae9a-4a3c-b8e1-8fccd7a5728a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:56.899973 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ef184-ae9a-4a3c-b8e1-8fccd7a5728a admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:56.938837 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb658932-5c20-406c-896c-0c4b7d019ba0 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:56.949726 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 857/1718] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:04:56 2022] POST /identity/v3/projects => generated 357 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:56.951540 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701a441-6528-481c-85d0-9bbbf39f4464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:56.952844 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ef184-ae9a-4a3c-b8e1-8fccd7a5728a admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:56.953881 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701a441-6528-481c-85d0-9bbbf39f4464 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:56.954731 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701a441-6528-481c-85d0-9bbbf39f4464 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:56.955470 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701a441-6528-481c-85d0-9bbbf39f4464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:56.979718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701a441-6528-481c-85d0-9bbbf39f4464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:56.984363 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701a441-6528-481c-85d0-9bbbf39f4464 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:57.013129 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 862/1719] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:04:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:04:57.015252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701a441-6528-481c-85d0-9bbbf39f4464 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:57.045649 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701a441-6528-481c-85d0-9bbbf39f4464 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:57.047824 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:57.118676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ef184-ae9a-4a3c-b8e1-8fccd7a5728a admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:57.134534 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185d7d7-98ac-4ec1-8df7-1c52c6e17492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:57.135583 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185d7d7-98ac-4ec1-8df7-1c52c6e17492 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:57.136082 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185d7d7-98ac-4ec1-8df7-1c52c6e17492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:57.136590 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185d7d7-98ac-4ec1-8df7-1c52c6e17492 admin admin] PATH_INFO: `/v3/projects/4f4994e542504ef6ac6fac7999d9c3b8/users/558aa93c1ea24b9baf5f48b4a49f361c/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:57.143495 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185d7d7-98ac-4ec1-8df7-1c52c6e17492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f4994e542504ef6ac6fac7999d9c3b8, user_id=558aa93c1ea24b9baf5f48b4a49f361c, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:57.147052 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185d7d7-98ac-4ec1-8df7-1c52c6e17492 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:57.175091 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 858/1720] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:04:56 2022] PUT /identity/v3/projects/4f4994e542504ef6ac6fac7999d9c3b8/users/558aa93c1ea24b9baf5f48b4a49f361c/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:57.181102 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143267ae-f7b4-45da-a2d3-6552dec42325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:57.182040 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143267ae-f7b4-45da-a2d3-6552dec42325 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:57.182756 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143267ae-f7b4-45da-a2d3-6552dec42325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:57.184771 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c76c6-614a-45c2-91c6-5887b41a8677 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:57.185398 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c76c6-614a-45c2-91c6-5887b41a8677 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:57.186388 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c76c6-614a-45c2-91c6-5887b41a8677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:57.190604 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143267ae-f7b4-45da-a2d3-6552dec42325 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:57.195061 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143267ae-f7b4-45da-a2d3-6552dec42325 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:57.199457 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143267ae-f7b4-45da-a2d3-6552dec42325 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:57.247219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 863/1721] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:04:57 2022] POST /identity/v3/users => generated 285 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:57.250007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-382c76c6-614a-45c2-91c6-5887b41a8677 None None] MFA Rules not processed for user `558aa93c1ea24b9baf5f48b4a49f361c`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:57.251952 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143267ae-f7b4-45da-a2d3-6552dec42325 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:57.255706 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-382c76c6-614a-45c2-91c6-5887b41a8677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:57.271674 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143267ae-f7b4-45da-a2d3-6552dec42325 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:57.424733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e43b6d-1e76-46e8-930f-e3321a9d7e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:57.425541 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e43b6d-1e76-46e8-930f-e3321a9d7e60 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:57.425940 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e43b6d-1e76-46e8-930f-e3321a9d7e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:57.426366 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e43b6d-1e76-46e8-930f-e3321a9d7e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:57.427322 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e43b6d-1e76-46e8-930f-e3321a9d7e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:57.431378 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e43b6d-1e76-46e8-930f-e3321a9d7e60 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:57.443791 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 859/1722] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:57 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:57.452288 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 864/1723] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:57.454639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c76c6-614a-45c2-91c6-5887b41a8677 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:57.465366 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e43b6d-1e76-46e8-930f-e3321a9d7e60 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:57.468787 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c76c6-614a-45c2-91c6-5887b41a8677 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:57.472028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f4e43b6d-1e76-46e8-930f-e3321a9d7e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:57.482381 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c999e-f655-4bb8-8fdf-42e642e34a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:57.483086 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c999e-f655-4bb8-8fdf-42e642e34a71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:57.483380 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c999e-f655-4bb8-8fdf-42e642e34a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:57.483656 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c999e-f655-4bb8-8fdf-42e642e34a71 admin admin] PATH_INFO: `/v3/projects/928370136bbf494a8ff98de4f3752ed0/users/401914c458714fd3a18f56aa7eeffd75/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:57.494270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:57.523801 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c999e-f655-4bb8-8fdf-42e642e34a71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=928370136bbf494a8ff98de4f3752ed0, user_id=401914c458714fd3a18f56aa7eeffd75, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:57.530653 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c999e-f655-4bb8-8fdf-42e642e34a71 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:57.576749 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e43b6d-1e76-46e8-930f-e3321a9d7e60 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:57.584928 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 860/1724] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:04:57 2022] PUT /identity/v3/projects/928370136bbf494a8ff98de4f3752ed0/users/401914c458714fd3a18f56aa7eeffd75/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:57.587558 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c999e-f655-4bb8-8fdf-42e642e34a71 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:57.693446 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df83308-9d59-45db-a683-865a08877ccb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:57.694733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df83308-9d59-45db-a683-865a08877ccb service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:57.694946 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df83308-9d59-45db-a683-865a08877ccb service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:57.695225 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df83308-9d59-45db-a683-865a08877ccb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:57.744199 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c999e-f655-4bb8-8fdf-42e642e34a71 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:57.767227 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963e403-d93f-4a2a-8f83-de29bb9a3739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:57.768470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963e403-d93f-4a2a-8f83-de29bb9a3739 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:57.768899 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963e403-d93f-4a2a-8f83-de29bb9a3739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:57.769602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963e403-d93f-4a2a-8f83-de29bb9a3739 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:57.770283 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963e403-d93f-4a2a-8f83-de29bb9a3739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:57.774167 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963e403-d93f-4a2a-8f83-de29bb9a3739 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:57.806976 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 861/1725] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:04:57.811167 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963e403-d93f-4a2a-8f83-de29bb9a3739 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:57.821730 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df83308-9d59-45db-a683-865a08877ccb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:57.823361 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df83308-9d59-45db-a683-865a08877ccb service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:57.837136 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 865/1726] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:04:57 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:04:57.850857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963e403-d93f-4a2a-8f83-de29bb9a3739 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:57.863540 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d24c6b-3e5b-4472-9b18-2fd4c2fff4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:57.864357 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d24c6b-3e5b-4472-9b18-2fd4c2fff4e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:57.864678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d24c6b-3e5b-4472-9b18-2fd4c2fff4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:57.865039 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d24c6b-3e5b-4472-9b18-2fd4c2fff4e3 admin admin] PATH_INFO: `/v3/projects/928370136bbf494a8ff98de4f3752ed0/users/401914c458714fd3a18f56aa7eeffd75/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:57.868433 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d24c6b-3e5b-4472-9b18-2fd4c2fff4e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=928370136bbf494a8ff98de4f3752ed0, user_id=401914c458714fd3a18f56aa7eeffd75, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:57.873120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d24c6b-3e5b-4472-9b18-2fd4c2fff4e3 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:57.939634 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 862/1727] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:04:57 2022] PUT /identity/v3/projects/928370136bbf494a8ff98de4f3752ed0/users/401914c458714fd3a18f56aa7eeffd75/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:57.940665 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b3118-499f-4c71-97bb-6e447ccf1974 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:57.941127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b3118-499f-4c71-97bb-6e447ccf1974 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:57.941400 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b3118-499f-4c71-97bb-6e447ccf1974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:57.971049 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d24c6b-3e5b-4472-9b18-2fd4c2fff4e3 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:57.992451 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:58.022852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-bb7b3118-499f-4c71-97bb-6e447ccf1974 None None] MFA Rules not processed for user `401914c458714fd3a18f56aa7eeffd75`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:58.024552 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-bb7b3118-499f-4c71-97bb-6e447ccf1974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:58.123520 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d24c6b-3e5b-4472-9b18-2fd4c2fff4e3 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:58.137438 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9a5a0-b870-410a-8976-f9ec8532528e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:58.139463 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:58.140633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9a5a0-b870-410a-8976-f9ec8532528e service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:58.141039 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9a5a0-b870-410a-8976-f9ec8532528e service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:58.141424 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9a5a0-b870-410a-8976-f9ec8532528e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:58.154615 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 866/1728] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:57 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:04:58.155474 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-afb9a5a0-b870-410a-8976-f9ec8532528e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:58.163877 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b3118-499f-4c71-97bb-6e447ccf1974 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:58.166496 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-bb7b3118-499f-4c71-97bb-6e447ccf1974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:58.201939 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b3118-499f-4c71-97bb-6e447ccf1974 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:58.211729 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b91ca3-1515-4966-8492-a28bcce8cc4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:58.213772 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b91ca3-1515-4966-8492-a28bcce8cc4a service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:58.214792 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b91ca3-1515-4966-8492-a28bcce8cc4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:58.216121 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b91ca3-1515-4966-8492-a28bcce8cc4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:58.242887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b91ca3-1515-4966-8492-a28bcce8cc4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:58.244342 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b91ca3-1515-4966-8492-a28bcce8cc4a service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:58.270307 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 867/1729] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:04:58 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:04:58.291647 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9a5a0-b870-410a-8976-f9ec8532528e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:58.293261 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9a5a0-b870-410a-8976-f9ec8532528e service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:58.306056 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 863/1730] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:04:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:04:58.411138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b91ca3-1515-4966-8492-a28bcce8cc4a service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:58.423583 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b91ca3-1515-4966-8492-a28bcce8cc4a service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:58.429909 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790720f1-8696-4fde-9d8b-5893533bb89a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:58.431408 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790720f1-8696-4fde-9d8b-5893533bb89a service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:58.432506 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790720f1-8696-4fde-9d8b-5893533bb89a service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:58.433688 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790720f1-8696-4fde-9d8b-5893533bb89a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:58.620267 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790720f1-8696-4fde-9d8b-5893533bb89a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:58.621717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790720f1-8696-4fde-9d8b-5893533bb89a service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:58.647131 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 868/1731] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:04:58 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:04:58.722883 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3961e-f976-4552-83fa-3b3cce207eac None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:58.723392 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3961e-f976-4552-83fa-3b3cce207eac None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:58.723510 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3961e-f976-4552-83fa-3b3cce207eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:58.769210 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-08c3961e-f976-4552-83fa-3b3cce207eac None None] MFA Rules not processed for user `bfd8052af6ab43beae0e8d6bb3af5bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:58.773153 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-08c3961e-f976-4552-83fa-3b3cce207eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:58.906952 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 864/1732] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:59.022915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790720f1-8696-4fde-9d8b-5893533bb89a service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:59.024399 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-790720f1-8696-4fde-9d8b-5893533bb89a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:59.202148 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790720f1-8696-4fde-9d8b-5893533bb89a service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:59.221394 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3f867-0573-4b45-8dcf-e852e289ee94 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:59.221922 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3f867-0573-4b45-8dcf-e852e289ee94 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:59.222357 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3f867-0573-4b45-8dcf-e852e289ee94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:59.227671 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddcd9f-b0c3-4ffb-9931-3d564f0f230b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:59.228338 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddcd9f-b0c3-4ffb-9931-3d564f0f230b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:59.228605 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddcd9f-b0c3-4ffb-9931-3d564f0f230b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:59.228984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddcd9f-b0c3-4ffb-9931-3d564f0f230b admin admin] PATH_INFO: `/v3/projects/10c4eac053ae4842845e4228339afcd6` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:59.232974 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ddcd9f-b0c3-4ffb-9931-3d564f0f230b admin admin] RBAC: Authorizing `identity:delete_project(project_id=10c4eac053ae4842845e4228339afcd6)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:59.237395 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ddcd9f-b0c3-4ffb-9931-3d564f0f230b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:59.312759 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-dcd3f867-0573-4b45-8dcf-e852e289ee94 None None] MFA Rules not processed for user `555e4a5f9bac4668a9e08fdcacfbc23a`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:04:59.314778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-dcd3f867-0573-4b45-8dcf-e852e289ee94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:59.368221 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-08ddcd9f-b0c3-4ffb-9931-3d564f0f230b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10c4eac053ae4842845e4228339afcd6', 'request_id': 'req-08ddcd9f-b0c3-4ffb-9931-3d564f0f230b'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:59.383804 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-08ddcd9f-b0c3-4ffb-9931-3d564f0f230b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10c4eac053ae4842845e4228339afcd6', 'request_id': 'req-08ddcd9f-b0c3-4ffb-9931-3d564f0f230b'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:59.403439 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-08ddcd9f-b0c3-4ffb-9931-3d564f0f230b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10c4eac053ae4842845e4228339afcd6', 'request_id': 'req-08ddcd9f-b0c3-4ffb-9931-3d564f0f230b'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:59.437944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-08ddcd9f-b0c3-4ffb-9931-3d564f0f230b admin admin] The token cache is being invalidate because project 10c4eac053ae4842845e4228339afcd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:04:59.439399 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-08ddcd9f-b0c3-4ffb-9931-3d564f0f230b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:59.440379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-08ddcd9f-b0c3-4ffb-9931-3d564f0f230b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:59.457469 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 869/1733] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:04:59 2022] DELETE /identity/v3/projects/10c4eac053ae4842845e4228339afcd6 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:04:59.464922 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddcd9f-b0c3-4ffb-9931-3d564f0f230b admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:59.467512 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-08ddcd9f-b0c3-4ffb-9931-3d564f0f230b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:59.513886 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:59.514638 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:59.533973 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 865/1734] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:04:59 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:04:59.538028 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3f867-0573-4b45-8dcf-e852e289ee94 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:59.542588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-dcd3f867-0573-4b45-8dcf-e852e289ee94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:04:59.578903 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3f867-0573-4b45-8dcf-e852e289ee94 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:59.668849 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddcd9f-b0c3-4ffb-9931-3d564f0f230b admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:04:59.682272 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44928ef9-a549-43a9-bfa2-6f60d66bb85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:59.682981 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44928ef9-a549-43a9-bfa2-6f60d66bb85a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:59.683207 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44928ef9-a549-43a9-bfa2-6f60d66bb85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:59.683480 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44928ef9-a549-43a9-bfa2-6f60d66bb85a admin admin] PATH_INFO: `/v3/users/976aa897e47f4018a31410a37e625e6f` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:59.688390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44928ef9-a549-43a9-bfa2-6f60d66bb85a admin admin] RBAC: Authorizing `identity:delete_user(user_id=976aa897e47f4018a31410a37e625e6f)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:59.692927 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44928ef9-a549-43a9-bfa2-6f60d66bb85a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:59.739559 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f31828-049e-4ece-9fe5-72619c4cb133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:04:59.740114 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f31828-049e-4ece-9fe5-72619c4cb133 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:04:59.740388 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f31828-049e-4ece-9fe5-72619c4cb133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:04:59.740654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f31828-049e-4ece-9fe5-72619c4cb133 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:04:59.741757 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f31828-049e-4ece-9fe5-72619c4cb133 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:04:59.745494 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f31828-049e-4ece-9fe5-72619c4cb133 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:04:59.830253 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-44928ef9-a549-43a9-bfa2-6f60d66bb85a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '976aa897e47f4018a31410a37e625e6f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:59.864050 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 866/1735] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:04:59 2022] POST /identity/v3/projects => generated 403 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:04:59.864050 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f31828-049e-4ece-9fe5-72619c4cb133 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:04:59.866392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-44928ef9-a549-43a9-bfa2-6f60d66bb85a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '976aa897e47f4018a31410a37e625e6f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:59.930607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-44928ef9-a549-43a9-bfa2-6f60d66bb85a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '976aa897e47f4018a31410a37e625e6f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:59.936427 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-44928ef9-a549-43a9-bfa2-6f60d66bb85a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '976aa897e47f4018a31410a37e625e6f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:59.938303 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-44928ef9-a549-43a9-bfa2-6f60d66bb85a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '976aa897e47f4018a31410a37e625e6f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:04:59.986008 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 870/1736] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:04:59 2022] DELETE /identity/v3/users/976aa897e47f4018a31410a37e625e6f => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:00.089672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f31828-049e-4ece-9fe5-72619c4cb133 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:00.163803 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41a0a3-0d2f-440f-90c8-a094fb58e31a None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:00.164362 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41a0a3-0d2f-440f-90c8-a094fb58e31a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:00.164362 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41a0a3-0d2f-440f-90c8-a094fb58e31a None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:00.166749 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 871/1737] 10.222.0.20 () {54 vars in 912 bytes} [Wed Sep 14 01:05:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 01:05:00.181888 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b24d2-e32f-4c10-a69f-dbc1a1fef906 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:00.182386 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b24d2-e32f-4c10-a69f-dbc1a1fef906 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:00.182492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b24d2-e32f-4c10-a69f-dbc1a1fef906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:00.220181 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83744223-fb88-4419-a651-ae7eef086581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:00.221305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83744223-fb88-4419-a651-ae7eef086581 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:00.221583 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83744223-fb88-4419-a651-ae7eef086581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:00.224014 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83744223-fb88-4419-a651-ae7eef086581 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:00.225642 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83744223-fb88-4419-a651-ae7eef086581 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:00.230447 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83744223-fb88-4419-a651-ae7eef086581 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:00.289929 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 867/1738] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:04:59 2022] POST /identity/v3/users => generated 308 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:00.295738 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83744223-fb88-4419-a651-ae7eef086581 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:00.297673 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-646b24d2-e32f-4c10-a69f-dbc1a1fef906 None None] MFA Rules not processed for user `b4444b17075f4224a4da1ef501fd4eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:00.300080 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-83744223-fb88-4419-a651-ae7eef086581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:00.300413 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-646b24d2-e32f-4c10-a69f-dbc1a1fef906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:00.391613 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83744223-fb88-4419-a651-ae7eef086581 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:00.409961 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2134bf-a10b-481d-be38-ca5cd56a82fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:00.414395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2134bf-a10b-481d-be38-ca5cd56a82fa admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:00.415041 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2134bf-a10b-481d-be38-ca5cd56a82fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:00.416668 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2134bf-a10b-481d-be38-ca5cd56a82fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:00.421666 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2134bf-a10b-481d-be38-ca5cd56a82fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:00.428406 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2134bf-a10b-481d-be38-ca5cd56a82fa admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:00.471269 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 868/1739] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 01:05:00.475842 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2134bf-a10b-481d-be38-ca5cd56a82fa admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:00.479860 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 872/1740] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 14 01:05:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:05:00.530998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2134bf-a10b-481d-be38-ca5cd56a82fa admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:00.545858 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eec21c-46f1-4991-beb4-f8d4779e0798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:00.547359 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eec21c-46f1-4991-beb4-f8d4779e0798 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:00.547359 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eec21c-46f1-4991-beb4-f8d4779e0798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:00.547359 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eec21c-46f1-4991-beb4-f8d4779e0798 admin admin] PATH_INFO: `/v3/projects/b10cc58ea21b4c1c94a1490d8ab58f9f/users/521afad5ea8648ff99d1d2e246c7717d/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:00.553973 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:00.588930 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eec21c-46f1-4991-beb4-f8d4779e0798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b10cc58ea21b4c1c94a1490d8ab58f9f, user_id=521afad5ea8648ff99d1d2e246c7717d, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:00.591683 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eec21c-46f1-4991-beb4-f8d4779e0798 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:00.650219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 869/1741] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:00 2022] PUT /identity/v3/projects/b10cc58ea21b4c1c94a1490d8ab58f9f/users/521afad5ea8648ff99d1d2e246c7717d/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:00.652128 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b24d2-e32f-4c10-a69f-dbc1a1fef906 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:00.677364 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b24d2-e32f-4c10-a69f-dbc1a1fef906 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:00.686338 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eec21c-46f1-4991-beb4-f8d4779e0798 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:00.688085 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f0eec21c-46f1-4991-beb4-f8d4779e0798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:00.824694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:00.880245 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eec21c-46f1-4991-beb4-f8d4779e0798 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:00.895709 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c776a5-4d82-4147-a098-51b7ce7ab855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:00.901988 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c776a5-4d82-4147-a098-51b7ce7ab855 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:00.902293 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c776a5-4d82-4147-a098-51b7ce7ab855 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:00.904228 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c776a5-4d82-4147-a098-51b7ce7ab855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:00.942770 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c776a5-4d82-4147-a098-51b7ce7ab855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:00.954078 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c776a5-4d82-4147-a098-51b7ce7ab855 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:01.022908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 870/1742] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:01.023171 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a95574-6a7f-4d78-83df-4663d0d8b96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:01.023968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a95574-6a7f-4d78-83df-4663d0d8b96e admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:01.024123 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a95574-6a7f-4d78-83df-4663d0d8b96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:01.024392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a95574-6a7f-4d78-83df-4663d0d8b96e admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:01.025053 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a95574-6a7f-4d78-83df-4663d0d8b96e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:01.026958 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a95574-6a7f-4d78-83df-4663d0d8b96e admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:01.080579 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 873/1743] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:01.089750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c776a5-4d82-4147-a098-51b7ce7ab855 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:01.109584 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c776a5-4d82-4147-a098-51b7ce7ab855 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:01.132628 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e6281-1270-4bea-80e1-f71528c779b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:01.133548 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e6281-1270-4bea-80e1-f71528c779b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:01.134021 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e6281-1270-4bea-80e1-f71528c779b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:01.134439 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e6281-1270-4bea-80e1-f71528c779b2 admin admin] PATH_INFO: `/v3/projects/b10cc58ea21b4c1c94a1490d8ab58f9f/users/521afad5ea8648ff99d1d2e246c7717d/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:01.138394 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e6281-1270-4bea-80e1-f71528c779b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b10cc58ea21b4c1c94a1490d8ab58f9f, user_id=521afad5ea8648ff99d1d2e246c7717d, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:01.143545 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e6281-1270-4bea-80e1-f71528c779b2 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:01.178978 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 871/1744] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:01 2022] PUT /identity/v3/projects/b10cc58ea21b4c1c94a1490d8ab58f9f/users/521afad5ea8648ff99d1d2e246c7717d/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:01.538518 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a95574-6a7f-4d78-83df-4663d0d8b96e admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:01.540607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-98a95574-6a7f-4d78-83df-4663d0d8b96e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:01.601699 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a95574-6a7f-4d78-83df-4663d0d8b96e admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:01.745975 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b32bfb-7847-49cd-9ddb-571df38a3cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:01.746759 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b32bfb-7847-49cd-9ddb-571df38a3cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:01.748844 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b32bfb-7847-49cd-9ddb-571df38a3cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:01.749219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b32bfb-7847-49cd-9ddb-571df38a3cdf admin admin] PATH_INFO: `/v3/projects/23bd664a93794f538e0a4cc676d8a31f` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:01.754787 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b32bfb-7847-49cd-9ddb-571df38a3cdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=23bd664a93794f538e0a4cc676d8a31f)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:01.757435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b32bfb-7847-49cd-9ddb-571df38a3cdf admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:01.925551 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-29b32bfb-7847-49cd-9ddb-571df38a3cdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23bd664a93794f538e0a4cc676d8a31f', 'request_id': 'req-29b32bfb-7847-49cd-9ddb-571df38a3cdf'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:01.963714 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-29b32bfb-7847-49cd-9ddb-571df38a3cdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23bd664a93794f538e0a4cc676d8a31f', 'request_id': 'req-29b32bfb-7847-49cd-9ddb-571df38a3cdf'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:01.989992 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-29b32bfb-7847-49cd-9ddb-571df38a3cdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23bd664a93794f538e0a4cc676d8a31f', 'request_id': 'req-29b32bfb-7847-49cd-9ddb-571df38a3cdf'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:02.040038 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-29b32bfb-7847-49cd-9ddb-571df38a3cdf admin admin] The token cache is being invalidate because project 23bd664a93794f538e0a4cc676d8a31f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:02.046880 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-29b32bfb-7847-49cd-9ddb-571df38a3cdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:02.049744 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-29b32bfb-7847-49cd-9ddb-571df38a3cdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:02.053379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 874/1745] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:01 2022] DELETE /identity/v3/projects/23bd664a93794f538e0a4cc676d8a31f => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:02.058522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ed664-2699-4637-91b1-ee72114c9ab7 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:02.059005 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ed664-2699-4637-91b1-ee72114c9ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:02.059253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ed664-2699-4637-91b1-ee72114c9ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:02.113414 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-d52ed664-2699-4637-91b1-ee72114c9ab7 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:02.114900 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d52ed664-2699-4637-91b1-ee72114c9ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:02.202468 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b32bfb-7847-49cd-9ddb-571df38a3cdf admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:02.204058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-29b32bfb-7847-49cd-9ddb-571df38a3cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:02.519809 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 872/1746] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:02.528446 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2a7bc-cfe1-4e94-aa58-4838ebbd3c0a None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:02.530439 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2a7bc-cfe1-4e94-aa58-4838ebbd3c0a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:02.531337 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2a7bc-cfe1-4e94-aa58-4838ebbd3c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:02.567333 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:02.631582 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b32bfb-7847-49cd-9ddb-571df38a3cdf admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:02.637511 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-9fe2a7bc-cfe1-4e94-aa58-4838ebbd3c0a None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:02.643254 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9fe2a7bc-cfe1-4e94-aa58-4838ebbd3c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:02.647433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc54357-5504-4d40-94b5-ae9b457d7c08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abf9ab5fafe94afdb3ebe98536b5cc3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:02.648715 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc54357-5504-4d40-94b5-ae9b457d7c08 service placement] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:02.649147 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc54357-5504-4d40-94b5-ae9b457d7c08 service placement] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:02.649615 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc54357-5504-4d40-94b5-ae9b457d7c08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:02.662207 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-cbc54357-5504-4d40-94b5-ae9b457d7c08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:02.682099 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 873/1747] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:02.685925 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2a7bc-cfe1-4e94-aa58-4838ebbd3c0a None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:02.715664 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc54357-5504-4d40-94b5-ae9b457d7c08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:02.720703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc54357-5504-4d40-94b5-ae9b457d7c08 service placement] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:02.730518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2a7bc-cfe1-4e94-aa58-4838ebbd3c0a None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:02.740125 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0f068-2123-4865-83b9-34201951a7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:02.740993 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0f068-2123-4865-83b9-34201951a7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:02.741595 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0f068-2123-4865-83b9-34201951a7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:02.741595 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0f068-2123-4865-83b9-34201951a7a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:02.742285 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0f068-2123-4865-83b9-34201951a7a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:05:02.742501 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0f068-2123-4865-83b9-34201951a7a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:02.744609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0f068-2123-4865-83b9-34201951a7a3 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:02.751117 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 875/1748] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:02.782575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 874/1749] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:05:02.785913 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc54357-5504-4d40-94b5-ae9b457d7c08 service placement] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:02.823853 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc54357-5504-4d40-94b5-ae9b457d7c08 service placement] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:02.839693 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c7bc3-52e1-415b-9d16-e306d2be4cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:02.840324 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c7bc3-52e1-415b-9d16-e306d2be4cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:02.840604 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c7bc3-52e1-415b-9d16-e306d2be4cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:02.840875 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c7bc3-52e1-415b-9d16-e306d2be4cd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:02.841512 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c7bc3-52e1-415b-9d16-e306d2be4cd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:02.848102 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c7bc3-52e1-415b-9d16-e306d2be4cd3 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:02.931308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 876/1750] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:02 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:02.932696 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0f068-2123-4865-83b9-34201951a7a3 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:02.947962 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0f068-2123-4865-83b9-34201951a7a3 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:03.145309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:03.170457 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83bf9a-7f42-4c5a-a2ef-df6968fcaf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:03.173425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83bf9a-7f42-4c5a-a2ef-df6968fcaf2f admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:03.174139 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83bf9a-7f42-4c5a-a2ef-df6968fcaf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:03.175669 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83bf9a-7f42-4c5a-a2ef-df6968fcaf2f admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:03.177455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf83bf9a-7f42-4c5a-a2ef-df6968fcaf2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:03.186835 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf83bf9a-7f42-4c5a-a2ef-df6968fcaf2f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:03.265779 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 875/1751] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:02 2022] POST /identity/v3/users => generated 290 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:03.270173 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c7bc3-52e1-415b-9d16-e306d2be4cd3 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:03.286614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c7bc3-52e1-415b-9d16-e306d2be4cd3 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:03.297911 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0328a-6724-4d55-bdd5-db13ca1f28cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:03.298492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0328a-6724-4d55-bdd5-db13ca1f28cd admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:03.299027 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0328a-6724-4d55-bdd5-db13ca1f28cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:03.299169 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0328a-6724-4d55-bdd5-db13ca1f28cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:03.300125 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0328a-6724-4d55-bdd5-db13ca1f28cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:03.303722 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0328a-6724-4d55-bdd5-db13ca1f28cd admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:03.341790 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83bf9a-7f42-4c5a-a2ef-df6968fcaf2f admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:03.355104 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 877/1752] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:03.356934 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83bf9a-7f42-4c5a-a2ef-df6968fcaf2f admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:03.363097 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed19a8-d201-4e59-ad05-2ae509fa03b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:03.363709 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed19a8-d201-4e59-ad05-2ae509fa03b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:03.363983 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed19a8-d201-4e59-ad05-2ae509fa03b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:03.364246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed19a8-d201-4e59-ad05-2ae509fa03b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:03.364883 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed19a8-d201-4e59-ad05-2ae509fa03b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:03.368114 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed19a8-d201-4e59-ad05-2ae509fa03b3 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:03.387333 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0328a-6724-4d55-bdd5-db13ca1f28cd admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:03.394541 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 876/1753] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:03.400056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0328a-6724-4d55-bdd5-db13ca1f28cd admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:03.405899 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce71aa6-0d4b-4129-9903-c0402791aad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:03.407229 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce71aa6-0d4b-4129-9903-c0402791aad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:03.407585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce71aa6-0d4b-4129-9903-c0402791aad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:03.408814 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce71aa6-0d4b-4129-9903-c0402791aad7 admin admin] PATH_INFO: `/v3/projects/4f4f1a4aad284cb68a8a874a969e030f/users/99277581f38747be821c76c7e87028ca/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:03.429825 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce71aa6-0d4b-4129-9903-c0402791aad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f4f1a4aad284cb68a8a874a969e030f, user_id=99277581f38747be821c76c7e87028ca, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:03.433493 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce71aa6-0d4b-4129-9903-c0402791aad7 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:03.456779 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4967a9-f6be-4d6a-bfbd-b7b013546331 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:03.457152 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4967a9-f6be-4d6a-bfbd-b7b013546331 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:03.457346 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4967a9-f6be-4d6a-bfbd-b7b013546331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:03.485240 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 878/1754] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:03 2022] PUT /identity/v3/projects/4f4f1a4aad284cb68a8a874a969e030f/users/99277581f38747be821c76c7e87028ca/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:05:03.489291 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f61812-0d2e-41a0-ad77-ebf7b85c9bab None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:03.489574 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f61812-0d2e-41a0-ad77-ebf7b85c9bab None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:03.489862 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f61812-0d2e-41a0-ad77-ebf7b85c9bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:03.532879 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-8c4967a9-f6be-4d6a-bfbd-b7b013546331 None None] MFA Rules not processed for user `0cf99358484c49c8bb4b55f4d0d852bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:03.535469 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8c4967a9-f6be-4d6a-bfbd-b7b013546331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:03.596302 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-71f61812-0d2e-41a0-ad77-ebf7b85c9bab None None] MFA Rules not processed for user `99277581f38747be821c76c7e87028ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:03.600396 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-71f61812-0d2e-41a0-ad77-ebf7b85c9bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:03.687403 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 879/1755] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:03.691699 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f61812-0d2e-41a0-ad77-ebf7b85c9bab None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:03.772143 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 877/1756] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:05:03.783530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56f362-fb99-443e-b279-e497a8846d0d None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:03.783873 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56f362-fb99-443e-b279-e497a8846d0d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:03.784193 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56f362-fb99-443e-b279-e497a8846d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:03.821989 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-bb56f362-fb99-443e-b279-e497a8846d0d None None] MFA Rules not processed for user `0cf99358484c49c8bb4b55f4d0d852bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:03.823288 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-bb56f362-fb99-443e-b279-e497a8846d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:03.843825 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 878/1757] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:03.856414 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56f362-fb99-443e-b279-e497a8846d0d None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:03.858622 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-bb56f362-fb99-443e-b279-e497a8846d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:03.895191 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f61812-0d2e-41a0-ad77-ebf7b85c9bab None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:03.932399 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3744704-277f-4738-9805-1fc2337be193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:03.933050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3744704-277f-4738-9805-1fc2337be193 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:03.933335 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3744704-277f-4738-9805-1fc2337be193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:03.938728 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3744704-277f-4738-9805-1fc2337be193 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:03.940088 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3744704-277f-4738-9805-1fc2337be193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:03.945263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3744704-277f-4738-9805-1fc2337be193 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:04.072870 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56f362-fb99-443e-b279-e497a8846d0d None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:04.110769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 880/1758] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:03 2022] POST /identity/v3/projects => generated 377 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:04.113412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3744704-277f-4738-9805-1fc2337be193 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:04.118214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25317a-2e0b-4fec-89cc-2ebc378c8718 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:04.119749 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25317a-2e0b-4fec-89cc-2ebc378c8718 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:04.121278 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25317a-2e0b-4fec-89cc-2ebc378c8718 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:04.121788 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25317a-2e0b-4fec-89cc-2ebc378c8718 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:04.124549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:04.147430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25317a-2e0b-4fec-89cc-2ebc378c8718 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:04.152289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25317a-2e0b-4fec-89cc-2ebc378c8718 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:04.189753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 879/1759] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:04.282652 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3744704-277f-4738-9805-1fc2337be193 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:04.290552 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa4cb2-24af-49f1-8e3d-a0319c802dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:04.291503 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa4cb2-24af-49f1-8e3d-a0319c802dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:04.291731 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa4cb2-24af-49f1-8e3d-a0319c802dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:04.292106 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa4cb2-24af-49f1-8e3d-a0319c802dc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:04.292854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa4cb2-24af-49f1-8e3d-a0319c802dc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:04.294943 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa4cb2-24af-49f1-8e3d-a0319c802dc2 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:04.335623 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 881/1760] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:04 2022] POST /identity/v3/users => generated 295 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:04.342193 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25317a-2e0b-4fec-89cc-2ebc378c8718 service nova] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:04.367501 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25317a-2e0b-4fec-89cc-2ebc378c8718 service nova] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:04.390342 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d4d69-2e2d-4ed1-8070-86477a68909f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:04.396176 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d4d69-2e2d-4ed1-8070-86477a68909f admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:04.396176 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d4d69-2e2d-4ed1-8070-86477a68909f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:04.396472 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d4d69-2e2d-4ed1-8070-86477a68909f admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:04.397306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d4d69-2e2d-4ed1-8070-86477a68909f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:04.399465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d4d69-2e2d-4ed1-8070-86477a68909f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:04.435970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 880/1761] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:04.436469 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa4cb2-24af-49f1-8e3d-a0319c802dc2 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:04.446758 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa4cb2-24af-49f1-8e3d-a0319c802dc2 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:04.458707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738b02d-dab0-47b6-a52b-e9aa00b1e869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:04.459615 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738b02d-dab0-47b6-a52b-e9aa00b1e869 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:04.462006 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738b02d-dab0-47b6-a52b-e9aa00b1e869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:04.462446 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738b02d-dab0-47b6-a52b-e9aa00b1e869 admin admin] PATH_INFO: `/v3/projects/96a80e36a80e4a10988bd4dfd01b0f4f/users/05db63b023b34ab4aed724cbcc785cc6/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:04.522587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738b02d-dab0-47b6-a52b-e9aa00b1e869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a80e36a80e4a10988bd4dfd01b0f4f, user_id=05db63b023b34ab4aed724cbcc785cc6, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:04.534865 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738b02d-dab0-47b6-a52b-e9aa00b1e869 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:04.572655 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 882/1762] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:04 2022] PUT /identity/v3/projects/96a80e36a80e4a10988bd4dfd01b0f4f/users/05db63b023b34ab4aed724cbcc785cc6/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:04.576618 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d4d69-2e2d-4ed1-8070-86477a68909f admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:04.590938 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d4d69-2e2d-4ed1-8070-86477a68909f admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:04.685764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:04.711065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a7640-0b92-48c1-8cf4-89d9bfeb7b79 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:04.711606 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a7640-0b92-48c1-8cf4-89d9bfeb7b79 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:04.711606 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a7640-0b92-48c1-8cf4-89d9bfeb7b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:04.787858 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a89d7-332b-44b6-a0e6-8e610eae5600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:04.788661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a89d7-332b-44b6-a0e6-8e610eae5600 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:04.789079 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a89d7-332b-44b6-a0e6-8e610eae5600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:04.789458 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a89d7-332b-44b6-a0e6-8e610eae5600 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:04.790388 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a89d7-332b-44b6-a0e6-8e610eae5600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:04.795925 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a89d7-332b-44b6-a0e6-8e610eae5600 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:04.827367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 881/1763] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:04.831313 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a89d7-332b-44b6-a0e6-8e610eae5600 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:04.839032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-d40a7640-0b92-48c1-8cf4-89d9bfeb7b79 None None] MFA Rules not processed for user `521afad5ea8648ff99d1d2e246c7717d`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:04.841016 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d40a7640-0b92-48c1-8cf4-89d9bfeb7b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:04.855902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a89d7-332b-44b6-a0e6-8e610eae5600 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:04.863462 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f3408-ea6f-49eb-a12b-1d7c52e3cef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:04.864445 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f3408-ea6f-49eb-a12b-1d7c52e3cef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:04.864867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f3408-ea6f-49eb-a12b-1d7c52e3cef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:04.865244 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f3408-ea6f-49eb-a12b-1d7c52e3cef4 admin admin] PATH_INFO: `/v3/projects/96a80e36a80e4a10988bd4dfd01b0f4f/users/05db63b023b34ab4aed724cbcc785cc6/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:04.868005 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f3408-ea6f-49eb-a12b-1d7c52e3cef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a80e36a80e4a10988bd4dfd01b0f4f, user_id=05db63b023b34ab4aed724cbcc785cc6, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:04.871423 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f3408-ea6f-49eb-a12b-1d7c52e3cef4 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:04.897409 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 882/1764] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:04 2022] PUT /identity/v3/projects/96a80e36a80e4a10988bd4dfd01b0f4f/users/05db63b023b34ab4aed724cbcc785cc6/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:05:04.907388 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd2b5f-938f-420b-bfca-6545790ecdea None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:04.907789 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd2b5f-938f-420b-bfca-6545790ecdea None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:04.908218 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd2b5f-938f-420b-bfca-6545790ecdea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:04.979387 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-93dd2b5f-938f-420b-bfca-6545790ecdea None None] MFA Rules not processed for user `05db63b023b34ab4aed724cbcc785cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:04.980777 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-93dd2b5f-938f-420b-bfca-6545790ecdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:05.176626 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 883/1765] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:04 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:05.180297 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fc272-ff8a-4780-bcab-f1031ef27aca None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:05.181446 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fc272-ff8a-4780-bcab-f1031ef27aca None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:05.182203 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fc272-ff8a-4780-bcab-f1031ef27aca None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:05.192876 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 884/1766] 10.222.0.20 () {54 vars in 912 bytes} [Wed Sep 14 01:05:05 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 01:05:05.195905 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41988c24-403b-40ad-b9e6-93e55bc24802 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:05.197453 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41988c24-403b-40ad-b9e6-93e55bc24802 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:05.198439 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41988c24-403b-40ad-b9e6-93e55bc24802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:05.265195 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-41988c24-403b-40ad-b9e6-93e55bc24802 None None] MFA Rules not processed for user `b4444b17075f4224a4da1ef501fd4eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:05.267968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 883/1767] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:05.275992 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-41988c24-403b-40ad-b9e6-93e55bc24802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:05.284611 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd2b5f-938f-420b-bfca-6545790ecdea None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:05.286418 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-93dd2b5f-938f-420b-bfca-6545790ecdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:05.437682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd2b5f-938f-420b-bfca-6545790ecdea None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:05.447714 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49487ab-12f1-4880-8b33-38c4289a030b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:05.448611 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49487ab-12f1-4880-8b33-38c4289a030b service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:05.452263 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49487ab-12f1-4880-8b33-38c4289a030b service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:05.452720 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49487ab-12f1-4880-8b33-38c4289a030b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:05.537057 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 885/1768] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 14 01:05:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:05.568552 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41988c24-403b-40ad-b9e6-93e55bc24802 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:05.569765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-41988c24-403b-40ad-b9e6-93e55bc24802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:05.576748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:05.590162 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41988c24-403b-40ad-b9e6-93e55bc24802 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:05.591289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:05.598032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49487ab-12f1-4880-8b33-38c4289a030b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:05.600438 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49487ab-12f1-4880-8b33-38c4289a030b service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:05.604634 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3deed-adc5-44fe-a18d-c02f3ccaa59d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:05.608037 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3deed-adc5-44fe-a18d-c02f3ccaa59d service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:05.609348 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3deed-adc5-44fe-a18d-c02f3ccaa59d service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:05.609469 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3deed-adc5-44fe-a18d-c02f3ccaa59d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:05.630133 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 884/1769] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:05.630658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3deed-adc5-44fe-a18d-c02f3ccaa59d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:05.636338 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3deed-adc5-44fe-a18d-c02f3ccaa59d service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:05.655880 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 886/1770] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 01:05:05.979411 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dd0c9-eb43-4149-bcc9-2fb4086ed291 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:05.979695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dd0c9-eb43-4149-bcc9-2fb4086ed291 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:05.979971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dd0c9-eb43-4149-bcc9-2fb4086ed291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:06.086531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-842dd0c9-eb43-4149-bcc9-2fb4086ed291 None None] MFA Rules not processed for user `c6b688a53f9547eba0aa9cbb1b764b63`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:06.087932 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-842dd0c9-eb43-4149-bcc9-2fb4086ed291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:06.316711 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 885/1771] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:06.335952 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd0995-8ff2-4054-ae05-e4bc73ddfdda None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:06.336565 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd0995-8ff2-4054-ae05-e4bc73ddfdda None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:06.336565 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd0995-8ff2-4054-ae05-e4bc73ddfdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:06.420134 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-36bd0995-8ff2-4054-ae05-e4bc73ddfdda None None] MFA Rules not processed for user `c6b688a53f9547eba0aa9cbb1b764b63`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:06.424907 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-36bd0995-8ff2-4054-ae05-e4bc73ddfdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:06.471445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 887/1772] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:06.474317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dd0c9-eb43-4149-bcc9-2fb4086ed291 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:06.475858 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-842dd0c9-eb43-4149-bcc9-2fb4086ed291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:06.726964 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dd0c9-eb43-4149-bcc9-2fb4086ed291 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:06.761588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb6680-8df1-4ca4-8b52-eb62450da55b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:06.762318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb6680-8df1-4ca4-8b52-eb62450da55b service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:06.762599 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb6680-8df1-4ca4-8b52-eb62450da55b service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:06.762940 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb6680-8df1-4ca4-8b52-eb62450da55b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:06.816351 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb6680-8df1-4ca4-8b52-eb62450da55b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:06.816351 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb6680-8df1-4ca4-8b52-eb62450da55b service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:06.867941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b8d99-2e89-4adc-8e7e-609ff2a7b562 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:06.868141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b8d99-2e89-4adc-8e7e-609ff2a7b562 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:06.868805 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b8d99-2e89-4adc-8e7e-609ff2a7b562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:06.880489 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 886/1773] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:06 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:07.047313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-cf4b8d99-2e89-4adc-8e7e-609ff2a7b562 None None] MFA Rules not processed for user `eb9d1149a417436bbf1577d61407c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:07.048953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-cf4b8d99-2e89-4adc-8e7e-609ff2a7b562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:07.148560 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 888/1774] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 14 01:05:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:05:07.400950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb6680-8df1-4ca4-8b52-eb62450da55b service nova] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:07.402678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-55eb6680-8df1-4ca4-8b52-eb62450da55b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:07.458905 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ada82-9200-49b7-8591-040c36e8391d None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:07.459416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ada82-9200-49b7-8591-040c36e8391d None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:07.459491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ada82-9200-49b7-8591-040c36e8391d None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:07.460858 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 889/1775] 10.222.0.20 () {54 vars in 921 bytes} [Wed Sep 14 01:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 01:05:07.503036 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6eac0-76c0-42a8-97fb-880c1fe544aa None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:07.504329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6eac0-76c0-42a8-97fb-880c1fe544aa None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:07.504812 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6eac0-76c0-42a8-97fb-880c1fe544aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:07.543006 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-21a6eac0-76c0-42a8-97fb-880c1fe544aa None None] MFA Rules not processed for user `abf9ab5fafe94afdb3ebe98536b5cc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:07.546112 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-21a6eac0-76c0-42a8-97fb-880c1fe544aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:07.568342 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:07.633565 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb6680-8df1-4ca4-8b52-eb62450da55b service nova] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:07.650305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdc260-82b1-4729-9438-dd4b4aab7705 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d05652bfe542d5a2cfa39fbf7a83c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:07.651380 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdc260-82b1-4729-9438-dd4b4aab7705 service swift] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:07.651774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdc260-82b1-4729-9438-dd4b4aab7705 service swift] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:07.652866 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdc260-82b1-4729-9438-dd4b4aab7705 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:07.670216 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdc260-82b1-4729-9438-dd4b4aab7705 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:07.672870 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdc260-82b1-4729-9438-dd4b4aab7705 service swift] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:07.699195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 887/1776] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 14 01:05:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 01:05:07.712421 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 890/1777] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Sep 14 01:05:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:07.776469 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a6df1-822c-4551-8a2a-e05977823887 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:07.776761 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a6df1-822c-4551-8a2a-e05977823887 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:07.777038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a6df1-822c-4551-8a2a-e05977823887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:07.919224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6eac0-76c0-42a8-97fb-880c1fe544aa None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:07.940530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6eac0-76c0-42a8-97fb-880c1fe544aa None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:07.953934 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-0a0a6df1-822c-4551-8a2a-e05977823887 None None] MFA Rules not processed for user `2b5730c49e61438884e3d9f4451e3b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:07.958141 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-0a0a6df1-822c-4551-8a2a-e05977823887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:07.962108 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5a786-22ae-496e-a427-ffb35f7f30b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:07.966138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5a786-22ae-496e-a427-ffb35f7f30b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:07.966511 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5a786-22ae-496e-a427-ffb35f7f30b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:07.974683 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5a786-22ae-496e-a427-ffb35f7f30b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:08.002415 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5a786-22ae-496e-a427-ffb35f7f30b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:08.007980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5a786-22ae-496e-a427-ffb35f7f30b2 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:08.054205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 891/1778] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 01:05:08.062298 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593c3a8-3a2b-4e83-ba93-42d0ef1d3001 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:08.063727 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593c3a8-3a2b-4e83-ba93-42d0ef1d3001 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:08.064092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593c3a8-3a2b-4e83-ba93-42d0ef1d3001 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:08.076237 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 892/1779] 10.222.0.20 () {54 vars in 961 bytes} [Wed Sep 14 01:05:08 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 01:05:08.086370 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618836f5-d1f7-4a5b-9e4b-36e59a3e73f9 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:08.086836 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618836f5-d1f7-4a5b-9e4b-36e59a3e73f9 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:08.088029 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618836f5-d1f7-4a5b-9e4b-36e59a3e73f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:08.158284 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-618836f5-d1f7-4a5b-9e4b-36e59a3e73f9 None None] MFA Rules not processed for user `abf9ab5fafe94afdb3ebe98536b5cc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:08.159720 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-618836f5-d1f7-4a5b-9e4b-36e59a3e73f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:08.184197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 893/1780] 10.222.0.20 () {58 vars in 1058 bytes} [Wed Sep 14 01:05:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:05:08.198924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618836f5-d1f7-4a5b-9e4b-36e59a3e73f9 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:08.214876 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618836f5-d1f7-4a5b-9e4b-36e59a3e73f9 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:08.230564 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7c765-0725-4fde-be06-a08bdae1a5f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abf9ab5fafe94afdb3ebe98536b5cc3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:08.231467 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7c765-0725-4fde-be06-a08bdae1a5f2 service placement] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:08.231467 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7c765-0725-4fde-be06-a08bdae1a5f2 service placement] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:08.231739 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7c765-0725-4fde-be06-a08bdae1a5f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:08.248463 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7c765-0725-4fde-be06-a08bdae1a5f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:08.251286 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7c765-0725-4fde-be06-a08bdae1a5f2 service placement] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:08.293839 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 894/1781] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:08.326236 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7c765-0725-4fde-be06-a08bdae1a5f2 service placement] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:08.327681 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-31b7c765-0725-4fde-be06-a08bdae1a5f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:08.384618 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:08.407126 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 888/1782] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 624 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:08.558714 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7c765-0725-4fde-be06-a08bdae1a5f2 service placement] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:08.571910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a165c-e871-4b05-bad5-cb1e7660cbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:08.572686 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a165c-e871-4b05-bad5-cb1e7660cbb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:08.572983 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a165c-e871-4b05-bad5-cb1e7660cbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:08.573261 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a165c-e871-4b05-bad5-cb1e7660cbb9 admin admin] PATH_INFO: `/v3/users/0aee7cc5bbd1487cbd5a81c8a43cd8de` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:08.575699 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a165c-e871-4b05-bad5-cb1e7660cbb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aee7cc5bbd1487cbd5a81c8a43cd8de)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:08.577629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a165c-e871-4b05-bad5-cb1e7660cbb9 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:08.720001 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5c4a165c-e871-4b05-bad5-cb1e7660cbb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aee7cc5bbd1487cbd5a81c8a43cd8de'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:08.761638 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5c4a165c-e871-4b05-bad5-cb1e7660cbb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aee7cc5bbd1487cbd5a81c8a43cd8de'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:08.808433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5c4a165c-e871-4b05-bad5-cb1e7660cbb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aee7cc5bbd1487cbd5a81c8a43cd8de'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:08.812166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5c4a165c-e871-4b05-bad5-cb1e7660cbb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aee7cc5bbd1487cbd5a81c8a43cd8de'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:08.815089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5c4a165c-e871-4b05-bad5-cb1e7660cbb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aee7cc5bbd1487cbd5a81c8a43cd8de'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:08.861385 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 895/1783] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:08 2022] DELETE /identity/v3/users/0aee7cc5bbd1487cbd5a81c8a43cd8de => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:05:08.867154 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da38bd9-6d12-41a2-8044-4be57ec98643 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:08.867586 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da38bd9-6d12-41a2-8044-4be57ec98643 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:08.867858 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da38bd9-6d12-41a2-8044-4be57ec98643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:08.933429 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-9da38bd9-6d12-41a2-8044-4be57ec98643 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:08.935709 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9da38bd9-6d12-41a2-8044-4be57ec98643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:09.335577 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 889/1784] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:09.468224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a165c-e871-4b05-bad5-cb1e7660cbb9 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:09.470886 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5c4a165c-e871-4b05-bad5-cb1e7660cbb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:09.779427 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a165c-e871-4b05-bad5-cb1e7660cbb9 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:09.802107 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e07b17-890b-42b5-8a65-61bf7648e196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:09.802107 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e07b17-890b-42b5-8a65-61bf7648e196 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:09.802107 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e07b17-890b-42b5-8a65-61bf7648e196 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:09.802107 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e07b17-890b-42b5-8a65-61bf7648e196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:09.838646 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e07b17-890b-42b5-8a65-61bf7648e196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:09.840253 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e07b17-890b-42b5-8a65-61bf7648e196 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:09.869006 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 896/1785] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:10.276583 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da38bd9-6d12-41a2-8044-4be57ec98643 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:10.278821 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9da38bd9-6d12-41a2-8044-4be57ec98643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:10.319673 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da38bd9-6d12-41a2-8044-4be57ec98643 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:10.341682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded2012-e1a9-4451-ae09-3cfd03f0ae7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:10.342689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded2012-e1a9-4451-ae09-3cfd03f0ae7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:10.343265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded2012-e1a9-4451-ae09-3cfd03f0ae7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:10.343805 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded2012-e1a9-4451-ae09-3cfd03f0ae7b admin admin] PATH_INFO: `/v3/users/555e4a5f9bac4668a9e08fdcacfbc23a` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:10.346637 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded2012-e1a9-4451-ae09-3cfd03f0ae7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=555e4a5f9bac4668a9e08fdcacfbc23a)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:10.348878 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded2012-e1a9-4451-ae09-3cfd03f0ae7b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:10.472245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e376b5-07ad-4b72-9200-2fb8d32a7daa None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:10.473514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e376b5-07ad-4b72-9200-2fb8d32a7daa None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:10.473999 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e376b5-07ad-4b72-9200-2fb8d32a7daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:10.488800 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-5ded2012-e1a9-4451-ae09-3cfd03f0ae7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '555e4a5f9bac4668a9e08fdcacfbc23a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:10.491063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-5ded2012-e1a9-4451-ae09-3cfd03f0ae7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '555e4a5f9bac4668a9e08fdcacfbc23a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:10.510174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-5ded2012-e1a9-4451-ae09-3cfd03f0ae7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '555e4a5f9bac4668a9e08fdcacfbc23a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:10.526108 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:10.553129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-5ded2012-e1a9-4451-ae09-3cfd03f0ae7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '555e4a5f9bac4668a9e08fdcacfbc23a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:10.554436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-5ded2012-e1a9-4451-ae09-3cfd03f0ae7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '555e4a5f9bac4668a9e08fdcacfbc23a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:10.556439 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-f8e376b5-07ad-4b72-9200-2fb8d32a7daa None None] MFA Rules not processed for user `b4444b17075f4224a4da1ef501fd4eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:10.559780 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f8e376b5-07ad-4b72-9200-2fb8d32a7daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:10.589430 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 897/1786] 10.222.0.23 () {58 vars in 1015 bytes} [Wed Sep 14 01:05:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:10.600768 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 890/1787] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:10 2022] DELETE /identity/v3/users/555e4a5f9bac4668a9e08fdcacfbc23a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:10.746564 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e376b5-07ad-4b72-9200-2fb8d32a7daa None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:10.748640 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f8e376b5-07ad-4b72-9200-2fb8d32a7daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:10.837166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e376b5-07ad-4b72-9200-2fb8d32a7daa None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:10.852857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded2012-e1a9-4451-ae09-3cfd03f0ae7b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:10.854579 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5ded2012-e1a9-4451-ae09-3cfd03f0ae7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:11.030031 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:11.102783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92976c8e-a1dd-4fd3-a314-69700d850730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:11.104483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92976c8e-a1dd-4fd3-a314-69700d850730 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:11.104772 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92976c8e-a1dd-4fd3-a314-69700d850730 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:11.105046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92976c8e-a1dd-4fd3-a314-69700d850730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:11.132860 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92976c8e-a1dd-4fd3-a314-69700d850730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:11.137786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92976c8e-a1dd-4fd3-a314-69700d850730 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:11.181952 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 898/1788] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:11.249544 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded2012-e1a9-4451-ae09-3cfd03f0ae7b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:11.264262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d511922-c41f-487d-a9e4-c97821255506 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:11.265007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d511922-c41f-487d-a9e4-c97821255506 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:11.265283 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d511922-c41f-487d-a9e4-c97821255506 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:11.265589 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d511922-c41f-487d-a9e4-c97821255506 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:11.276859 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1d511922-c41f-487d-a9e4-c97821255506 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:11.486652 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d511922-c41f-487d-a9e4-c97821255506 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:11.488630 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d511922-c41f-487d-a9e4-c97821255506 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:11.521978 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 891/1789] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 01:05:12.060170 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e2b43-c6ca-40c2-8d32-b3d21782e8da None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:12.060711 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e2b43-c6ca-40c2-8d32-b3d21782e8da None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:12.060711 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e2b43-c6ca-40c2-8d32-b3d21782e8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:12.177118 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-bf2e2b43-c6ca-40c2-8d32-b3d21782e8da None None] MFA Rules not processed for user `c6b688a53f9547eba0aa9cbb1b764b63`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:12.179390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-bf2e2b43-c6ca-40c2-8d32-b3d21782e8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:12.403899 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 899/1790] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:05:12.553584 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d511922-c41f-487d-a9e4-c97821255506 service nova] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:12.555983 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1d511922-c41f-487d-a9e4-c97821255506 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:12.702968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e2b43-c6ca-40c2-8d32-b3d21782e8da None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:12.705063 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-bf2e2b43-c6ca-40c2-8d32-b3d21782e8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:12.810669 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d511922-c41f-487d-a9e4-c97821255506 service nova] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:12.827301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66824228-5400-40d5-91a6-13249a2eeb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:12.828167 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66824228-5400-40d5-91a6-13249a2eeb53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:12.829630 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66824228-5400-40d5-91a6-13249a2eeb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:12.830088 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66824228-5400-40d5-91a6-13249a2eeb53 admin admin] PATH_INFO: `/v3/projects/3a0bce892e7f4a3e8fcb7eb15bb26d73` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:12.836851 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66824228-5400-40d5-91a6-13249a2eeb53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a0bce892e7f4a3e8fcb7eb15bb26d73)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:12.840227 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66824228-5400-40d5-91a6-13249a2eeb53 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:12.952731 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:12.968918 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e2b43-c6ca-40c2-8d32-b3d21782e8da None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:13.006738 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc3c2c-0128-4cdb-b284-0a8d44edbc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:13.007941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc3c2c-0128-4cdb-b284-0a8d44edbc48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:13.008591 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc3c2c-0128-4cdb-b284-0a8d44edbc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:13.008879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc3c2c-0128-4cdb-b284-0a8d44edbc48 admin admin] PATH_INFO: `/v3/users/99277581f38747be821c76c7e87028ca` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:13.016158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc3c2c-0128-4cdb-b284-0a8d44edbc48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99277581f38747be821c76c7e87028ca)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:13.024285 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-66824228-5400-40d5-91a6-13249a2eeb53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a0bce892e7f4a3e8fcb7eb15bb26d73', 'request_id': 'req-66824228-5400-40d5-91a6-13249a2eeb53'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:13.024628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc3c2c-0128-4cdb-b284-0a8d44edbc48 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:13.055957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-66824228-5400-40d5-91a6-13249a2eeb53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a0bce892e7f4a3e8fcb7eb15bb26d73', 'request_id': 'req-66824228-5400-40d5-91a6-13249a2eeb53'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:13.099474 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-66824228-5400-40d5-91a6-13249a2eeb53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a0bce892e7f4a3e8fcb7eb15bb26d73', 'request_id': 'req-66824228-5400-40d5-91a6-13249a2eeb53'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:13.178073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fefc3c2c-0128-4cdb-b284-0a8d44edbc48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99277581f38747be821c76c7e87028ca'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:13.181784 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-66824228-5400-40d5-91a6-13249a2eeb53 admin admin] The token cache is being invalidate because project 3a0bce892e7f4a3e8fcb7eb15bb26d73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:13.182119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-66824228-5400-40d5-91a6-13249a2eeb53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:13.184577 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-66824228-5400-40d5-91a6-13249a2eeb53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:13.190158 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 892/1791] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:12 2022] DELETE /identity/v3/projects/3a0bce892e7f4a3e8fcb7eb15bb26d73 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:13.194101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66824228-5400-40d5-91a6-13249a2eeb53 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:13.198759 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-66824228-5400-40d5-91a6-13249a2eeb53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:13.209596 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fefc3c2c-0128-4cdb-b284-0a8d44edbc48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99277581f38747be821c76c7e87028ca'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:13.287444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fefc3c2c-0128-4cdb-b284-0a8d44edbc48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99277581f38747be821c76c7e87028ca'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:13.289775 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fefc3c2c-0128-4cdb-b284-0a8d44edbc48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99277581f38747be821c76c7e87028ca'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:13.303294 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fefc3c2c-0128-4cdb-b284-0a8d44edbc48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99277581f38747be821c76c7e87028ca'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:13.323863 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:13.339411 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 900/1792] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:12 2022] DELETE /identity/v3/users/99277581f38747be821c76c7e87028ca => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:05:13.349272 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc191543-4753-4dbf-93f3-e6db1bb65041 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:13.349816 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc191543-4753-4dbf-93f3-e6db1bb65041 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:13.350286 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc191543-4753-4dbf-93f3-e6db1bb65041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:13.363562 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66824228-5400-40d5-91a6-13249a2eeb53 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:13.396741 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-dc191543-4753-4dbf-93f3-e6db1bb65041 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:13.398225 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-dc191543-4753-4dbf-93f3-e6db1bb65041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:13.590242 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6878bcf-3c82-4b0c-8089-5df4a03bef28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:13.592987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 901/1793] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:13.597727 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6878bcf-3c82-4b0c-8089-5df4a03bef28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:13.598182 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6878bcf-3c82-4b0c-8089-5df4a03bef28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:13.598629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6878bcf-3c82-4b0c-8089-5df4a03bef28 admin admin] PATH_INFO: `/v3/users/521afad5ea8648ff99d1d2e246c7717d` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:13.606670 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6878bcf-3c82-4b0c-8089-5df4a03bef28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=521afad5ea8648ff99d1d2e246c7717d)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:13.614492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6878bcf-3c82-4b0c-8089-5df4a03bef28 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:13.667549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc191543-4753-4dbf-93f3-e6db1bb65041 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:13.669184 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-dc191543-4753-4dbf-93f3-e6db1bb65041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:13.806465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b6878bcf-3c82-4b0c-8089-5df4a03bef28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '521afad5ea8648ff99d1d2e246c7717d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:13.807032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b6878bcf-3c82-4b0c-8089-5df4a03bef28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '521afad5ea8648ff99d1d2e246c7717d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:13.817918 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b6878bcf-3c82-4b0c-8089-5df4a03bef28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '521afad5ea8648ff99d1d2e246c7717d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:13.819353 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:13.844930 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b6878bcf-3c82-4b0c-8089-5df4a03bef28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '521afad5ea8648ff99d1d2e246c7717d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:13.852473 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b6878bcf-3c82-4b0c-8089-5df4a03bef28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '521afad5ea8648ff99d1d2e246c7717d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:13.909342 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 893/1794] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:13 2022] DELETE /identity/v3/users/521afad5ea8648ff99d1d2e246c7717d => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:13.924328 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc191543-4753-4dbf-93f3-e6db1bb65041 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:14.210900 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385933f-1d6a-4d97-87e0-c752e3ee5661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:14.212310 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385933f-1d6a-4d97-87e0-c752e3ee5661 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:14.212750 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385933f-1d6a-4d97-87e0-c752e3ee5661 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:14.213215 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385933f-1d6a-4d97-87e0-c752e3ee5661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:14.221980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3385933f-1d6a-4d97-87e0-c752e3ee5661 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:14.438231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385933f-1d6a-4d97-87e0-c752e3ee5661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:14.439739 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385933f-1d6a-4d97-87e0-c752e3ee5661 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:14.453219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 902/1795] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 786 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:14.880785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6878bcf-3c82-4b0c-8089-5df4a03bef28 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:14.882834 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b6878bcf-3c82-4b0c-8089-5df4a03bef28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:14.949582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6878bcf-3c82-4b0c-8089-5df4a03bef28 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:14.976132 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf4ea2-2220-4d1b-88da-71f916942466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:14.977020 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf4ea2-2220-4d1b-88da-71f916942466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:14.977328 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf4ea2-2220-4d1b-88da-71f916942466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:14.977604 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf4ea2-2220-4d1b-88da-71f916942466 admin admin] PATH_INFO: `/v3/projects/3472a8a1e7e149a8892dae8869a5544e` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:14.984984 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf4ea2-2220-4d1b-88da-71f916942466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3472a8a1e7e149a8892dae8869a5544e)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:14.997459 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf4ea2-2220-4d1b-88da-71f916942466 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:15.153338 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-90cf4ea2-2220-4d1b-88da-71f916942466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3472a8a1e7e149a8892dae8869a5544e', 'request_id': 'req-90cf4ea2-2220-4d1b-88da-71f916942466'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:15.174968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-90cf4ea2-2220-4d1b-88da-71f916942466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3472a8a1e7e149a8892dae8869a5544e', 'request_id': 'req-90cf4ea2-2220-4d1b-88da-71f916942466'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:15.197749 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-90cf4ea2-2220-4d1b-88da-71f916942466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3472a8a1e7e149a8892dae8869a5544e', 'request_id': 'req-90cf4ea2-2220-4d1b-88da-71f916942466'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:15.230795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-90cf4ea2-2220-4d1b-88da-71f916942466 admin admin] The token cache is being invalidate because project 3472a8a1e7e149a8892dae8869a5544e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:15.232842 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-90cf4ea2-2220-4d1b-88da-71f916942466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:15.234591 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-90cf4ea2-2220-4d1b-88da-71f916942466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:15.244686 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 894/1796] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:14 2022] DELETE /identity/v3/projects/3472a8a1e7e149a8892dae8869a5544e => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:15.245443 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385933f-1d6a-4d97-87e0-c752e3ee5661 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:15.260770 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385933f-1d6a-4d97-87e0-c752e3ee5661 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:15.278225 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:15.491667 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca40802-b78c-49a6-83e2-1e9a5b6acadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:15.492935 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca40802-b78c-49a6-83e2-1e9a5b6acadc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:15.493376 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca40802-b78c-49a6-83e2-1e9a5b6acadc admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:15.493659 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca40802-b78c-49a6-83e2-1e9a5b6acadc admin admin] PATH_INFO: `/v3/users/558aa93c1ea24b9baf5f48b4a49f361c` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:15.496992 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca40802-b78c-49a6-83e2-1e9a5b6acadc admin admin] RBAC: Authorizing `identity:delete_user(user_id=558aa93c1ea24b9baf5f48b4a49f361c)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:15.504962 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca40802-b78c-49a6-83e2-1e9a5b6acadc admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:15.691280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3ca40802-b78c-49a6-83e2-1e9a5b6acadc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '558aa93c1ea24b9baf5f48b4a49f361c'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:15.759863 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3ca40802-b78c-49a6-83e2-1e9a5b6acadc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '558aa93c1ea24b9baf5f48b4a49f361c'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:15.839555 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3ca40802-b78c-49a6-83e2-1e9a5b6acadc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '558aa93c1ea24b9baf5f48b4a49f361c'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:15.848370 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3ca40802-b78c-49a6-83e2-1e9a5b6acadc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '558aa93c1ea24b9baf5f48b4a49f361c'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:15.854868 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3ca40802-b78c-49a6-83e2-1e9a5b6acadc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '558aa93c1ea24b9baf5f48b4a49f361c'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:15.914482 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 903/1797] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:15 2022] DELETE /identity/v3/users/558aa93c1ea24b9baf5f48b4a49f361c => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:05:17.666039 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf4ea2-2220-4d1b-88da-71f916942466 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:17.668030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-90cf4ea2-2220-4d1b-88da-71f916942466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:17.697238 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf4ea2-2220-4d1b-88da-71f916942466 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:18.004036 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86fbbe-a3db-4496-b596-2e6a71871e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:18.005357 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86fbbe-a3db-4496-b596-2e6a71871e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:18.005728 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86fbbe-a3db-4496-b596-2e6a71871e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:18.007293 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86fbbe-a3db-4496-b596-2e6a71871e3b admin admin] PATH_INFO: `/v3/projects/b10cc58ea21b4c1c94a1490d8ab58f9f` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:18.009742 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86fbbe-a3db-4496-b596-2e6a71871e3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b10cc58ea21b4c1c94a1490d8ab58f9f)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:18.012597 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86fbbe-a3db-4496-b596-2e6a71871e3b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:18.051930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ff018-9ac4-437a-86e3-3527d6edb3e1 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:18.053594 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ff018-9ac4-437a-86e3-3527d6edb3e1 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:18.053594 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ff018-9ac4-437a-86e3-3527d6edb3e1 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:18.054728 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 904/1798] 10.222.0.20 () {54 vars in 921 bytes} [Wed Sep 14 01:05:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 01:05:18.166134 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8f86fbbe-a3db-4496-b596-2e6a71871e3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b10cc58ea21b4c1c94a1490d8ab58f9f', 'request_id': 'req-8f86fbbe-a3db-4496-b596-2e6a71871e3b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:18.188058 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8f86fbbe-a3db-4496-b596-2e6a71871e3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b10cc58ea21b4c1c94a1490d8ab58f9f', 'request_id': 'req-8f86fbbe-a3db-4496-b596-2e6a71871e3b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:18.199467 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:18.235716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8f86fbbe-a3db-4496-b596-2e6a71871e3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b10cc58ea21b4c1c94a1490d8ab58f9f', 'request_id': 'req-8f86fbbe-a3db-4496-b596-2e6a71871e3b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:18.293372 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8f86fbbe-a3db-4496-b596-2e6a71871e3b admin admin] The token cache is being invalidate because project b10cc58ea21b4c1c94a1490d8ab58f9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:18.293372 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8f86fbbe-a3db-4496-b596-2e6a71871e3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:18.293372 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8f86fbbe-a3db-4496-b596-2e6a71871e3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:18.308523 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 895/1799] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:17 2022] DELETE /identity/v3/projects/b10cc58ea21b4c1c94a1490d8ab58f9f => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:18.314183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78864f00-6de6-45fd-9335-4f58ea453082 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:18.314528 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78864f00-6de6-45fd-9335-4f58ea453082 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:18.314811 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78864f00-6de6-45fd-9335-4f58ea453082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:18.333554 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defc788-e4cf-4bb7-8c25-76a3db251da8 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:18.334053 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defc788-e4cf-4bb7-8c25-76a3db251da8 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:18.334341 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defc788-e4cf-4bb7-8c25-76a3db251da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:18.427011 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-78864f00-6de6-45fd-9335-4f58ea453082 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:18.428706 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-6defc788-e4cf-4bb7-8c25-76a3db251da8 None None] MFA Rules not processed for user `c05caac9e8b9498583780306887734be`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:18.430977 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-78864f00-6de6-45fd-9335-4f58ea453082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:18.434240 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6defc788-e4cf-4bb7-8c25-76a3db251da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:18.612383 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 905/1800] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:18.613856 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78864f00-6de6-45fd-9335-4f58ea453082 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:18.615586 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-78864f00-6de6-45fd-9335-4f58ea453082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:18.645678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78864f00-6de6-45fd-9335-4f58ea453082 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:18.660435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959b6ac-d47b-4979-920f-00dabe9bf732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:18.661952 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959b6ac-d47b-4979-920f-00dabe9bf732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:18.662533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959b6ac-d47b-4979-920f-00dabe9bf732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:18.663298 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959b6ac-d47b-4979-920f-00dabe9bf732 admin admin] PATH_INFO: `/v3/projects/4f4f1a4aad284cb68a8a874a969e030f` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:18.665120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959b6ac-d47b-4979-920f-00dabe9bf732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f4f1a4aad284cb68a8a874a969e030f)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:18.669158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959b6ac-d47b-4979-920f-00dabe9bf732 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:18.821886 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 896/1801] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Sep 14 01:05:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 490 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:18.828476 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1092b1-bae9-423b-9abe-9f9287a7b268 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:18.828792 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1092b1-bae9-423b-9abe-9f9287a7b268 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:18.836988 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1092b1-bae9-423b-9abe-9f9287a7b268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:18.843738 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:18.949445 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-5e1092b1-bae9-423b-9abe-9f9287a7b268 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:18.951352 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5e1092b1-bae9-423b-9abe-9f9287a7b268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:19.012179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5959b6ac-d47b-4979-920f-00dabe9bf732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f4f1a4aad284cb68a8a874a969e030f', 'request_id': 'req-5959b6ac-d47b-4979-920f-00dabe9bf732'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:19.048973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5959b6ac-d47b-4979-920f-00dabe9bf732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f4f1a4aad284cb68a8a874a969e030f', 'request_id': 'req-5959b6ac-d47b-4979-920f-00dabe9bf732'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:19.087237 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5959b6ac-d47b-4979-920f-00dabe9bf732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f4f1a4aad284cb68a8a874a969e030f', 'request_id': 'req-5959b6ac-d47b-4979-920f-00dabe9bf732'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:19.104996 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5959b6ac-d47b-4979-920f-00dabe9bf732 admin admin] The token cache is being invalidate because project 4f4f1a4aad284cb68a8a874a969e030f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:19.105458 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5959b6ac-d47b-4979-920f-00dabe9bf732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:19.108143 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5959b6ac-d47b-4979-920f-00dabe9bf732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:19.112969 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 906/1802] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:18 2022] DELETE /identity/v3/projects/4f4f1a4aad284cb68a8a874a969e030f => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:19.117281 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959b6ac-d47b-4979-920f-00dabe9bf732 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:19.119233 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5959b6ac-d47b-4979-920f-00dabe9bf732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:19.208823 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 897/1803] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:19.214018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1092b1-bae9-423b-9abe-9f9287a7b268 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:19.234265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1092b1-bae9-423b-9abe-9f9287a7b268 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:19.253890 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef73c9-3fde-4f56-b44e-7c3361fbcf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:19.254472 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef73c9-3fde-4f56-b44e-7c3361fbcf8c admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:19.254748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef73c9-3fde-4f56-b44e-7c3361fbcf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:19.255051 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef73c9-3fde-4f56-b44e-7c3361fbcf8c admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:19.255753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef73c9-3fde-4f56-b44e-7c3361fbcf8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:05:19.256059 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef73c9-3fde-4f56-b44e-7c3361fbcf8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:19.264284 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef73c9-3fde-4f56-b44e-7c3361fbcf8c admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:19.309986 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 898/1804] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 01:05:19.311160 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef73c9-3fde-4f56-b44e-7c3361fbcf8c admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:19.348856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef73c9-3fde-4f56-b44e-7c3361fbcf8c admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:19.376598 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7729a04-9bec-4da1-bc9a-36f552af64e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:19.378019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7729a04-9bec-4da1-bc9a-36f552af64e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:19.378019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7729a04-9bec-4da1-bc9a-36f552af64e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:19.378232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7729a04-9bec-4da1-bc9a-36f552af64e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:19.378704 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7729a04-9bec-4da1-bc9a-36f552af64e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:19.380598 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7729a04-9bec-4da1-bc9a-36f552af64e6 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:19.400699 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959b6ac-d47b-4979-920f-00dabe9bf732 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:19.419554 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7fe20a-12d9-46d5-af2e-f39760e6c0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:19.422692 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fe20a-12d9-46d5-af2e-f39760e6c0d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:19.423022 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fe20a-12d9-46d5-af2e-f39760e6c0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:19.423295 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fe20a-12d9-46d5-af2e-f39760e6c0d5 admin admin] PATH_INFO: `/v3/users/05db63b023b34ab4aed724cbcc785cc6` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:19.443203 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fe20a-12d9-46d5-af2e-f39760e6c0d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05db63b023b34ab4aed724cbcc785cc6)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:19.455881 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fe20a-12d9-46d5-af2e-f39760e6c0d5 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:19.499044 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 899/1805] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:19 2022] POST /identity/v3/projects => generated 381 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:19.504212 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7729a04-9bec-4da1-bc9a-36f552af64e6 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:19.624550 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6d7fe20a-12d9-46d5-af2e-f39760e6c0d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05db63b023b34ab4aed724cbcc785cc6'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:19.646858 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6d7fe20a-12d9-46d5-af2e-f39760e6c0d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05db63b023b34ab4aed724cbcc785cc6'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:19.652034 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:19.692434 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6d7fe20a-12d9-46d5-af2e-f39760e6c0d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05db63b023b34ab4aed724cbcc785cc6'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:19.693189 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6d7fe20a-12d9-46d5-af2e-f39760e6c0d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05db63b023b34ab4aed724cbcc785cc6'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:19.693848 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6d7fe20a-12d9-46d5-af2e-f39760e6c0d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05db63b023b34ab4aed724cbcc785cc6'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:19.718753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 907/1806] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:19 2022] DELETE /identity/v3/users/05db63b023b34ab4aed724cbcc785cc6 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:19.721416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7fe20a-12d9-46d5-af2e-f39760e6c0d5 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:19.727710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6d7fe20a-12d9-46d5-af2e-f39760e6c0d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:19.731322 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7729a04-9bec-4da1-bc9a-36f552af64e6 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:19.815552 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:19.897857 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7fe20a-12d9-46d5-af2e-f39760e6c0d5 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:19.910185 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e363d57-6277-4832-b906-a1deeb44fd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:19.913350 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e363d57-6277-4832-b906-a1deeb44fd36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:19.913896 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e363d57-6277-4832-b906-a1deeb44fd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:19.914374 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e363d57-6277-4832-b906-a1deeb44fd36 admin admin] PATH_INFO: `/v3/projects/4f4994e542504ef6ac6fac7999d9c3b8` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:19.918636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e363d57-6277-4832-b906-a1deeb44fd36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f4994e542504ef6ac6fac7999d9c3b8)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:19.923951 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e363d57-6277-4832-b906-a1deeb44fd36 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:19.925701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f44286-4a14-42b4-976c-908d48d7fd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:19.926409 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f44286-4a14-42b4-976c-908d48d7fd15 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:19.926687 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f44286-4a14-42b4-976c-908d48d7fd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:19.926953 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f44286-4a14-42b4-976c-908d48d7fd15 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:19.927659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f44286-4a14-42b4-976c-908d48d7fd15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:19.929640 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f44286-4a14-42b4-976c-908d48d7fd15 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:19.971381 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 900/1807] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:19 2022] POST /identity/v3/users => generated 291 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:19.971381 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f44286-4a14-42b4-976c-908d48d7fd15 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:19.974874 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c0f44286-4a14-42b4-976c-908d48d7fd15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:20.090309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1e363d57-6277-4832-b906-a1deeb44fd36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f4994e542504ef6ac6fac7999d9c3b8', 'request_id': 'req-1e363d57-6277-4832-b906-a1deeb44fd36'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:20.119222 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1e363d57-6277-4832-b906-a1deeb44fd36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f4994e542504ef6ac6fac7999d9c3b8', 'request_id': 'req-1e363d57-6277-4832-b906-a1deeb44fd36'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:20.134753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1e363d57-6277-4832-b906-a1deeb44fd36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f4994e542504ef6ac6fac7999d9c3b8', 'request_id': 'req-1e363d57-6277-4832-b906-a1deeb44fd36'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:20.148324 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f44286-4a14-42b4-976c-908d48d7fd15 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:20.171818 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1e363d57-6277-4832-b906-a1deeb44fd36 admin admin] The token cache is being invalidate because project 4f4994e542504ef6ac6fac7999d9c3b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:20.172171 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1e363d57-6277-4832-b906-a1deeb44fd36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:20.177665 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1e363d57-6277-4832-b906-a1deeb44fd36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:20.191591 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 908/1808] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:19 2022] DELETE /identity/v3/projects/4f4994e542504ef6ac6fac7999d9c3b8 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:20.191591 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e363d57-6277-4832-b906-a1deeb44fd36 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:20.192450 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1e363d57-6277-4832-b906-a1deeb44fd36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:20.373231 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce7e86-8a54-416f-a1e0-39050585514f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:20.373851 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce7e86-8a54-416f-a1e0-39050585514f service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:20.374370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce7e86-8a54-416f-a1e0-39050585514f service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:20.374682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce7e86-8a54-416f-a1e0-39050585514f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:20.382483 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-68ce7e86-8a54-416f-a1e0-39050585514f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:20.427133 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce7e86-8a54-416f-a1e0-39050585514f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:20.428958 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce7e86-8a54-416f-a1e0-39050585514f service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:20.429758 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e363d57-6277-4832-b906-a1deeb44fd36 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:20.437957 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2962608-8bf0-4deb-b246-cb797d687ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:20.439517 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2962608-8bf0-4deb-b246-cb797d687ffb admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:20.440118 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2962608-8bf0-4deb-b246-cb797d687ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:20.440628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2962608-8bf0-4deb-b246-cb797d687ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:20.443609 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2962608-8bf0-4deb-b246-cb797d687ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:20.447182 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2962608-8bf0-4deb-b246-cb797d687ffb admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:20.456587 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 901/1809] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:20.459623 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaab493-52d0-4cff-88bd-ebd46454a5c2 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:20.459953 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaab493-52d0-4cff-88bd-ebd46454a5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:20.460206 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaab493-52d0-4cff-88bd-ebd46454a5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:20.470162 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 909/1810] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:20.475970 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2962608-8bf0-4deb-b246-cb797d687ffb admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:20.485020 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:20.515345 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2962608-8bf0-4deb-b246-cb797d687ffb admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:20.515802 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-afaab493-52d0-4cff-88bd-ebd46454a5c2 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:20.517210 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-afaab493-52d0-4cff-88bd-ebd46454a5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:20.533706 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 902/1811] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:20.541881 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d117d7-dbca-4987-96af-d20f5d267ecd None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:20.542181 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d117d7-dbca-4987-96af-d20f5d267ecd None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:20.542417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d117d7-dbca-4987-96af-d20f5d267ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:20.548432 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2a24c-068c-4471-8458-62115bf2bdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:20.549134 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2a24c-068c-4471-8458-62115bf2bdd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:20.549422 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2a24c-068c-4471-8458-62115bf2bdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:20.549700 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2a24c-068c-4471-8458-62115bf2bdd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:20.556232 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2a24c-068c-4471-8458-62115bf2bdd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:20.577771 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2a24c-068c-4471-8458-62115bf2bdd4 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:20.601336 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-68d117d7-dbca-4987-96af-d20f5d267ecd None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:20.602688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-68d117d7-dbca-4987-96af-d20f5d267ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:20.613786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 910/1812] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:20.628239 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 903/1813] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:05:20.629058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2a24c-068c-4471-8458-62115bf2bdd4 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:20.632369 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d117d7-dbca-4987-96af-d20f5d267ecd None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:20.653819 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d117d7-dbca-4987-96af-d20f5d267ecd None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:20.661353 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2a24c-068c-4471-8458-62115bf2bdd4 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:20.668946 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0c960-dd36-4f29-b0bd-a3ca3bb66587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:20.669592 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0c960-dd36-4f29-b0bd-a3ca3bb66587 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:20.669916 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0c960-dd36-4f29-b0bd-a3ca3bb66587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:20.670189 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0c960-dd36-4f29-b0bd-a3ca3bb66587 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:20.672299 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0c960-dd36-4f29-b0bd-a3ca3bb66587 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:05:20.674210 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0c960-dd36-4f29-b0bd-a3ca3bb66587 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:20.675977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0c960-dd36-4f29-b0bd-a3ca3bb66587 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:20.697371 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 904/1814] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:05:20.701703 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0c960-dd36-4f29-b0bd-a3ca3bb66587 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:20.706475 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8daf69-11fb-4bf2-9763-1e0ea3c807e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:20.707409 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8daf69-11fb-4bf2-9763-1e0ea3c807e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:20.707843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8daf69-11fb-4bf2-9763-1e0ea3c807e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:20.708318 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8daf69-11fb-4bf2-9763-1e0ea3c807e5 admin admin] PATH_INFO: `/v3/projects/47dbf262bd4647de8e7657fddb5525f7/users/4472c5c49e47449c8f71eb8cc3b83726/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:20.716038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0c960-dd36-4f29-b0bd-a3ca3bb66587 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:20.728731 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c564206-8cbc-4bf1-9a32-42e4c6cef542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:20.730629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c564206-8cbc-4bf1-9a32-42e4c6cef542 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:20.732438 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c564206-8cbc-4bf1-9a32-42e4c6cef542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:20.732926 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c564206-8cbc-4bf1-9a32-42e4c6cef542 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:20.736355 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c564206-8cbc-4bf1-9a32-42e4c6cef542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:20.741826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c564206-8cbc-4bf1-9a32-42e4c6cef542 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:20.760068 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8daf69-11fb-4bf2-9763-1e0ea3c807e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47dbf262bd4647de8e7657fddb5525f7, user_id=4472c5c49e47449c8f71eb8cc3b83726, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:20.764618 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8daf69-11fb-4bf2-9763-1e0ea3c807e5 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:20.824476 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 911/1815] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:20 2022] PUT /identity/v3/projects/47dbf262bd4647de8e7657fddb5525f7/users/4472c5c49e47449c8f71eb8cc3b83726/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:20.827569 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8daf69-11fb-4bf2-9763-1e0ea3c807e5 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:20.834503 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-9b8daf69-11fb-4bf2-9763-1e0ea3c807e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:20.841965 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 905/1816] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:20 2022] POST /identity/v3/projects => generated 367 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:20.848034 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f69053-9f03-48cb-87f6-00b7b8b81771 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:20.848821 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f69053-9f03-48cb-87f6-00b7b8b81771 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:20.850954 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f69053-9f03-48cb-87f6-00b7b8b81771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:20.911740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:20.940242 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-62f69053-9f03-48cb-87f6-00b7b8b81771 None None] MFA Rules not processed for user `4472c5c49e47449c8f71eb8cc3b83726`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:20.941446 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-62f69053-9f03-48cb-87f6-00b7b8b81771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:21.048622 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8daf69-11fb-4bf2-9763-1e0ea3c807e5 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:21.103352 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 906/1817] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:21.103352 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f69053-9f03-48cb-87f6-00b7b8b81771 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:21.205541 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62ec1c-82d6-4ea9-9b60-91b5fe8dc97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:21.207286 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62ec1c-82d6-4ea9-9b60-91b5fe8dc97d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:21.207765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62ec1c-82d6-4ea9-9b60-91b5fe8dc97d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:21.208225 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62ec1c-82d6-4ea9-9b60-91b5fe8dc97d admin admin] PATH_INFO: `/v3/projects/96a80e36a80e4a10988bd4dfd01b0f4f` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:21.211818 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62ec1c-82d6-4ea9-9b60-91b5fe8dc97d admin admin] RBAC: Authorizing `identity:delete_project(project_id=96a80e36a80e4a10988bd4dfd01b0f4f)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:21.214055 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62ec1c-82d6-4ea9-9b60-91b5fe8dc97d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:21.309758 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f69053-9f03-48cb-87f6-00b7b8b81771 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:21.323503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a8b93-a502-42b5-85a5-69a20181fa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:21.331057 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a8b93-a502-42b5-85a5-69a20181fa82 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:21.333871 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a8b93-a502-42b5-85a5-69a20181fa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:21.334221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a8b93-a502-42b5-85a5-69a20181fa82 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:21.334913 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a8b93-a502-42b5-85a5-69a20181fa82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:21.344535 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a8b93-a502-42b5-85a5-69a20181fa82 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:21.368730 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7a62ec1c-82d6-4ea9-9b60-91b5fe8dc97d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96a80e36a80e4a10988bd4dfd01b0f4f', 'request_id': 'req-7a62ec1c-82d6-4ea9-9b60-91b5fe8dc97d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:21.392875 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7a62ec1c-82d6-4ea9-9b60-91b5fe8dc97d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96a80e36a80e4a10988bd4dfd01b0f4f', 'request_id': 'req-7a62ec1c-82d6-4ea9-9b60-91b5fe8dc97d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:21.413977 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7a62ec1c-82d6-4ea9-9b60-91b5fe8dc97d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96a80e36a80e4a10988bd4dfd01b0f4f', 'request_id': 'req-7a62ec1c-82d6-4ea9-9b60-91b5fe8dc97d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:21.438839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 907/1818] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:21 2022] POST /identity/v3/users => generated 284 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:21.448637 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a8b93-a502-42b5-85a5-69a20181fa82 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:21.462906 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a8b93-a502-42b5-85a5-69a20181fa82 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:21.477774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7a62ec1c-82d6-4ea9-9b60-91b5fe8dc97d admin admin] The token cache is being invalidate because project 96a80e36a80e4a10988bd4dfd01b0f4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:21.481528 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7a62ec1c-82d6-4ea9-9b60-91b5fe8dc97d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:21.485907 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7a62ec1c-82d6-4ea9-9b60-91b5fe8dc97d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:21.490890 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 912/1819] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:20 2022] DELETE /identity/v3/projects/96a80e36a80e4a10988bd4dfd01b0f4f => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:21.504471 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62ec1c-82d6-4ea9-9b60-91b5fe8dc97d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:21.512372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7a62ec1c-82d6-4ea9-9b60-91b5fe8dc97d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:21.628986 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:21.747040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e55fb-23e6-47da-ab1d-9e7e7faf53e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:21.747754 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e55fb-23e6-47da-ab1d-9e7e7faf53e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:21.747916 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e55fb-23e6-47da-ab1d-9e7e7faf53e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:21.748374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e55fb-23e6-47da-ab1d-9e7e7faf53e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:21.749012 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e55fb-23e6-47da-ab1d-9e7e7faf53e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:21.761852 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e55fb-23e6-47da-ab1d-9e7e7faf53e0 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:21.802880 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:21.808997 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62ec1c-82d6-4ea9-9b60-91b5fe8dc97d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:21.834018 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950a98a-1d8d-404e-90cf-4f1ed0e3c3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:21.834018 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950a98a-1d8d-404e-90cf-4f1ed0e3c3de admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:21.834018 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950a98a-1d8d-404e-90cf-4f1ed0e3c3de admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:21.834018 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950a98a-1d8d-404e-90cf-4f1ed0e3c3de admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:21.834429 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950a98a-1d8d-404e-90cf-4f1ed0e3c3de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:21.834429 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950a98a-1d8d-404e-90cf-4f1ed0e3c3de admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:21.844134 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 908/1820] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:21 2022] POST /identity/v3/projects => generated 381 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:21.844134 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfac7f-d2e4-4276-9b46-9ce962a2062e None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:21.844134 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfac7f-d2e4-4276-9b46-9ce962a2062e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:21.844134 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfac7f-d2e4-4276-9b46-9ce962a2062e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:21.864167 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 913/1821] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:21.864167 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950a98a-1d8d-404e-90cf-4f1ed0e3c3de admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:21.870128 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a950a98a-1d8d-404e-90cf-4f1ed0e3c3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:21.887226 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-fdcfac7f-d2e4-4276-9b46-9ce962a2062e None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:21.888434 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fdcfac7f-d2e4-4276-9b46-9ce962a2062e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:21.908460 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950a98a-1d8d-404e-90cf-4f1ed0e3c3de admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:22.056305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 909/1822] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:22.056305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfac7f-d2e4-4276-9b46-9ce962a2062e None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:22.061057 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfac7f-d2e4-4276-9b46-9ce962a2062e None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:22.067329 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b1984-7b2e-4afa-9acc-9f03396ca71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:22.068018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b1984-7b2e-4afa-9acc-9f03396ca71b admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:22.068298 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b1984-7b2e-4afa-9acc-9f03396ca71b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:22.068646 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b1984-7b2e-4afa-9acc-9f03396ca71b admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:22.069449 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b1984-7b2e-4afa-9acc-9f03396ca71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:22.071123 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b1984-7b2e-4afa-9acc-9f03396ca71b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:22.088895 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc614b-518c-4135-b88c-7cca94058c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:22.089700 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc614b-518c-4135-b88c-7cca94058c6f admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:22.090208 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc614b-518c-4135-b88c-7cca94058c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:22.090521 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc614b-518c-4135-b88c-7cca94058c6f admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:22.091404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc614b-518c-4135-b88c-7cca94058c6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:22.093951 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc614b-518c-4135-b88c-7cca94058c6f admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:22.112775 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 910/1823] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:22.113668 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b1984-7b2e-4afa-9acc-9f03396ca71b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:22.118503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5f8b1984-7b2e-4afa-9acc-9f03396ca71b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:22.137507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 914/1824] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:21 2022] POST /identity/v3/users => generated 297 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:22.139544 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caec857-97c2-435c-b1f9-1c84ff95cf2d None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:22.139909 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caec857-97c2-435c-b1f9-1c84ff95cf2d None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:22.140169 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caec857-97c2-435c-b1f9-1c84ff95cf2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:22.167444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b1984-7b2e-4afa-9acc-9f03396ca71b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:22.174215 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe7cf6-4d51-45b7-8a76-0fd659f46561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:22.175055 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe7cf6-4d51-45b7-8a76-0fd659f46561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:22.175331 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe7cf6-4d51-45b7-8a76-0fd659f46561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:22.175816 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe7cf6-4d51-45b7-8a76-0fd659f46561 admin admin] PATH_INFO: `/v3/users/17148c16add84a2b870f6ce086805614` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:22.177060 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe7cf6-4d51-45b7-8a76-0fd659f46561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17148c16add84a2b870f6ce086805614)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:22.179228 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe7cf6-4d51-45b7-8a76-0fd659f46561 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:22.180412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-6caec857-97c2-435c-b1f9-1c84ff95cf2d None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:22.182128 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6caec857-97c2-435c-b1f9-1c84ff95cf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:22.194313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 915/1825] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:22.195978 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caec857-97c2-435c-b1f9-1c84ff95cf2d None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:22.209353 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caec857-97c2-435c-b1f9-1c84ff95cf2d None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:22.230500 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3076616-f51a-4b0d-83b3-3a1c642d86f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:22.231606 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3076616-f51a-4b0d-83b3-3a1c642d86f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:22.231799 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3076616-f51a-4b0d-83b3-3a1c642d86f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:22.232076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3076616-f51a-4b0d-83b3-3a1c642d86f4 admin admin] PATH_INFO: `/v3/projects/20b27185622c4df7906bd71d04f17526/users/f7a4e80fcc0045d7abe7947219fcafe0/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:22.277070 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d3fe7cf6-4d51-45b7-8a76-0fd659f46561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17148c16add84a2b870f6ce086805614'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:22.278444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d3fe7cf6-4d51-45b7-8a76-0fd659f46561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17148c16add84a2b870f6ce086805614'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:22.285633 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3076616-f51a-4b0d-83b3-3a1c642d86f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b27185622c4df7906bd71d04f17526, user_id=f7a4e80fcc0045d7abe7947219fcafe0, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:22.289715 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3076616-f51a-4b0d-83b3-3a1c642d86f4 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:22.300279 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d3fe7cf6-4d51-45b7-8a76-0fd659f46561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17148c16add84a2b870f6ce086805614'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:22.311662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 916/1826] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:22 2022] PUT /identity/v3/projects/20b27185622c4df7906bd71d04f17526/users/f7a4e80fcc0045d7abe7947219fcafe0/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:22.313156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3076616-f51a-4b0d-83b3-3a1c642d86f4 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:22.315933 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a3076616-f51a-4b0d-83b3-3a1c642d86f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:22.349026 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d3fe7cf6-4d51-45b7-8a76-0fd659f46561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17148c16add84a2b870f6ce086805614'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:22.351596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d3fe7cf6-4d51-45b7-8a76-0fd659f46561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17148c16add84a2b870f6ce086805614'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:22.384041 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 911/1827] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:22 2022] DELETE /identity/v3/users/17148c16add84a2b870f6ce086805614 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:22.384783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe7cf6-4d51-45b7-8a76-0fd659f46561 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:22.388729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d3fe7cf6-4d51-45b7-8a76-0fd659f46561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:22.450933 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:22.514079 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe7cf6-4d51-45b7-8a76-0fd659f46561 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:22.516464 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3076616-f51a-4b0d-83b3-3a1c642d86f4 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:22.519910 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ce762-3533-40d0-8d90-92e60c4276b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:22.520535 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ce762-3533-40d0-8d90-92e60c4276b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:22.520987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ce762-3533-40d0-8d90-92e60c4276b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:22.521263 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ce762-3533-40d0-8d90-92e60c4276b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:22.521945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ce762-3533-40d0-8d90-92e60c4276b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:05:22.522246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ce762-3533-40d0-8d90-92e60c4276b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:22.523186 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387491b6-f605-4ad4-b4dd-122b1943bae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:22.523883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387491b6-f605-4ad4-b4dd-122b1943bae1 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:22.523989 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ce762-3533-40d0-8d90-92e60c4276b9 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:22.524256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387491b6-f605-4ad4-b4dd-122b1943bae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:22.524597 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387491b6-f605-4ad4-b4dd-122b1943bae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:22.525338 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387491b6-f605-4ad4-b4dd-122b1943bae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:22.528564 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387491b6-f605-4ad4-b4dd-122b1943bae1 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:22.547034 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 912/1828] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:05:22.547034 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08b1d1-48ff-47c4-b2bd-b1fe9935ebaa None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:22.547351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 917/1829] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:22.547441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08b1d1-48ff-47c4-b2bd-b1fe9935ebaa None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:22.547441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08b1d1-48ff-47c4-b2bd-b1fe9935ebaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:22.548784 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322662e-37f4-4ed0-9847-2a988fa51044 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:22.549258 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322662e-37f4-4ed0-9847-2a988fa51044 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:22.549568 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322662e-37f4-4ed0-9847-2a988fa51044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:22.580510 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-5322662e-37f4-4ed0-9847-2a988fa51044 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:22.583624 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5322662e-37f4-4ed0-9847-2a988fa51044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:22.595555 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 918/1830] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:22.596431 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322662e-37f4-4ed0-9847-2a988fa51044 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:22.600333 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-8f08b1d1-48ff-47c4-b2bd-b1fe9935ebaa None None] MFA Rules not processed for user `f7a4e80fcc0045d7abe7947219fcafe0`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:22.601752 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8f08b1d1-48ff-47c4-b2bd-b1fe9935ebaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:22.607915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322662e-37f4-4ed0-9847-2a988fa51044 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:22.614042 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db7b96-16a8-4b26-82f9-4a9162f56491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:22.614854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db7b96-16a8-4b26-82f9-4a9162f56491 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:22.615199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db7b96-16a8-4b26-82f9-4a9162f56491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:22.616286 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db7b96-16a8-4b26-82f9-4a9162f56491 admin admin] PATH_INFO: `/v3/projects/0f6478f30db14189940c15b17b6ecc9b/users/7e73835522d2402b93387591a33210eb/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:22.636928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db7b96-16a8-4b26-82f9-4a9162f56491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f6478f30db14189940c15b17b6ecc9b, user_id=7e73835522d2402b93387591a33210eb, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:22.639817 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db7b96-16a8-4b26-82f9-4a9162f56491 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:22.662804 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 919/1831] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:22 2022] PUT /identity/v3/projects/0f6478f30db14189940c15b17b6ecc9b/users/7e73835522d2402b93387591a33210eb/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:22.664686 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db7b96-16a8-4b26-82f9-4a9162f56491 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:22.688227 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:22.734405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 913/1832] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:22.737450 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08b1d1-48ff-47c4-b2bd-b1fe9935ebaa None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:22.763730 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08b1d1-48ff-47c4-b2bd-b1fe9935ebaa None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:22.808595 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db7b96-16a8-4b26-82f9-4a9162f56491 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:22.832050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de7bab-dd35-4f7b-be29-4d6c79948959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:22.833180 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de7bab-dd35-4f7b-be29-4d6c79948959 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:22.835086 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de7bab-dd35-4f7b-be29-4d6c79948959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:22.835636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de7bab-dd35-4f7b-be29-4d6c79948959 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:22.839484 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de7bab-dd35-4f7b-be29-4d6c79948959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:22.842061 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de7bab-dd35-4f7b-be29-4d6c79948959 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:22.880949 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 920/1833] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:22 2022] POST /identity/v3/projects => generated 387 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:22.882145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de7bab-dd35-4f7b-be29-4d6c79948959 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:22.884037 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-96de7bab-dd35-4f7b-be29-4d6c79948959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:22.887528 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d7b56-30ee-4f4d-a4d6-54be7fcfdb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:22.888148 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d7b56-30ee-4f4d-a4d6-54be7fcfdb08 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:22.888428 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d7b56-30ee-4f4d-a4d6-54be7fcfdb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:22.888704 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d7b56-30ee-4f4d-a4d6-54be7fcfdb08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:22.889506 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d7b56-30ee-4f4d-a4d6-54be7fcfdb08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:22.891996 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d7b56-30ee-4f4d-a4d6-54be7fcfdb08 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:22.909654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 914/1834] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:22.911299 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d7b56-30ee-4f4d-a4d6-54be7fcfdb08 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:22.913284 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-799d7b56-30ee-4f4d-a4d6-54be7fcfdb08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:22.974212 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de7bab-dd35-4f7b-be29-4d6c79948959 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:22.979456 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf9261-e2aa-4cdc-bd33-8efc849f6cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:22.980072 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf9261-e2aa-4cdc-bd33-8efc849f6cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:22.980425 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf9261-e2aa-4cdc-bd33-8efc849f6cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:22.980818 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf9261-e2aa-4cdc-bd33-8efc849f6cf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:22.981472 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf9261-e2aa-4cdc-bd33-8efc849f6cf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:22.983521 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf9261-e2aa-4cdc-bd33-8efc849f6cf2 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:23.020708 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:23.027896 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 921/1835] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:22 2022] POST /identity/v3/projects => generated 367 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:23.027896 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf9261-e2aa-4cdc-bd33-8efc849f6cf2 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:23.045318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d7b56-30ee-4f4d-a4d6-54be7fcfdb08 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:23.131341 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf9261-e2aa-4cdc-bd33-8efc849f6cf2 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:23.162713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e4309-4d30-4833-afce-c4dd1ef687fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:23.163752 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e4309-4d30-4833-afce-c4dd1ef687fc admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:23.164436 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e4309-4d30-4833-afce-c4dd1ef687fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:23.164863 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e4309-4d30-4833-afce-c4dd1ef687fc admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:23.165878 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e4309-4d30-4833-afce-c4dd1ef687fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:23.169075 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e4309-4d30-4833-afce-c4dd1ef687fc admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:23.182348 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f239bc-ba3f-481c-a731-b0130b4a900d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:23.182898 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f239bc-ba3f-481c-a731-b0130b4a900d service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:23.182991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f239bc-ba3f-481c-a731-b0130b4a900d service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:23.183461 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f239bc-ba3f-481c-a731-b0130b4a900d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:23.203231 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f239bc-ba3f-481c-a731-b0130b4a900d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:23.206831 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f239bc-ba3f-481c-a731-b0130b4a900d service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:23.217556 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 922/1836] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:23 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:23.217556 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e4309-4d30-4833-afce-c4dd1ef687fc admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:23.229707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e4309-4d30-4833-afce-c4dd1ef687fc admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:23.231808 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 915/1837] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:23.233764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f239bc-ba3f-481c-a731-b0130b4a900d service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:23.239621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d1e99-1333-4600-99b3-e8d00dafc1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:23.241060 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d1e99-1333-4600-99b3-e8d00dafc1b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:23.241528 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d1e99-1333-4600-99b3-e8d00dafc1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:23.242221 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d1e99-1333-4600-99b3-e8d00dafc1b4 admin admin] PATH_INFO: `/v3/projects/0f6478f30db14189940c15b17b6ecc9b/users/7e73835522d2402b93387591a33210eb/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:23.244496 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d1e99-1333-4600-99b3-e8d00dafc1b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f6478f30db14189940c15b17b6ecc9b, user_id=7e73835522d2402b93387591a33210eb, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:23.244606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f239bc-ba3f-481c-a731-b0130b4a900d service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:23.256575 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d1e99-1333-4600-99b3-e8d00dafc1b4 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:23.258094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980db791-f2c0-4a63-bd8b-d8f7e28942ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:23.258707 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980db791-f2c0-4a63-bd8b-d8f7e28942ea admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:23.259471 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980db791-f2c0-4a63-bd8b-d8f7e28942ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:23.260072 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980db791-f2c0-4a63-bd8b-d8f7e28942ea admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:23.260655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980db791-f2c0-4a63-bd8b-d8f7e28942ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:23.263005 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980db791-f2c0-4a63-bd8b-d8f7e28942ea admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:23.278663 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 923/1838] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:23 2022] PUT /identity/v3/projects/0f6478f30db14189940c15b17b6ecc9b/users/7e73835522d2402b93387591a33210eb/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:23.279666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d1e99-1333-4600-99b3-e8d00dafc1b4 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:23.290842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:23.307830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 916/1839] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:23 2022] POST /identity/v3/users => generated 290 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:23.309578 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22bb6d-5e26-4a4d-a301-14880596df5c None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:23.309578 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22bb6d-5e26-4a4d-a301-14880596df5c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:23.309791 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22bb6d-5e26-4a4d-a301-14880596df5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:23.347492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-bd22bb6d-5e26-4a4d-a301-14880596df5c None None] MFA Rules not processed for user `7e73835522d2402b93387591a33210eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:23.349117 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-bd22bb6d-5e26-4a4d-a301-14880596df5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:23.367703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d1e99-1333-4600-99b3-e8d00dafc1b4 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:23.373457 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05573c-bf46-4fde-bae8-ab1378f781cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:23.374974 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05573c-bf46-4fde-bae8-ab1378f781cd admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:23.374974 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05573c-bf46-4fde-bae8-ab1378f781cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:23.374974 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05573c-bf46-4fde-bae8-ab1378f781cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:23.375685 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05573c-bf46-4fde-bae8-ab1378f781cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:23.377506 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05573c-bf46-4fde-bae8-ab1378f781cd admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:23.391445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 924/1840] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:23.391445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05573c-bf46-4fde-bae8-ab1378f781cd admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:23.402876 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05573c-bf46-4fde-bae8-ab1378f781cd admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:23.409401 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f109d81-ad35-404e-a2b5-5243e842cdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:23.410179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f109d81-ad35-404e-a2b5-5243e842cdad admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:23.410637 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f109d81-ad35-404e-a2b5-5243e842cdad admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:23.410864 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f109d81-ad35-404e-a2b5-5243e842cdad admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:23.411816 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f109d81-ad35-404e-a2b5-5243e842cdad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:23.413640 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f109d81-ad35-404e-a2b5-5243e842cdad admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:23.427928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 925/1841] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:23.427928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f109d81-ad35-404e-a2b5-5243e842cdad admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:23.436986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f109d81-ad35-404e-a2b5-5243e842cdad admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:23.439616 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 917/1842] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:23.440588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22bb6d-5e26-4a4d-a301-14880596df5c None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:23.447179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4b023-3925-4181-ad10-c25a8a4c3cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:23.448974 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4b023-3925-4181-ad10-c25a8a4c3cac admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:23.448974 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4b023-3925-4181-ad10-c25a8a4c3cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:23.449252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4b023-3925-4181-ad10-c25a8a4c3cac admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:23.449921 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4b023-3925-4181-ad10-c25a8a4c3cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:23.451513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4b023-3925-4181-ad10-c25a8a4c3cac admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:23.451968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22bb6d-5e26-4a4d-a301-14880596df5c None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:23.459572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26d65f-74f3-4a2d-b0ad-e34a17f9e371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:23.460403 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26d65f-74f3-4a2d-b0ad-e34a17f9e371 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:23.460830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26d65f-74f3-4a2d-b0ad-e34a17f9e371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:23.461102 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26d65f-74f3-4a2d-b0ad-e34a17f9e371 admin admin] PATH_INFO: `/v3/projects/e44cc4bd9e154e318ac1de1b290af03c/users/999e14e64c7e4bc49b9378943438ae1a/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:23.465175 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 926/1843] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:23.466768 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4b023-3925-4181-ad10-c25a8a4c3cac admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:23.470541 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-04e4b023-3925-4181-ad10-c25a8a4c3cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:23.482188 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26d65f-74f3-4a2d-b0ad-e34a17f9e371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e44cc4bd9e154e318ac1de1b290af03c, user_id=999e14e64c7e4bc49b9378943438ae1a, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:23.485031 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26d65f-74f3-4a2d-b0ad-e34a17f9e371 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:23.501480 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 918/1844] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:23 2022] PUT /identity/v3/projects/e44cc4bd9e154e318ac1de1b290af03c/users/999e14e64c7e4bc49b9378943438ae1a/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:23.502714 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26d65f-74f3-4a2d-b0ad-e34a17f9e371 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:23.539971 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4b023-3925-4181-ad10-c25a8a4c3cac admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:23.583339 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:23.613101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e462a5a-8544-40ec-8b2b-089d4d54421c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:23.614163 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e462a5a-8544-40ec-8b2b-089d4d54421c service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:23.614664 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e462a5a-8544-40ec-8b2b-089d4d54421c service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:23.615161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e462a5a-8544-40ec-8b2b-089d4d54421c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:23.617370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26d65f-74f3-4a2d-b0ad-e34a17f9e371 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:23.624088 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69434125-4c20-4a89-a9ea-0515ca9ba0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:23.625390 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69434125-4c20-4a89-a9ea-0515ca9ba0f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:23.625678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69434125-4c20-4a89-a9ea-0515ca9ba0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:23.627013 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69434125-4c20-4a89-a9ea-0515ca9ba0f9 admin admin] PATH_INFO: `/v3/projects/3b53a26f2db94f01b040db01a5b5a99c/users/e5ef95cf40ab4b76942beff82c5354a7/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:23.665379 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69434125-4c20-4a89-a9ea-0515ca9ba0f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b53a26f2db94f01b040db01a5b5a99c, user_id=e5ef95cf40ab4b76942beff82c5354a7, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:23.669388 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69434125-4c20-4a89-a9ea-0515ca9ba0f9 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:23.699014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:23.699228 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 919/1845] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:23 2022] PUT /identity/v3/projects/3b53a26f2db94f01b040db01a5b5a99c/users/e5ef95cf40ab4b76942beff82c5354a7/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:23.700796 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69434125-4c20-4a89-a9ea-0515ca9ba0f9 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:23.718224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e462a5a-8544-40ec-8b2b-089d4d54421c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:23.720945 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e462a5a-8544-40ec-8b2b-089d4d54421c service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:23.747350 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 927/1846] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:23.751189 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531671a-0a94-43d6-915c-20201837e7b3 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:23.754168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531671a-0a94-43d6-915c-20201837e7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:23.754892 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531671a-0a94-43d6-915c-20201837e7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:23.810258 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-8531671a-0a94-43d6-915c-20201837e7b3 None None] MFA Rules not processed for user `e5ef95cf40ab4b76942beff82c5354a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:23.811590 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8531671a-0a94-43d6-915c-20201837e7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:23.821540 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69434125-4c20-4a89-a9ea-0515ca9ba0f9 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:23.832186 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbbe3e-5939-4780-85d5-40115abb3954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:23.833020 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbbe3e-5939-4780-85d5-40115abb3954 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:23.833512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbbe3e-5939-4780-85d5-40115abb3954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:23.834437 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbbe3e-5939-4780-85d5-40115abb3954 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:23.840288 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbbe3e-5939-4780-85d5-40115abb3954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:23.841963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbbe3e-5939-4780-85d5-40115abb3954 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:23.862635 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 920/1847] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:23.862635 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75005e-b461-47f0-ae49-696801a9f2a3 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:23.862635 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75005e-b461-47f0-ae49-696801a9f2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:23.862635 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75005e-b461-47f0-ae49-696801a9f2a3 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:23.863039 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 921/1848] 10.222.0.20 () {54 vars in 921 bytes} [Wed Sep 14 01:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 01:05:23.863679 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75005e-b461-47f0-ae49-696801a9f2a3 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:23.906058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 928/1849] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:23.906058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531671a-0a94-43d6-915c-20201837e7b3 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:23.915804 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531671a-0a94-43d6-915c-20201837e7b3 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:23.920830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7552d-988a-445a-a572-16115d198357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:23.921643 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7552d-988a-445a-a572-16115d198357 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:23.922167 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7552d-988a-445a-a572-16115d198357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:23.922603 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7552d-988a-445a-a572-16115d198357 admin admin] PATH_INFO: `/v3/projects/e44cc4bd9e154e318ac1de1b290af03c/users/999e14e64c7e4bc49b9378943438ae1a/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:23.926234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7552d-988a-445a-a572-16115d198357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e44cc4bd9e154e318ac1de1b290af03c, user_id=999e14e64c7e4bc49b9378943438ae1a, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:23.929687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7552d-988a-445a-a572-16115d198357 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:23.935137 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75005e-b461-47f0-ae49-696801a9f2a3 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:23.942700 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 929/1850] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:23 2022] PUT /identity/v3/projects/e44cc4bd9e154e318ac1de1b290af03c/users/999e14e64c7e4bc49b9378943438ae1a/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:23.951256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe47ae-960d-4911-a77f-3cf4cc83e818 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:23.951820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe47ae-960d-4911-a77f-3cf4cc83e818 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:23.952408 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe47ae-960d-4911-a77f-3cf4cc83e818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:23.977986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-1bbe47ae-960d-4911-a77f-3cf4cc83e818 None None] MFA Rules not processed for user `c05caac9e8b9498583780306887734be`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:23.979223 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1bbe47ae-960d-4911-a77f-3cf4cc83e818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:24.004370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d61be-b5d4-4506-91e7-45f63588c42d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:24.004893 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d61be-b5d4-4506-91e7-45f63588c42d service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:24.005177 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d61be-b5d4-4506-91e7-45f63588c42d service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:24.005477 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d61be-b5d4-4506-91e7-45f63588c42d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:24.007643 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-da8d61be-b5d4-4506-91e7-45f63588c42d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:24.057926 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:24.073246 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 930/1851] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Sep 14 01:05:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:24.074026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe47ae-960d-4911-a77f-3cf4cc83e818 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:24.118966 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d61be-b5d4-4506-91e7-45f63588c42d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:24.121223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d61be-b5d4-4506-91e7-45f63588c42d service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:24.136837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 922/1852] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:24.138609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a8e2d-8122-495e-964d-e2883f88452d None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:24.138876 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a8e2d-8122-495e-964d-e2883f88452d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:24.139327 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a8e2d-8122-495e-964d-e2883f88452d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:24.154589 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:24.168826 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe47ae-960d-4911-a77f-3cf4cc83e818 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:24.174206 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622d106-36cb-4f66-ad49-7c03da072351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:24.174822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622d106-36cb-4f66-ad49-7c03da072351 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:24.175103 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622d106-36cb-4f66-ad49-7c03da072351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:24.175377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622d106-36cb-4f66-ad49-7c03da072351 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:24.176014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622d106-36cb-4f66-ad49-7c03da072351 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:24.177973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622d106-36cb-4f66-ad49-7c03da072351 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:24.218375 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-b92a8e2d-8122-495e-964d-e2883f88452d None None] MFA Rules not processed for user `999e14e64c7e4bc49b9378943438ae1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:24.220566 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b92a8e2d-8122-495e-964d-e2883f88452d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:24.221099 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 931/1853] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:24 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:24.222013 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622d106-36cb-4f66-ad49-7c03da072351 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:24.225491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e622d106-36cb-4f66-ad49-7c03da072351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:24.343086 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622d106-36cb-4f66-ad49-7c03da072351 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:24.352275 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643fde1-a757-47d6-8834-995074d9ac2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:24.353048 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643fde1-a757-47d6-8834-995074d9ac2c service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:24.353454 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643fde1-a757-47d6-8834-995074d9ac2c service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:24.353739 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643fde1-a757-47d6-8834-995074d9ac2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:24.373911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 923/1854] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:24.374843 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a8e2d-8122-495e-964d-e2883f88452d None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:24.416541 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643fde1-a757-47d6-8834-995074d9ac2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:24.424728 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643fde1-a757-47d6-8834-995074d9ac2c service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:24.478393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 932/1855] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:24.480895 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07f10c-46b8-4419-b0e9-6f2d5893a9c4 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:24.481080 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07f10c-46b8-4419-b0e9-6f2d5893a9c4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:24.481327 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07f10c-46b8-4419-b0e9-6f2d5893a9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:24.519256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a8e2d-8122-495e-964d-e2883f88452d None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:24.525840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882e7f3-cfb9-4ab1-8570-e38cf10ed1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:24.526242 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882e7f3-cfb9-4ab1-8570-e38cf10ed1d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:24.526573 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882e7f3-cfb9-4ab1-8570-e38cf10ed1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:24.526888 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882e7f3-cfb9-4ab1-8570-e38cf10ed1d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:24.527538 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882e7f3-cfb9-4ab1-8570-e38cf10ed1d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:24.530019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882e7f3-cfb9-4ab1-8570-e38cf10ed1d3 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:24.558509 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 924/1856] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:24 2022] POST /identity/v3/users => generated 300 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:24.558699 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ca07f10c-46b8-4419-b0e9-6f2d5893a9c4 None None] MFA Rules not processed for user `2b5730c49e61438884e3d9f4451e3b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:24.559166 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882e7f3-cfb9-4ab1-8570-e38cf10ed1d3 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:24.560577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ca07f10c-46b8-4419-b0e9-6f2d5893a9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:24.679935 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:24.692529 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882e7f3-cfb9-4ab1-8570-e38cf10ed1d3 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:24.697274 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4a2e8-3fd1-4cf5-9326-373740817633 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:24.698633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4a2e8-3fd1-4cf5-9326-373740817633 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:24.698633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4a2e8-3fd1-4cf5-9326-373740817633 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:24.699282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4a2e8-3fd1-4cf5-9326-373740817633 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:24.713162 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4a2e8-3fd1-4cf5-9326-373740817633 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:24.714935 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4a2e8-3fd1-4cf5-9326-373740817633 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:24.737083 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 925/1857] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:24.739505 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4a2e8-3fd1-4cf5-9326-373740817633 service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:24.745295 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-64f4a2e8-3fd1-4cf5-9326-373740817633 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:24.745710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 933/1858] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:24.748151 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07f10c-46b8-4419-b0e9-6f2d5893a9c4 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:24.770215 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07f10c-46b8-4419-b0e9-6f2d5893a9c4 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:24.783227 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814157d3-1cb2-49c3-baa7-5d1526a61075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:24.783854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814157d3-1cb2-49c3-baa7-5d1526a61075 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:24.784134 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814157d3-1cb2-49c3-baa7-5d1526a61075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:24.784467 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814157d3-1cb2-49c3-baa7-5d1526a61075 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:24.786150 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4a2e8-3fd1-4cf5-9326-373740817633 service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:24.787617 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814157d3-1cb2-49c3-baa7-5d1526a61075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:24.789475 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814157d3-1cb2-49c3-baa7-5d1526a61075 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:24.820694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be3a1b-d8ea-4783-b98c-3247101eb175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:24.822754 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be3a1b-d8ea-4783-b98c-3247101eb175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:24.823046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be3a1b-d8ea-4783-b98c-3247101eb175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:24.823325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be3a1b-d8ea-4783-b98c-3247101eb175 admin admin] PATH_INFO: `/v3/projects/e4affa3577b64010b9a1be2e9e7e1a48` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:24.824801 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be3a1b-d8ea-4783-b98c-3247101eb175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4affa3577b64010b9a1be2e9e7e1a48)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:24.839604 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 934/1859] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:24.839773 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be3a1b-d8ea-4783-b98c-3247101eb175 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:24.846433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814157d3-1cb2-49c3-baa7-5d1526a61075 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:24.884952 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814157d3-1cb2-49c3-baa7-5d1526a61075 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:24.914107 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e081cfc-f841-4f0d-857e-a674b3d110d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:24.914818 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e081cfc-f841-4f0d-857e-a674b3d110d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:24.915095 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e081cfc-f841-4f0d-857e-a674b3d110d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:24.915393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e081cfc-f841-4f0d-857e-a674b3d110d2 admin admin] PATH_INFO: `/v3/projects/6d3630609a9a493eb8b97029163cf607/users/3035c09760d14505af715c200444165c/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:24.947569 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e081cfc-f841-4f0d-857e-a674b3d110d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d3630609a9a493eb8b97029163cf607, user_id=3035c09760d14505af715c200444165c, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:24.954748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e081cfc-f841-4f0d-857e-a674b3d110d2 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:24.956797 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-42be3a1b-d8ea-4783-b98c-3247101eb175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4affa3577b64010b9a1be2e9e7e1a48', 'request_id': 'req-42be3a1b-d8ea-4783-b98c-3247101eb175'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:24.971774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-42be3a1b-d8ea-4783-b98c-3247101eb175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4affa3577b64010b9a1be2e9e7e1a48', 'request_id': 'req-42be3a1b-d8ea-4783-b98c-3247101eb175'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:24.986402 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 935/1860] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:24 2022] PUT /identity/v3/projects/6d3630609a9a493eb8b97029163cf607/users/3035c09760d14505af715c200444165c/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:24.987650 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e081cfc-f841-4f0d-857e-a674b3d110d2 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:24.992832 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-42be3a1b-d8ea-4783-b98c-3247101eb175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4affa3577b64010b9a1be2e9e7e1a48', 'request_id': 'req-42be3a1b-d8ea-4783-b98c-3247101eb175'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:25.022832 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-42be3a1b-d8ea-4783-b98c-3247101eb175 admin admin] The token cache is being invalidate because project e4affa3577b64010b9a1be2e9e7e1a48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:25.023582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-42be3a1b-d8ea-4783-b98c-3247101eb175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:25.024492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-42be3a1b-d8ea-4783-b98c-3247101eb175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:25.027112 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 926/1861] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:24 2022] DELETE /identity/v3/projects/e4affa3577b64010b9a1be2e9e7e1a48 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:25.031724 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be3a1b-d8ea-4783-b98c-3247101eb175 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:25.034029 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-42be3a1b-d8ea-4783-b98c-3247101eb175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:25.047313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:25.073496 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e081cfc-f841-4f0d-857e-a674b3d110d2 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:25.078309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fb729-6021-427b-87b4-bf3c66d0632f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:25.078980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fb729-6021-427b-87b4-bf3c66d0632f service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:25.079261 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fb729-6021-427b-87b4-bf3c66d0632f service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:25.079532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fb729-6021-427b-87b4-bf3c66d0632f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:25.081372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-159fb729-6021-427b-87b4-bf3c66d0632f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:25.133008 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be3a1b-d8ea-4783-b98c-3247101eb175 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:25.163425 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fb729-6021-427b-87b4-bf3c66d0632f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:25.164883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fb729-6021-427b-87b4-bf3c66d0632f service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:25.179462 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 936/1862] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:25.180504 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fb729-6021-427b-87b4-bf3c66d0632f service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:25.182179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-159fb729-6021-427b-87b4-bf3c66d0632f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:25.223197 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f568fd-f190-4a7c-bada-af207a85f2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:25.223811 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f568fd-f190-4a7c-bada-af207a85f2dd admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:25.224086 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f568fd-f190-4a7c-bada-af207a85f2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:25.224352 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f568fd-f190-4a7c-bada-af207a85f2dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:25.224992 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f568fd-f190-4a7c-bada-af207a85f2dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:25.226843 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f568fd-f190-4a7c-bada-af207a85f2dd admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:25.241640 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 927/1863] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:25.245157 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f568fd-f190-4a7c-bada-af207a85f2dd admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:25.256019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f568fd-f190-4a7c-bada-af207a85f2dd admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:25.261174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac369d9-4df0-46ac-be44-88b5152a6203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:25.262076 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac369d9-4df0-46ac-be44-88b5152a6203 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:25.262444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac369d9-4df0-46ac-be44-88b5152a6203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:25.262779 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac369d9-4df0-46ac-be44-88b5152a6203 admin admin] PATH_INFO: `/v3/projects/6d3630609a9a493eb8b97029163cf607/users/3035c09760d14505af715c200444165c/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:25.264784 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac369d9-4df0-46ac-be44-88b5152a6203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d3630609a9a493eb8b97029163cf607, user_id=3035c09760d14505af715c200444165c, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:25.268159 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac369d9-4df0-46ac-be44-88b5152a6203 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:25.282433 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 928/1864] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:25 2022] PUT /identity/v3/projects/6d3630609a9a493eb8b97029163cf607/users/3035c09760d14505af715c200444165c/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:25.289748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fb729-6021-427b-87b4-bf3c66d0632f service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:25.297153 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c0b0c-134c-4c5d-8851-f3467c511a55 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:25.297472 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c0b0c-134c-4c5d-8851-f3467c511a55 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:25.298326 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c0b0c-134c-4c5d-8851-f3467c511a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:25.310296 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:25.347449 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-277c0b0c-134c-4c5d-8851-f3467c511a55 None None] MFA Rules not processed for user `3035c09760d14505af715c200444165c`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:25.348618 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-277c0b0c-134c-4c5d-8851-f3467c511a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:25.393235 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa4629-0c8c-4ab9-a09b-52672d69f1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:25.394394 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa4629-0c8c-4ab9-a09b-52672d69f1be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:25.394928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa4629-0c8c-4ab9-a09b-52672d69f1be admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:25.395404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa4629-0c8c-4ab9-a09b-52672d69f1be admin admin] PATH_INFO: `/v3/users/401914c458714fd3a18f56aa7eeffd75` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:25.397047 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa4629-0c8c-4ab9-a09b-52672d69f1be admin admin] RBAC: Authorizing `identity:delete_user(user_id=401914c458714fd3a18f56aa7eeffd75)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:25.399620 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa4629-0c8c-4ab9-a09b-52672d69f1be admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:25.467598 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:25.485859 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d0fa4629-0c8c-4ab9-a09b-52672d69f1be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '401914c458714fd3a18f56aa7eeffd75'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:25.496384 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 929/1865] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:25.506707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d0fa4629-0c8c-4ab9-a09b-52672d69f1be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '401914c458714fd3a18f56aa7eeffd75'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:25.552673 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d0fa4629-0c8c-4ab9-a09b-52672d69f1be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '401914c458714fd3a18f56aa7eeffd75'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:25.553828 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d0fa4629-0c8c-4ab9-a09b-52672d69f1be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '401914c458714fd3a18f56aa7eeffd75'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:25.555409 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d0fa4629-0c8c-4ab9-a09b-52672d69f1be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '401914c458714fd3a18f56aa7eeffd75'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:25.583918 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 937/1866] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:25 2022] DELETE /identity/v3/users/401914c458714fd3a18f56aa7eeffd75 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:25.603031 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c0b0c-134c-4c5d-8851-f3467c511a55 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:25.604975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-277c0b0c-134c-4c5d-8851-f3467c511a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:25.752686 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c0b0c-134c-4c5d-8851-f3467c511a55 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:25.894036 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7e93b-f42b-4b52-93c0-c344de0c362d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:25.894660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7e93b-f42b-4b52-93c0-c344de0c362d service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:25.894932 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7e93b-f42b-4b52-93c0-c344de0c362d service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:25.895197 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7e93b-f42b-4b52-93c0-c344de0c362d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:25.904258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-91b7e93b-f42b-4b52-93c0-c344de0c362d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:26.152569 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:26.163688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7e93b-f42b-4b52-93c0-c344de0c362d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:26.168543 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7e93b-f42b-4b52-93c0-c344de0c362d service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:26.225422 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 930/1867] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:25 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:26.382747 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa4629-0c8c-4ab9-a09b-52672d69f1be admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:26.384482 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d0fa4629-0c8c-4ab9-a09b-52672d69f1be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:26.560506 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa4629-0c8c-4ab9-a09b-52672d69f1be admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:26.592980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8cf08-1314-4adf-a13c-7688c8351465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:26.593652 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8cf08-1314-4adf-a13c-7688c8351465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:26.593954 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8cf08-1314-4adf-a13c-7688c8351465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:26.594227 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8cf08-1314-4adf-a13c-7688c8351465 admin admin] PATH_INFO: `/v3/users/e5ef95cf40ab4b76942beff82c5354a7` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:26.598766 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8cf08-1314-4adf-a13c-7688c8351465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5ef95cf40ab4b76942beff82c5354a7)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:26.606666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8cf08-1314-4adf-a13c-7688c8351465 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:26.669191 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7e93b-f42b-4b52-93c0-c344de0c362d service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:26.671918 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-91b7e93b-f42b-4b52-93c0-c344de0c362d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:26.713502 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7e93b-f42b-4b52-93c0-c344de0c362d service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:26.718425 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-03b8cf08-1314-4adf-a13c-7688c8351465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5ef95cf40ab4b76942beff82c5354a7'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:26.726267 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d71874-278a-4851-8628-97b497afc624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:26.726932 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d71874-278a-4851-8628-97b497afc624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:26.727220 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d71874-278a-4851-8628-97b497afc624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:26.727468 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d71874-278a-4851-8628-97b497afc624 admin admin] PATH_INFO: `/v3/projects/928370136bbf494a8ff98de4f3752ed0` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:26.733863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d71874-278a-4851-8628-97b497afc624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=928370136bbf494a8ff98de4f3752ed0)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:26.739928 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d71874-278a-4851-8628-97b497afc624 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:26.760946 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-03b8cf08-1314-4adf-a13c-7688c8351465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5ef95cf40ab4b76942beff82c5354a7'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:26.777192 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-03b8cf08-1314-4adf-a13c-7688c8351465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5ef95cf40ab4b76942beff82c5354a7'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:26.778187 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-03b8cf08-1314-4adf-a13c-7688c8351465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5ef95cf40ab4b76942beff82c5354a7'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:26.778954 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-03b8cf08-1314-4adf-a13c-7688c8351465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5ef95cf40ab4b76942beff82c5354a7'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:26.802932 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 938/1868] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:26 2022] DELETE /identity/v3/users/e5ef95cf40ab4b76942beff82c5354a7 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:26.808342 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c75ef-04f4-40aa-b956-e4e90b938ffc None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:26.809126 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c75ef-04f4-40aa-b956-e4e90b938ffc None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:26.809898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c75ef-04f4-40aa-b956-e4e90b938ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:26.840936 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-9d7c75ef-04f4-40aa-b956-e4e90b938ffc None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:26.843439 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-9d7c75ef-04f4-40aa-b956-e4e90b938ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:26.930766 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:26.950494 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a4d71874-278a-4851-8628-97b497afc624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '928370136bbf494a8ff98de4f3752ed0', 'request_id': 'req-a4d71874-278a-4851-8628-97b497afc624'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:26.963854 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a4d71874-278a-4851-8628-97b497afc624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '928370136bbf494a8ff98de4f3752ed0', 'request_id': 'req-a4d71874-278a-4851-8628-97b497afc624'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:26.976785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a4d71874-278a-4851-8628-97b497afc624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '928370136bbf494a8ff98de4f3752ed0', 'request_id': 'req-a4d71874-278a-4851-8628-97b497afc624'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:27.007868 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 939/1869] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:27.027836 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c75ef-04f4-40aa-b956-e4e90b938ffc None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:27.029928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-9d7c75ef-04f4-40aa-b956-e4e90b938ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:27.042147 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a4d71874-278a-4851-8628-97b497afc624 admin admin] The token cache is being invalidate because project 928370136bbf494a8ff98de4f3752ed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:27.042757 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a4d71874-278a-4851-8628-97b497afc624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:27.043577 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a4d71874-278a-4851-8628-97b497afc624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:27.046271 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 931/1870] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:26 2022] DELETE /identity/v3/projects/928370136bbf494a8ff98de4f3752ed0 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:05:27.052420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a67b27-4331-467e-8461-c4d3b6b5e310 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:27.052867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a67b27-4331-467e-8461-c4d3b6b5e310 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:27.053378 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a67b27-4331-467e-8461-c4d3b6b5e310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:27.100449 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-d5a67b27-4331-467e-8461-c4d3b6b5e310 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:27.101989 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d5a67b27-4331-467e-8461-c4d3b6b5e310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:27.175876 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c75ef-04f4-40aa-b956-e4e90b938ffc None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:27.221925 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 932/1871] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:05:27.231526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e17e7-3df4-466a-95cc-24d7d6182202 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:27.232114 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e17e7-3df4-466a-95cc-24d7d6182202 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:27.232114 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e17e7-3df4-466a-95cc-24d7d6182202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:27.242182 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7387b-a32a-4055-a23b-1c5c2ffbfe1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:27.242895 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7387b-a32a-4055-a23b-1c5c2ffbfe1b service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:27.243245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7387b-a32a-4055-a23b-1c5c2ffbfe1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:27.244262 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7387b-a32a-4055-a23b-1c5c2ffbfe1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:27.246528 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-55f7387b-a32a-4055-a23b-1c5c2ffbfe1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:27.265324 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-f64e17e7-3df4-466a-95cc-24d7d6182202 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:27.267423 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f64e17e7-3df4-466a-95cc-24d7d6182202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:27.271216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7387b-a32a-4055-a23b-1c5c2ffbfe1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:27.272777 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7387b-a32a-4055-a23b-1c5c2ffbfe1b service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:27.278249 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 933/1872] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:27.283137 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 940/1873] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 01:05:27.283290 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e17e7-3df4-466a-95cc-24d7d6182202 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:27.292291 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e17e7-3df4-466a-95cc-24d7d6182202 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:27.296774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2713a-5cb4-4e3f-824e-fd52d030299e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:27.297357 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2713a-5cb4-4e3f-824e-fd52d030299e admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:27.297690 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2713a-5cb4-4e3f-824e-fd52d030299e admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:27.297993 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2713a-5cb4-4e3f-824e-fd52d030299e admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:27.298621 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2713a-5cb4-4e3f-824e-fd52d030299e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:05:27.298918 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2713a-5cb4-4e3f-824e-fd52d030299e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:27.300622 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2713a-5cb4-4e3f-824e-fd52d030299e admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:27.312578 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 934/1874] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 01:05:27.317471 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7387b-a32a-4055-a23b-1c5c2ffbfe1b service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:27.327233 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7387b-a32a-4055-a23b-1c5c2ffbfe1b service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:27.336443 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e838c-9895-40a7-830e-77b5d2842270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:27.337066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e838c-9895-40a7-830e-77b5d2842270 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:27.337350 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e838c-9895-40a7-830e-77b5d2842270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:27.337627 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e838c-9895-40a7-830e-77b5d2842270 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:27.338423 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e838c-9895-40a7-830e-77b5d2842270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:27.340339 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e838c-9895-40a7-830e-77b5d2842270 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:27.382021 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 941/1875] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:27 2022] POST /identity/v3/projects => generated 369 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:27.383838 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2713a-5cb4-4e3f-824e-fd52d030299e admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:27.398013 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2713a-5cb4-4e3f-824e-fd52d030299e admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:27.500038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444759e-a2b7-4825-85b7-8ca8d6b2437c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:27.500896 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444759e-a2b7-4825-85b7-8ca8d6b2437c admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:27.501378 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444759e-a2b7-4825-85b7-8ca8d6b2437c admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:27.501756 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444759e-a2b7-4825-85b7-8ca8d6b2437c admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:27.502564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444759e-a2b7-4825-85b7-8ca8d6b2437c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:27.504811 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444759e-a2b7-4825-85b7-8ca8d6b2437c admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:27.514208 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:27.551837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 935/1876] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:27 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:27.553390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e838c-9895-40a7-830e-77b5d2842270 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:27.570408 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e838c-9895-40a7-830e-77b5d2842270 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:27.586766 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812be53-5b7b-4cda-ad06-2c991be4f463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:27.587466 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812be53-5b7b-4cda-ad06-2c991be4f463 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:27.587904 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812be53-5b7b-4cda-ad06-2c991be4f463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:27.588392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812be53-5b7b-4cda-ad06-2c991be4f463 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:27.589153 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812be53-5b7b-4cda-ad06-2c991be4f463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:27.593852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812be53-5b7b-4cda-ad06-2c991be4f463 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:27.626604 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 942/1877] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:27.631362 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444759e-a2b7-4825-85b7-8ca8d6b2437c admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:27.646955 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444759e-a2b7-4825-85b7-8ca8d6b2437c admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:27.661759 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5557f2-1d8e-4f9e-8968-1607ca4da825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:27.665081 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5557f2-1d8e-4f9e-8968-1607ca4da825 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:27.665554 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5557f2-1d8e-4f9e-8968-1607ca4da825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:27.666076 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5557f2-1d8e-4f9e-8968-1607ca4da825 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:27.668350 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5557f2-1d8e-4f9e-8968-1607ca4da825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:27.670239 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5557f2-1d8e-4f9e-8968-1607ca4da825 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:27.716823 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 936/1878] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:27.721877 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812be53-5b7b-4cda-ad06-2c991be4f463 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:27.743450 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812be53-5b7b-4cda-ad06-2c991be4f463 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:27.744837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5557f2-1d8e-4f9e-8968-1607ca4da825 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:27.747551 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5d5557f2-1d8e-4f9e-8968-1607ca4da825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:27.756452 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f8cc8-9cf0-4e49-867f-8b29bb88d789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:27.757133 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f8cc8-9cf0-4e49-867f-8b29bb88d789 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:27.757489 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f8cc8-9cf0-4e49-867f-8b29bb88d789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:27.757663 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f8cc8-9cf0-4e49-867f-8b29bb88d789 admin admin] PATH_INFO: `/v3/projects/48993d72ac2a41dabc5210bfb318f5e4/users/f3d15693a664439880615fe65a0016a8/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:27.768533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5557f2-1d8e-4f9e-8968-1607ca4da825 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:27.783154 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14b688-648e-459d-8f4e-bbc36c725691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:27.783542 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14b688-648e-459d-8f4e-bbc36c725691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:27.783885 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14b688-648e-459d-8f4e-bbc36c725691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:27.784317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14b688-648e-459d-8f4e-bbc36c725691 admin admin] PATH_INFO: `/v3/projects/3b53a26f2db94f01b040db01a5b5a99c` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:27.789753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14b688-648e-459d-8f4e-bbc36c725691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b53a26f2db94f01b040db01a5b5a99c)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:27.792016 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14b688-648e-459d-8f4e-bbc36c725691 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:27.834605 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f8cc8-9cf0-4e49-867f-8b29bb88d789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48993d72ac2a41dabc5210bfb318f5e4, user_id=f3d15693a664439880615fe65a0016a8, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:27.853319 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f8cc8-9cf0-4e49-867f-8b29bb88d789 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:27.899998 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 943/1879] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:27 2022] PUT /identity/v3/projects/48993d72ac2a41dabc5210bfb318f5e4/users/f3d15693a664439880615fe65a0016a8/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:27.911044 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ec14b688-648e-459d-8f4e-bbc36c725691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b53a26f2db94f01b040db01a5b5a99c', 'request_id': 'req-ec14b688-648e-459d-8f4e-bbc36c725691'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:27.912105 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e05fa-96ed-447e-a763-ddef464a54b8 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:27.912682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e05fa-96ed-447e-a763-ddef464a54b8 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:27.913147 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e05fa-96ed-447e-a763-ddef464a54b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:27.936373 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ec14b688-648e-459d-8f4e-bbc36c725691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b53a26f2db94f01b040db01a5b5a99c', 'request_id': 'req-ec14b688-648e-459d-8f4e-bbc36c725691'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:27.963532 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ec14b688-648e-459d-8f4e-bbc36c725691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b53a26f2db94f01b040db01a5b5a99c', 'request_id': 'req-ec14b688-648e-459d-8f4e-bbc36c725691'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:28.007560 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ec14b688-648e-459d-8f4e-bbc36c725691 admin admin] The token cache is being invalidate because project 3b53a26f2db94f01b040db01a5b5a99c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:28.007867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ec14b688-648e-459d-8f4e-bbc36c725691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:28.008725 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ec14b688-648e-459d-8f4e-bbc36c725691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:28.012140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 937/1880] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:27 2022] DELETE /identity/v3/projects/3b53a26f2db94f01b040db01a5b5a99c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:05:28.014320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14b688-648e-459d-8f4e-bbc36c725691 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:28.015618 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-2d3e05fa-96ed-447e-a763-ddef464a54b8 None None] MFA Rules not processed for user `f3d15693a664439880615fe65a0016a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:28.015755 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ec14b688-648e-459d-8f4e-bbc36c725691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:28.018168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2d3e05fa-96ed-447e-a763-ddef464a54b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:28.058561 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:28.141275 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 944/1881] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:28.147862 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e05fa-96ed-447e-a763-ddef464a54b8 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:28.152851 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2d3e05fa-96ed-447e-a763-ddef464a54b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:28.191191 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14b688-648e-459d-8f4e-bbc36c725691 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:28.283860 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97401ac-5390-4ba5-9265-856126c1c178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:28.284559 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97401ac-5390-4ba5-9265-856126c1c178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:28.284836 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97401ac-5390-4ba5-9265-856126c1c178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:28.285109 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97401ac-5390-4ba5-9265-856126c1c178 admin admin] PATH_INFO: `/v3/users/3035c09760d14505af715c200444165c` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:28.286585 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97401ac-5390-4ba5-9265-856126c1c178 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3035c09760d14505af715c200444165c)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:28.288591 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97401ac-5390-4ba5-9265-856126c1c178 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:28.304759 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:28.325071 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e05fa-96ed-447e-a763-ddef464a54b8 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:28.340278 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4841359-8764-4574-a111-f58cf6917ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:28.347385 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4841359-8764-4574-a111-f58cf6917ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:28.347385 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4841359-8764-4574-a111-f58cf6917ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:28.347385 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4841359-8764-4574-a111-f58cf6917ce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:28.347385 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4841359-8764-4574-a111-f58cf6917ce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:28.347385 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4841359-8764-4574-a111-f58cf6917ce9 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:28.381996 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b97401ac-5390-4ba5-9265-856126c1c178 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3035c09760d14505af715c200444165c'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:28.382860 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b97401ac-5390-4ba5-9265-856126c1c178 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3035c09760d14505af715c200444165c'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:28.393090 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 945/1882] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:28 2022] POST /identity/v3/projects => generated 367 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:28.394543 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a45d6-bba5-43af-b822-21ef46ce4de9 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:28.394875 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a45d6-bba5-43af-b822-21ef46ce4de9 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:28.395158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a45d6-bba5-43af-b822-21ef46ce4de9 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:28.396269 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b97401ac-5390-4ba5-9265-856126c1c178 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3035c09760d14505af715c200444165c'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:28.396638 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 946/1883] 10.222.0.20 () {54 vars in 921 bytes} [Wed Sep 14 01:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 01:05:28.405368 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a45d6-bba5-43af-b822-21ef46ce4de9 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:28.412180 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5b6a45d6-bba5-43af-b822-21ef46ce4de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:28.431098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b97401ac-5390-4ba5-9265-856126c1c178 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3035c09760d14505af715c200444165c'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:28.434317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b97401ac-5390-4ba5-9265-856126c1c178 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3035c09760d14505af715c200444165c'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:28.461495 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 938/1884] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:28 2022] DELETE /identity/v3/users/3035c09760d14505af715c200444165c => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:05:28.463499 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94127e1-bc8e-49cf-b1e3-872659957f3c None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:28.463957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94127e1-bc8e-49cf-b1e3-872659957f3c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:28.466175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94127e1-bc8e-49cf-b1e3-872659957f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:28.502489 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a45d6-bba5-43af-b822-21ef46ce4de9 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:28.507973 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-e94127e1-bc8e-49cf-b1e3-872659957f3c None None] MFA Rules not processed for user `c05caac9e8b9498583780306887734be`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:28.511373 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e94127e1-bc8e-49cf-b1e3-872659957f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:28.582532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:28.600502 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3c169-227c-4d00-adb7-55981187d348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:28.601428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3c169-227c-4d00-adb7-55981187d348 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:28.601721 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3c169-227c-4d00-adb7-55981187d348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:28.602016 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3c169-227c-4d00-adb7-55981187d348 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:28.603208 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3c169-227c-4d00-adb7-55981187d348 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:28.606978 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3c169-227c-4d00-adb7-55981187d348 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:28.634622 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 947/1885] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:28 2022] POST /identity/v3/users => generated 290 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:28.638875 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3c169-227c-4d00-adb7-55981187d348 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:28.650733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3c169-227c-4d00-adb7-55981187d348 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:28.662184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 939/1886] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Sep 14 01:05:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:28.662554 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85b02c-dcc3-4151-8857-6ca021fb31d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:28.662645 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85b02c-dcc3-4151-8857-6ca021fb31d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:28.663166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85b02c-dcc3-4151-8857-6ca021fb31d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:28.663368 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85b02c-dcc3-4151-8857-6ca021fb31d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:28.664103 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f85b02c-dcc3-4151-8857-6ca021fb31d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:28.665613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f85b02c-dcc3-4151-8857-6ca021fb31d2 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:28.671156 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94127e1-bc8e-49cf-b1e3-872659957f3c None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:28.677074 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e94127e1-bc8e-49cf-b1e3-872659957f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:28.683140 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 948/1887] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:28.684235 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85b02c-dcc3-4151-8857-6ca021fb31d2 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:28.698165 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85b02c-dcc3-4151-8857-6ca021fb31d2 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:28.701647 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94127e1-bc8e-49cf-b1e3-872659957f3c None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:28.704415 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08eee4-2876-45fb-b29a-02d1fb0bcc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:28.705092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08eee4-2876-45fb-b29a-02d1fb0bcc14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:28.705372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08eee4-2876-45fb-b29a-02d1fb0bcc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:28.705651 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08eee4-2876-45fb-b29a-02d1fb0bcc14 admin admin] PATH_INFO: `/v3/projects/7e72e05ea7af4697b414ad7eeca427e6/users/bec09e19bf5d401aad0dd56e0ac2f3c8/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:28.715673 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff13fc6-238c-4423-86d6-a48a0832af01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:28.716676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff13fc6-238c-4423-86d6-a48a0832af01 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:28.716864 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff13fc6-238c-4423-86d6-a48a0832af01 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:28.717081 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff13fc6-238c-4423-86d6-a48a0832af01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:28.729567 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff13fc6-238c-4423-86d6-a48a0832af01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:28.731451 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff13fc6-238c-4423-86d6-a48a0832af01 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:28.747297 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 940/1888] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:28.751864 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08eee4-2876-45fb-b29a-02d1fb0bcc14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e72e05ea7af4697b414ad7eeca427e6, user_id=bec09e19bf5d401aad0dd56e0ac2f3c8, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:28.754483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08eee4-2876-45fb-b29a-02d1fb0bcc14 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:28.774433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 949/1889] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:28 2022] PUT /identity/v3/projects/7e72e05ea7af4697b414ad7eeca427e6/users/bec09e19bf5d401aad0dd56e0ac2f3c8/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:28.775677 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff13fc6-238c-4423-86d6-a48a0832af01 service nova] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:28.796106 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff13fc6-238c-4423-86d6-a48a0832af01 service nova] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:28.928436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1774cf-0687-4be0-b83b-35c72a15bab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:28.929345 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1774cf-0687-4be0-b83b-35c72a15bab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:28.929658 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1774cf-0687-4be0-b83b-35c72a15bab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:28.929895 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1774cf-0687-4be0-b83b-35c72a15bab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:28.930787 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1774cf-0687-4be0-b83b-35c72a15bab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:28.932676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1774cf-0687-4be0-b83b-35c72a15bab1 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:28.946116 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 941/1890] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 01:05:28.951058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08eee4-2876-45fb-b29a-02d1fb0bcc14 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:28.963412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08eee4-2876-45fb-b29a-02d1fb0bcc14 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:28.975943 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734af7ed-9fb1-45f7-8631-a20c4c46f255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:28.977781 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734af7ed-9fb1-45f7-8631-a20c4c46f255 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:28.988650 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734af7ed-9fb1-45f7-8631-a20c4c46f255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:28.988998 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734af7ed-9fb1-45f7-8631-a20c4c46f255 admin admin] PATH_INFO: `/v3/projects/7e72e05ea7af4697b414ad7eeca427e6/users/bec09e19bf5d401aad0dd56e0ac2f3c8/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:28.993919 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734af7ed-9fb1-45f7-8631-a20c4c46f255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e72e05ea7af4697b414ad7eeca427e6, user_id=bec09e19bf5d401aad0dd56e0ac2f3c8, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:29.007462 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734af7ed-9fb1-45f7-8631-a20c4c46f255 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:29.036064 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d72d1-b479-4cf9-a90d-a90fc0656e9c None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:29.036378 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d72d1-b479-4cf9-a90d-a90fc0656e9c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:29.036682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d72d1-b479-4cf9-a90d-a90fc0656e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:29.045929 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 950/1891] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:28 2022] PUT /identity/v3/projects/7e72e05ea7af4697b414ad7eeca427e6/users/bec09e19bf5d401aad0dd56e0ac2f3c8/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:29.058913 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:29.104456 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-1d6d72d1-b479-4cf9-a90d-a90fc0656e9c None None] MFA Rules not processed for user `bec09e19bf5d401aad0dd56e0ac2f3c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:29.105688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1d6d72d1-b479-4cf9-a90d-a90fc0656e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:29.300093 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 942/1892] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:29.329920 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734af7ed-9fb1-45f7-8631-a20c4c46f255 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:29.331713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-734af7ed-9fb1-45f7-8631-a20c4c46f255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:29.422246 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734af7ed-9fb1-45f7-8631-a20c4c46f255 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:29.427163 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a952930-2fd2-4723-ae62-b259d1f85fec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:29.428120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a952930-2fd2-4723-ae62-b259d1f85fec service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:29.428567 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a952930-2fd2-4723-ae62-b259d1f85fec service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:29.429199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a952930-2fd2-4723-ae62-b259d1f85fec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:29.470533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a952930-2fd2-4723-ae62-b259d1f85fec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:29.472500 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a952930-2fd2-4723-ae62-b259d1f85fec service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:29.495692 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 951/1893] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:29.566668 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d72d1-b479-4cf9-a90d-a90fc0656e9c None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:29.589700 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d72d1-b479-4cf9-a90d-a90fc0656e9c None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:29.600870 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f136b4-5545-477d-80ec-eb3b1d819814 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:29.601667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f136b4-5545-477d-80ec-eb3b1d819814 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:29.603550 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f136b4-5545-477d-80ec-eb3b1d819814 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:29.603862 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f136b4-5545-477d-80ec-eb3b1d819814 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:29.608950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-66f136b4-5545-477d-80ec-eb3b1d819814 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:29.707275 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f136b4-5545-477d-80ec-eb3b1d819814 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:29.711062 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f136b4-5545-477d-80ec-eb3b1d819814 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:29.730531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 943/1894] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:30.289243 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a952930-2fd2-4723-ae62-b259d1f85fec service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:30.290796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4a952930-2fd2-4723-ae62-b259d1f85fec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:30.456443 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a952930-2fd2-4723-ae62-b259d1f85fec service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:30.462872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33592315-80c9-47fb-ae26-5032bcbf00de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:30.463896 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33592315-80c9-47fb-ae26-5032bcbf00de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:30.464326 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33592315-80c9-47fb-ae26-5032bcbf00de admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:30.479064 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33592315-80c9-47fb-ae26-5032bcbf00de admin admin] PATH_INFO: `/v3/projects/6d3630609a9a493eb8b97029163cf607` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:30.482573 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33592315-80c9-47fb-ae26-5032bcbf00de admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d3630609a9a493eb8b97029163cf607)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:30.487552 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33592315-80c9-47fb-ae26-5032bcbf00de admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:30.567234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:30.588142 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-33592315-80c9-47fb-ae26-5032bcbf00de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d3630609a9a493eb8b97029163cf607', 'request_id': 'req-33592315-80c9-47fb-ae26-5032bcbf00de'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:30.600495 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-33592315-80c9-47fb-ae26-5032bcbf00de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d3630609a9a493eb8b97029163cf607', 'request_id': 'req-33592315-80c9-47fb-ae26-5032bcbf00de'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:30.610893 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-33592315-80c9-47fb-ae26-5032bcbf00de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d3630609a9a493eb8b97029163cf607', 'request_id': 'req-33592315-80c9-47fb-ae26-5032bcbf00de'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:30.624298 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-33592315-80c9-47fb-ae26-5032bcbf00de admin admin] The token cache is being invalidate because project 6d3630609a9a493eb8b97029163cf607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:30.624886 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-33592315-80c9-47fb-ae26-5032bcbf00de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:30.626397 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-33592315-80c9-47fb-ae26-5032bcbf00de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:30.632615 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 952/1895] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:30 2022] DELETE /identity/v3/projects/6d3630609a9a493eb8b97029163cf607 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:30.634899 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6e0d1-1eb5-4c31-814a-af0b270211ed None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:30.635401 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6e0d1-1eb5-4c31-814a-af0b270211ed None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:30.635486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6e0d1-1eb5-4c31-814a-af0b270211ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:30.680083 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-39c6e0d1-1eb5-4c31-814a-af0b270211ed None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:30.681341 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-39c6e0d1-1eb5-4c31-814a-af0b270211ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:30.749057 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 944/1896] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:30.759212 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d565b-525b-4249-91dd-7e01e329c20d None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:30.760014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d565b-525b-4249-91dd-7e01e329c20d None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:30.760724 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d565b-525b-4249-91dd-7e01e329c20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:30.786288 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-360d565b-525b-4249-91dd-7e01e329c20d None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:30.787689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-360d565b-525b-4249-91dd-7e01e329c20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:30.796336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 953/1897] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:30.801513 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6e0d1-1eb5-4c31-814a-af0b270211ed None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:30.816438 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6e0d1-1eb5-4c31-814a-af0b270211ed None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:30.822092 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075d081-a02d-4eaf-82f7-26b4ac2b60a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:30.822952 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075d081-a02d-4eaf-82f7-26b4ac2b60a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:30.823438 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075d081-a02d-4eaf-82f7-26b4ac2b60a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:30.824641 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075d081-a02d-4eaf-82f7-26b4ac2b60a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:30.825938 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075d081-a02d-4eaf-82f7-26b4ac2b60a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:05:30.826569 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075d081-a02d-4eaf-82f7-26b4ac2b60a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:30.828380 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075d081-a02d-4eaf-82f7-26b4ac2b60a9 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:30.859630 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 945/1898] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:05:30.861394 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d565b-525b-4249-91dd-7e01e329c20d None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:30.871170 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d565b-525b-4249-91dd-7e01e329c20d None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:30.876080 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8313e2-e89e-4812-93c3-f30661249ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:30.876692 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8313e2-e89e-4812-93c3-f30661249ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:30.876972 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8313e2-e89e-4812-93c3-f30661249ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:30.877447 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8313e2-e89e-4812-93c3-f30661249ca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:30.877988 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8313e2-e89e-4812-93c3-f30661249ca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:30.879923 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8313e2-e89e-4812-93c3-f30661249ca7 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:30.917731 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 954/1899] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:30 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:30.918901 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075d081-a02d-4eaf-82f7-26b4ac2b60a9 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:30.934975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075d081-a02d-4eaf-82f7-26b4ac2b60a9 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:30.945693 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:31.012345 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8313e2-e89e-4812-93c3-f30661249ca7 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:31.014927 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ba8313e2-e89e-4812-93c3-f30661249ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:31.031739 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fda63-9192-43a3-a1f3-8646e45d0c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:31.032422 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fda63-9192-43a3-a1f3-8646e45d0c9f admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:31.032710 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fda63-9192-43a3-a1f3-8646e45d0c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:31.032979 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fda63-9192-43a3-a1f3-8646e45d0c9f admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:31.033615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4fda63-9192-43a3-a1f3-8646e45d0c9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:31.035630 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4fda63-9192-43a3-a1f3-8646e45d0c9f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:31.077836 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 946/1900] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:30 2022] POST /identity/v3/users => generated 295 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:31.082062 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fda63-9192-43a3-a1f3-8646e45d0c9f admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:31.097625 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fda63-9192-43a3-a1f3-8646e45d0c9f admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:31.104366 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a614190-afde-4cf9-8ab8-a6facfea870f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:31.105060 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a614190-afde-4cf9-8ab8-a6facfea870f admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:31.105405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a614190-afde-4cf9-8ab8-a6facfea870f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:31.105735 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a614190-afde-4cf9-8ab8-a6facfea870f admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:31.106723 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a614190-afde-4cf9-8ab8-a6facfea870f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:31.108601 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a614190-afde-4cf9-8ab8-a6facfea870f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:31.111341 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8313e2-e89e-4812-93c3-f30661249ca7 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:31.118522 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934fd6a-b216-4547-843e-687a8bdf0d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:31.119518 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934fd6a-b216-4547-843e-687a8bdf0d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:31.119994 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934fd6a-b216-4547-843e-687a8bdf0d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:31.120318 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934fd6a-b216-4547-843e-687a8bdf0d30 admin admin] PATH_INFO: `/v3/users/f7a4e80fcc0045d7abe7947219fcafe0` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:31.121791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934fd6a-b216-4547-843e-687a8bdf0d30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7a4e80fcc0045d7abe7947219fcafe0)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:31.122069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 947/1901] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:31.124380 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934fd6a-b216-4547-843e-687a8bdf0d30 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:31.128016 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a614190-afde-4cf9-8ab8-a6facfea870f admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:31.142460 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a614190-afde-4cf9-8ab8-a6facfea870f admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:31.147998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdeea87-9c69-4ea0-8bc9-3e4cdf0ed668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:31.148615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdeea87-9c69-4ea0-8bc9-3e4cdf0ed668 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:31.148886 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdeea87-9c69-4ea0-8bc9-3e4cdf0ed668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:31.149337 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdeea87-9c69-4ea0-8bc9-3e4cdf0ed668 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:31.150217 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdeea87-9c69-4ea0-8bc9-3e4cdf0ed668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:31.152240 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdeea87-9c69-4ea0-8bc9-3e4cdf0ed668 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:31.169252 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 948/1902] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:31.175782 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdeea87-9c69-4ea0-8bc9-3e4cdf0ed668 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:31.185579 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdeea87-9c69-4ea0-8bc9-3e4cdf0ed668 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:31.192014 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbda458-f5d8-48c4-98fd-4d63186e812d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:31.192550 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbda458-f5d8-48c4-98fd-4d63186e812d admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:31.192665 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e934fd6a-b216-4547-843e-687a8bdf0d30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7a4e80fcc0045d7abe7947219fcafe0'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:31.192830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbda458-f5d8-48c4-98fd-4d63186e812d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:31.193103 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbda458-f5d8-48c4-98fd-4d63186e812d admin admin] PATH_INFO: `/v3/projects/471a5b802a8844d295f40988da5441bd/users/a2ce9bddea2d49fc806da9c27e27a9d0/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:31.203586 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e934fd6a-b216-4547-843e-687a8bdf0d30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7a4e80fcc0045d7abe7947219fcafe0'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:31.209592 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbda458-f5d8-48c4-98fd-4d63186e812d admin admin] RBAC: Authorizing `identity:create_grant(project_id=471a5b802a8844d295f40988da5441bd, user_id=a2ce9bddea2d49fc806da9c27e27a9d0, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:31.213838 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbda458-f5d8-48c4-98fd-4d63186e812d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:31.219460 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e934fd6a-b216-4547-843e-687a8bdf0d30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7a4e80fcc0045d7abe7947219fcafe0'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:31.220418 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e934fd6a-b216-4547-843e-687a8bdf0d30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7a4e80fcc0045d7abe7947219fcafe0'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:31.221203 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e934fd6a-b216-4547-843e-687a8bdf0d30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7a4e80fcc0045d7abe7947219fcafe0'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:31.230387 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 949/1903] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:31 2022] PUT /identity/v3/projects/471a5b802a8844d295f40988da5441bd/users/a2ce9bddea2d49fc806da9c27e27a9d0/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:05:31.241490 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48714da3-a1eb-4c8b-aed7-e2e57cc8f859 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:31.241778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48714da3-a1eb-4c8b-aed7-e2e57cc8f859 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:31.242169 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48714da3-a1eb-4c8b-aed7-e2e57cc8f859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:31.246681 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 955/1904] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:31 2022] DELETE /identity/v3/users/f7a4e80fcc0045d7abe7947219fcafe0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:05:31.251808 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2e2e6-2d2c-45cd-bfd6-6160dcb56f9d None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:31.252926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2e2e6-2d2c-45cd-bfd6-6160dcb56f9d None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:31.253304 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2e2e6-2d2c-45cd-bfd6-6160dcb56f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:31.274400 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-48714da3-a1eb-4c8b-aed7-e2e57cc8f859 None None] MFA Rules not processed for user `a2ce9bddea2d49fc806da9c27e27a9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:31.276003 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-48714da3-a1eb-4c8b-aed7-e2e57cc8f859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:31.277169 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-88d2e2e6-2d2c-45cd-bfd6-6160dcb56f9d None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:31.278372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-88d2e2e6-2d2c-45cd-bfd6-6160dcb56f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:31.300192 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:31.362095 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 956/1905] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:05:31.371074 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2e2e6-2d2c-45cd-bfd6-6160dcb56f9d None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:31.371494 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 950/1906] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:05:31.374381 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-88d2e2e6-2d2c-45cd-bfd6-6160dcb56f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:31.394455 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2e2e6-2d2c-45cd-bfd6-6160dcb56f9d None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:31.403814 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18692184-a845-4664-a4fc-0e66518183a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:31.404444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18692184-a845-4664-a4fc-0e66518183a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:31.404756 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18692184-a845-4664-a4fc-0e66518183a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:31.405041 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18692184-a845-4664-a4fc-0e66518183a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:31.405681 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18692184-a845-4664-a4fc-0e66518183a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:31.408756 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18692184-a845-4664-a4fc-0e66518183a7 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:31.424935 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48714da3-a1eb-4c8b-aed7-e2e57cc8f859 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:31.427711 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-48714da3-a1eb-4c8b-aed7-e2e57cc8f859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:31.487293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 957/1907] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:31 2022] POST /identity/v3/projects => generated 389 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:31.498494 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18692184-a845-4664-a4fc-0e66518183a7 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:31.561663 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:31.571439 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48714da3-a1eb-4c8b-aed7-e2e57cc8f859 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:31.635302 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18692184-a845-4664-a4fc-0e66518183a7 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:31.653397 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbd93f-a111-40b2-a513-4c8782b00cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:31.654509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbd93f-a111-40b2-a513-4c8782b00cba admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:31.654826 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbd93f-a111-40b2-a513-4c8782b00cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:31.658852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbd93f-a111-40b2-a513-4c8782b00cba admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:31.659571 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbd93f-a111-40b2-a513-4c8782b00cba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:31.668516 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbd93f-a111-40b2-a513-4c8782b00cba admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:31.703688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f6fa8-8c59-47fe-8e81-dc8328e28331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:31.704560 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f6fa8-8c59-47fe-8e81-dc8328e28331 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:31.704791 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f6fa8-8c59-47fe-8e81-dc8328e28331 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:31.705256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f6fa8-8c59-47fe-8e81-dc8328e28331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:31.712028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 958/1908] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:31 2022] POST /identity/v3/users => generated 301 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:05:31.716864 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbd93f-a111-40b2-a513-4c8782b00cba admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:31.720629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f6fa8-8c59-47fe-8e81-dc8328e28331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:31.722118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f6fa8-8c59-47fe-8e81-dc8328e28331 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:31.734199 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 951/1909] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:31.736491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbd93f-a111-40b2-a513-4c8782b00cba admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:31.743838 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35afe4-0eb4-46be-8413-51a4a7e8e3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:31.745510 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35afe4-0eb4-46be-8413-51a4a7e8e3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:31.746041 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35afe4-0eb4-46be-8413-51a4a7e8e3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:31.746547 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35afe4-0eb4-46be-8413-51a4a7e8e3d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:31.747375 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35afe4-0eb4-46be-8413-51a4a7e8e3d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:31.749383 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35afe4-0eb4-46be-8413-51a4a7e8e3d9 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:31.769502 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f6fa8-8c59-47fe-8e81-dc8328e28331 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:31.770444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 959/1910] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:31.781865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f6fa8-8c59-47fe-8e81-dc8328e28331 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:31.788472 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971315e-114f-40bc-a0db-141c101ff018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:31.789458 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971315e-114f-40bc-a0db-141c101ff018 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:31.790019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971315e-114f-40bc-a0db-141c101ff018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:31.790638 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971315e-114f-40bc-a0db-141c101ff018 admin admin] PATH_INFO: `/v3/projects/592ffc31cdb945f497ac6fbd486d7244/users/1088e9ec9dae4775a70b6649646bfb4a/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:31.822253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971315e-114f-40bc-a0db-141c101ff018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=592ffc31cdb945f497ac6fbd486d7244, user_id=1088e9ec9dae4775a70b6649646bfb4a, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:31.825986 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971315e-114f-40bc-a0db-141c101ff018 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:31.851254 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 952/1911] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:31 2022] PUT /identity/v3/projects/592ffc31cdb945f497ac6fbd486d7244/users/1088e9ec9dae4775a70b6649646bfb4a/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:05:31.855142 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35afe4-0eb4-46be-8413-51a4a7e8e3d9 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:31.872835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35afe4-0eb4-46be-8413-51a4a7e8e3d9 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:31.968783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6191fd-393b-42a3-8896-6f05d9bd88d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:31.969970 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6191fd-393b-42a3-8896-6f05d9bd88d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:31.970514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6191fd-393b-42a3-8896-6f05d9bd88d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:31.970794 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6191fd-393b-42a3-8896-6f05d9bd88d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:31.971453 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6191fd-393b-42a3-8896-6f05d9bd88d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:31.973740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6191fd-393b-42a3-8896-6f05d9bd88d2 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:31.986235 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 960/1912] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:31.990382 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971315e-114f-40bc-a0db-141c101ff018 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:32.011191 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971315e-114f-40bc-a0db-141c101ff018 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:32.034211 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ec265-b62b-4f06-b5ae-4ac5d485a31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:32.035219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ec265-b62b-4f06-b5ae-4ac5d485a31b admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:32.036836 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ec265-b62b-4f06-b5ae-4ac5d485a31b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:32.037227 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ec265-b62b-4f06-b5ae-4ac5d485a31b admin admin] PATH_INFO: `/v3/projects/592ffc31cdb945f497ac6fbd486d7244/users/1088e9ec9dae4775a70b6649646bfb4a/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:32.041850 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ec265-b62b-4f06-b5ae-4ac5d485a31b admin admin] RBAC: Authorizing `identity:create_grant(project_id=592ffc31cdb945f497ac6fbd486d7244, user_id=1088e9ec9dae4775a70b6649646bfb4a, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:32.051466 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ec265-b62b-4f06-b5ae-4ac5d485a31b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:32.136914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 953/1913] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:31 2022] PUT /identity/v3/projects/592ffc31cdb945f497ac6fbd486d7244/users/1088e9ec9dae4775a70b6649646bfb4a/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:32.140898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afea277-f9fa-4836-8e0c-d95020f579a1 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:32.142297 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afea277-f9fa-4836-8e0c-d95020f579a1 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:32.142981 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afea277-f9fa-4836-8e0c-d95020f579a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:32.263238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-8afea277-f9fa-4836-8e0c-d95020f579a1 None None] MFA Rules not processed for user `1088e9ec9dae4775a70b6649646bfb4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:32.264751 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ec265-b62b-4f06-b5ae-4ac5d485a31b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:32.267545 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-820ec265-b62b-4f06-b5ae-4ac5d485a31b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:32.268967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8afea277-f9fa-4836-8e0c-d95020f579a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:32.284143 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:32.403195 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 961/1914] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:32 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:32.404170 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afea277-f9fa-4836-8e0c-d95020f579a1 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:32.407699 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ec265-b62b-4f06-b5ae-4ac5d485a31b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:32.411998 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8afea277-f9fa-4836-8e0c-d95020f579a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:32.415319 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c0001-e474-484e-ab82-58bb0836b38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:32.416173 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c0001-e474-484e-ab82-58bb0836b38b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:32.416558 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c0001-e474-484e-ab82-58bb0836b38b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:32.416922 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c0001-e474-484e-ab82-58bb0836b38b admin admin] PATH_INFO: `/v3/users/4472c5c49e47449c8f71eb8cc3b83726` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:32.418662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c0001-e474-484e-ab82-58bb0836b38b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4472c5c49e47449c8f71eb8cc3b83726)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:32.422621 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c0001-e474-484e-ab82-58bb0836b38b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:32.442510 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afea277-f9fa-4836-8e0c-d95020f579a1 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:32.462139 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3cd6f-d446-46c1-b595-bb099b6e6e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:32.463486 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3cd6f-d446-46c1-b595-bb099b6e6e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:32.463895 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3cd6f-d446-46c1-b595-bb099b6e6e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:32.464619 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3cd6f-d446-46c1-b595-bb099b6e6e99 admin admin] PATH_INFO: `/v3/projects/20b27185622c4df7906bd71d04f17526` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:32.467318 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f3cd6f-d446-46c1-b595-bb099b6e6e99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20b27185622c4df7906bd71d04f17526)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:32.478155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f3cd6f-d446-46c1-b595-bb099b6e6e99 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:32.502240 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b16c0001-e474-484e-ab82-58bb0836b38b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4472c5c49e47449c8f71eb8cc3b83726'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:32.506215 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b16c0001-e474-484e-ab82-58bb0836b38b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4472c5c49e47449c8f71eb8cc3b83726'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:32.514545 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b16c0001-e474-484e-ab82-58bb0836b38b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4472c5c49e47449c8f71eb8cc3b83726'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:32.528213 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:32.532046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b16c0001-e474-484e-ab82-58bb0836b38b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4472c5c49e47449c8f71eb8cc3b83726'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:32.533035 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b16c0001-e474-484e-ab82-58bb0836b38b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4472c5c49e47449c8f71eb8cc3b83726'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:32.565445 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 954/1915] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:32 2022] DELETE /identity/v3/users/4472c5c49e47449c8f71eb8cc3b83726 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:05:32.566618 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c0001-e474-484e-ab82-58bb0836b38b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:32.568316 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b16c0001-e474-484e-ab82-58bb0836b38b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:32.574254 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-67f3cd6f-d446-46c1-b595-bb099b6e6e99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20b27185622c4df7906bd71d04f17526', 'request_id': 'req-67f3cd6f-d446-46c1-b595-bb099b6e6e99'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:32.588679 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-67f3cd6f-d446-46c1-b595-bb099b6e6e99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20b27185622c4df7906bd71d04f17526', 'request_id': 'req-67f3cd6f-d446-46c1-b595-bb099b6e6e99'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:32.602163 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-67f3cd6f-d446-46c1-b595-bb099b6e6e99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20b27185622c4df7906bd71d04f17526', 'request_id': 'req-67f3cd6f-d446-46c1-b595-bb099b6e6e99'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:32.635615 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-67f3cd6f-d446-46c1-b595-bb099b6e6e99 admin admin] The token cache is being invalidate because project 20b27185622c4df7906bd71d04f17526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:32.635615 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-67f3cd6f-d446-46c1-b595-bb099b6e6e99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:32.636427 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-67f3cd6f-d446-46c1-b595-bb099b6e6e99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:32.641123 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 962/1916] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:32 2022] DELETE /identity/v3/projects/20b27185622c4df7906bd71d04f17526 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:32.642968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6366d20-23c3-42c7-bb7e-7f1bc00a70c2 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:32.643423 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6366d20-23c3-42c7-bb7e-7f1bc00a70c2 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:32.643865 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6366d20-23c3-42c7-bb7e-7f1bc00a70c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:32.658338 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c0001-e474-484e-ab82-58bb0836b38b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:32.663905 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9390b-e867-4968-98c4-1a91c18f30c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:32.666366 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9390b-e867-4968-98c4-1a91c18f30c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:32.666671 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9390b-e867-4968-98c4-1a91c18f30c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:32.667620 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9390b-e867-4968-98c4-1a91c18f30c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:32.671859 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-40f9390b-e867-4968-98c4-1a91c18f30c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:32.694163 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-d6366d20-23c3-42c7-bb7e-7f1bc00a70c2 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:32.694163 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d6366d20-23c3-42c7-bb7e-7f1bc00a70c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:32.765616 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9390b-e867-4968-98c4-1a91c18f30c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:32.768445 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9390b-e867-4968-98c4-1a91c18f30c9 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:32.770461 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 963/1917] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:32.771617 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6366d20-23c3-42c7-bb7e-7f1bc00a70c2 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:32.773367 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d6366d20-23c3-42c7-bb7e-7f1bc00a70c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:32.788709 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6366d20-23c3-42c7-bb7e-7f1bc00a70c2 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:32.790752 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 955/1918] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:32 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:32.793185 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9390b-e867-4968-98c4-1a91c18f30c9 service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:32.796201 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-40f9390b-e867-4968-98c4-1a91c18f30c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:32.824063 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5745e-93d5-4888-bd86-b8235439c07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:32.826326 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5745e-93d5-4888-bd86-b8235439c07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:32.827917 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5745e-93d5-4888-bd86-b8235439c07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:32.829159 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5745e-93d5-4888-bd86-b8235439c07a admin admin] PATH_INFO: `/v3/users/999e14e64c7e4bc49b9378943438ae1a` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:32.830809 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a5745e-93d5-4888-bd86-b8235439c07a admin admin] RBAC: Authorizing `identity:delete_user(user_id=999e14e64c7e4bc49b9378943438ae1a)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:32.833210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a5745e-93d5-4888-bd86-b8235439c07a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:32.902126 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9390b-e867-4968-98c4-1a91c18f30c9 service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:32.907243 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970b74e-e6a1-4bd5-9895-88956683bc5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:32.908579 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970b74e-e6a1-4bd5-9895-88956683bc5e service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:32.909058 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970b74e-e6a1-4bd5-9895-88956683bc5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:32.909777 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970b74e-e6a1-4bd5-9895-88956683bc5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:32.929462 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:32.931167 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970b74e-e6a1-4bd5-9895-88956683bc5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:32.939342 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970b74e-e6a1-4bd5-9895-88956683bc5e service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:32.968144 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 956/1919] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:33.026599 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-a0a5745e-93d5-4888-bd86-b8235439c07a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '999e14e64c7e4bc49b9378943438ae1a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:33.059027 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-a0a5745e-93d5-4888-bd86-b8235439c07a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '999e14e64c7e4bc49b9378943438ae1a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:33.088664 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970b74e-e6a1-4bd5-9895-88956683bc5e service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:33.090178 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4970b74e-e6a1-4bd5-9895-88956683bc5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:33.095167 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-a0a5745e-93d5-4888-bd86-b8235439c07a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '999e14e64c7e4bc49b9378943438ae1a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:33.095845 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-a0a5745e-93d5-4888-bd86-b8235439c07a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '999e14e64c7e4bc49b9378943438ae1a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:33.096813 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-a0a5745e-93d5-4888-bd86-b8235439c07a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '999e14e64c7e4bc49b9378943438ae1a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:33.117316 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 964/1920] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:32 2022] DELETE /identity/v3/users/999e14e64c7e4bc49b9378943438ae1a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:33.117544 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970b74e-e6a1-4bd5-9895-88956683bc5e service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:33.171360 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:33.278969 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e87bb-ae41-4481-ae5b-0888b1dc08f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:33.284070 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e87bb-ae41-4481-ae5b-0888b1dc08f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:33.285901 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e87bb-ae41-4481-ae5b-0888b1dc08f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:33.286209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e87bb-ae41-4481-ae5b-0888b1dc08f4 admin admin] PATH_INFO: `/v3/users/a2ce9bddea2d49fc806da9c27e27a9d0` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:33.288625 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e87bb-ae41-4481-ae5b-0888b1dc08f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2ce9bddea2d49fc806da9c27e27a9d0)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:33.296171 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e87bb-ae41-4481-ae5b-0888b1dc08f4 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:33.368404 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a35e87bb-ae41-4481-ae5b-0888b1dc08f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2ce9bddea2d49fc806da9c27e27a9d0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:33.369091 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a35e87bb-ae41-4481-ae5b-0888b1dc08f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2ce9bddea2d49fc806da9c27e27a9d0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:33.378810 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a35e87bb-ae41-4481-ae5b-0888b1dc08f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2ce9bddea2d49fc806da9c27e27a9d0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:33.407464 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a35e87bb-ae41-4481-ae5b-0888b1dc08f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2ce9bddea2d49fc806da9c27e27a9d0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:33.408348 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a35e87bb-ae41-4481-ae5b-0888b1dc08f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2ce9bddea2d49fc806da9c27e27a9d0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:33.458923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 957/1921] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:33 2022] DELETE /identity/v3/users/a2ce9bddea2d49fc806da9c27e27a9d0 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:05:33.462687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcde517-9f32-4b16-a4d6-71ab77d97f8b None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:33.463173 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcde517-9f32-4b16-a4d6-71ab77d97f8b None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:33.463351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcde517-9f32-4b16-a4d6-71ab77d97f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:33.471964 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e87bb-ae41-4481-ae5b-0888b1dc08f4 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:33.476084 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a35e87bb-ae41-4481-ae5b-0888b1dc08f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:33.504785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-6bcde517-9f32-4b16-a4d6-71ab77d97f8b None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:33.506156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6bcde517-9f32-4b16-a4d6-71ab77d97f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:33.638833 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e87bb-ae41-4481-ae5b-0888b1dc08f4 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:33.643811 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 965/1922] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:33.657432 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c8af5-d16f-4e95-b6e0-a7716547e911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:33.658310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c8af5-d16f-4e95-b6e0-a7716547e911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:33.658592 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c8af5-d16f-4e95-b6e0-a7716547e911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:33.658866 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c8af5-d16f-4e95-b6e0-a7716547e911 admin admin] PATH_INFO: `/v3/projects/47dbf262bd4647de8e7657fddb5525f7` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:33.660248 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c8af5-d16f-4e95-b6e0-a7716547e911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47dbf262bd4647de8e7657fddb5525f7)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:33.662204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c8af5-d16f-4e95-b6e0-a7716547e911 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:33.683630 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcde517-9f32-4b16-a4d6-71ab77d97f8b None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:33.685587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6bcde517-9f32-4b16-a4d6-71ab77d97f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:33.791282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-0f7c8af5-d16f-4e95-b6e0-a7716547e911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47dbf262bd4647de8e7657fddb5525f7', 'request_id': 'req-0f7c8af5-d16f-4e95-b6e0-a7716547e911'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:33.808080 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-0f7c8af5-d16f-4e95-b6e0-a7716547e911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47dbf262bd4647de8e7657fddb5525f7', 'request_id': 'req-0f7c8af5-d16f-4e95-b6e0-a7716547e911'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:33.820038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-0f7c8af5-d16f-4e95-b6e0-a7716547e911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47dbf262bd4647de8e7657fddb5525f7', 'request_id': 'req-0f7c8af5-d16f-4e95-b6e0-a7716547e911'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:33.830045 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:33.840137 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcde517-9f32-4b16-a4d6-71ab77d97f8b None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:33.855076 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-0f7c8af5-d16f-4e95-b6e0-a7716547e911 admin admin] The token cache is being invalidate because project 47dbf262bd4647de8e7657fddb5525f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:33.855684 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-0f7c8af5-d16f-4e95-b6e0-a7716547e911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:33.857469 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-0f7c8af5-d16f-4e95-b6e0-a7716547e911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:33.861263 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 958/1923] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:33 2022] DELETE /identity/v3/projects/47dbf262bd4647de8e7657fddb5525f7 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:33.866736 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c8af5-d16f-4e95-b6e0-a7716547e911 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:33.881678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-0f7c8af5-d16f-4e95-b6e0-a7716547e911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:33.908393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab6e89-8478-4538-9e64-eb7659ca5cd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:33.909686 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab6e89-8478-4538-9e64-eb7659ca5cd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:33.910177 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab6e89-8478-4538-9e64-eb7659ca5cd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:33.910760 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab6e89-8478-4538-9e64-eb7659ca5cd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:33.926759 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ffab6e89-8478-4538-9e64-eb7659ca5cd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:33.945980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:33.989919 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c8af5-d16f-4e95-b6e0-a7716547e911 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:33.995738 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a02bb-6243-4023-b30e-f185659dfb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:33.996469 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a02bb-6243-4023-b30e-f185659dfb0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:33.996820 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a02bb-6243-4023-b30e-f185659dfb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:33.997190 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a02bb-6243-4023-b30e-f185659dfb0c admin admin] PATH_INFO: `/v3/users/7e73835522d2402b93387591a33210eb` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:33.998822 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a02bb-6243-4023-b30e-f185659dfb0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e73835522d2402b93387591a33210eb)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:34.001772 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a02bb-6243-4023-b30e-f185659dfb0c admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:34.113337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab6e89-8478-4538-9e64-eb7659ca5cd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:34.116165 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab6e89-8478-4538-9e64-eb7659ca5cd7 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:34.121864 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9a1a02bb-6243-4023-b30e-f185659dfb0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e73835522d2402b93387591a33210eb'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:34.122958 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9a1a02bb-6243-4023-b30e-f185659dfb0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e73835522d2402b93387591a33210eb'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:34.141464 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9a1a02bb-6243-4023-b30e-f185659dfb0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e73835522d2402b93387591a33210eb'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:34.143152 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 966/1924] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 01:05:34.184729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9a1a02bb-6243-4023-b30e-f185659dfb0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e73835522d2402b93387591a33210eb'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:34.185492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9a1a02bb-6243-4023-b30e-f185659dfb0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e73835522d2402b93387591a33210eb'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:34.215405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 959/1925] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:33 2022] DELETE /identity/v3/users/7e73835522d2402b93387591a33210eb => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:05:34.272398 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab6e89-8478-4538-9e64-eb7659ca5cd7 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:34.274773 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ffab6e89-8478-4538-9e64-eb7659ca5cd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:34.292879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab6e89-8478-4538-9e64-eb7659ca5cd7 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:34.437101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434ab61-44c0-4182-9e8b-4b3ad7ba375f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:34.437778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434ab61-44c0-4182-9e8b-4b3ad7ba375f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:34.438675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434ab61-44c0-4182-9e8b-4b3ad7ba375f admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:34.438881 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434ab61-44c0-4182-9e8b-4b3ad7ba375f admin admin] PATH_INFO: `/v3/projects/e44cc4bd9e154e318ac1de1b290af03c` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:34.442242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434ab61-44c0-4182-9e8b-4b3ad7ba375f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e44cc4bd9e154e318ac1de1b290af03c)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:34.444899 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434ab61-44c0-4182-9e8b-4b3ad7ba375f admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:34.464481 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a02bb-6243-4023-b30e-f185659dfb0c admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:34.465944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9a1a02bb-6243-4023-b30e-f185659dfb0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:34.489248 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a02bb-6243-4023-b30e-f185659dfb0c admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:34.499252 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616938e2-0172-46e5-9f3c-035af4f5a1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:34.499905 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616938e2-0172-46e5-9f3c-035af4f5a1a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:34.500181 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616938e2-0172-46e5-9f3c-035af4f5a1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:34.501069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616938e2-0172-46e5-9f3c-035af4f5a1a9 admin admin] PATH_INFO: `/v3/users/f3d15693a664439880615fe65a0016a8` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:34.502478 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616938e2-0172-46e5-9f3c-035af4f5a1a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3d15693a664439880615fe65a0016a8)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:34.504442 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616938e2-0172-46e5-9f3c-035af4f5a1a9 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:34.552765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3434ab61-44c0-4182-9e8b-4b3ad7ba375f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e44cc4bd9e154e318ac1de1b290af03c', 'request_id': 'req-3434ab61-44c0-4182-9e8b-4b3ad7ba375f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:34.563019 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3434ab61-44c0-4182-9e8b-4b3ad7ba375f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e44cc4bd9e154e318ac1de1b290af03c', 'request_id': 'req-3434ab61-44c0-4182-9e8b-4b3ad7ba375f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:34.590780 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3434ab61-44c0-4182-9e8b-4b3ad7ba375f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e44cc4bd9e154e318ac1de1b290af03c', 'request_id': 'req-3434ab61-44c0-4182-9e8b-4b3ad7ba375f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:34.611974 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3434ab61-44c0-4182-9e8b-4b3ad7ba375f admin admin] The token cache is being invalidate because project e44cc4bd9e154e318ac1de1b290af03c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:34.612789 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3434ab61-44c0-4182-9e8b-4b3ad7ba375f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:34.613895 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3434ab61-44c0-4182-9e8b-4b3ad7ba375f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:34.615706 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-616938e2-0172-46e5-9f3c-035af4f5a1a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3d15693a664439880615fe65a0016a8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:34.616638 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-616938e2-0172-46e5-9f3c-035af4f5a1a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3d15693a664439880615fe65a0016a8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:34.617054 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 967/1926] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:34 2022] DELETE /identity/v3/projects/e44cc4bd9e154e318ac1de1b290af03c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:34.624898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a699c4f-7752-4c29-9867-82ddae646aa0 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:34.626090 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a699c4f-7752-4c29-9867-82ddae646aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:34.626637 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a699c4f-7752-4c29-9867-82ddae646aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:34.641285 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-616938e2-0172-46e5-9f3c-035af4f5a1a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3d15693a664439880615fe65a0016a8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:34.651481 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:DELETE=20,keystone:SELECT=79,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:34.669760 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-616938e2-0172-46e5-9f3c-035af4f5a1a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3d15693a664439880615fe65a0016a8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:34.670707 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-616938e2-0172-46e5-9f3c-035af4f5a1a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3d15693a664439880615fe65a0016a8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:34.689295 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-4a699c4f-7752-4c29-9867-82ddae646aa0 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:34.690794 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 960/1927] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:34 2022] DELETE /identity/v3/users/f3d15693a664439880615fe65a0016a8 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:34.692614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4a699c4f-7752-4c29-9867-82ddae646aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:34.695440 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599176af-6828-40db-85c0-02954dae1da1 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:34.695731 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599176af-6828-40db-85c0-02954dae1da1 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:34.696406 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599176af-6828-40db-85c0-02954dae1da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:34.724257 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-599176af-6828-40db-85c0-02954dae1da1 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:34.725659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-599176af-6828-40db-85c0-02954dae1da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:34.774495 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:34.857617 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 961/1928] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:34.863572 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 968/1929] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:05:34.870660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea2d13-df12-4b28-81ff-a9f471f8227d None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:34.871622 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea2d13-df12-4b28-81ff-a9f471f8227d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:34.871910 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea2d13-df12-4b28-81ff-a9f471f8227d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:34.896371 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a699c4f-7752-4c29-9867-82ddae646aa0 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:34.899953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4a699c4f-7752-4c29-9867-82ddae646aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:34.917477 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-0eea2d13-df12-4b28-81ff-a9f471f8227d None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:34.920428 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-0eea2d13-df12-4b28-81ff-a9f471f8227d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:34.941955 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 962/1930] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:34.945940 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea2d13-df12-4b28-81ff-a9f471f8227d None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:34.965488 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea2d13-df12-4b28-81ff-a9f471f8227d None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:34.972050 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec661ec0-b814-4fbe-9357-10f1480772b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:34.972717 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec661ec0-b814-4fbe-9357-10f1480772b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:34.972999 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec661ec0-b814-4fbe-9357-10f1480772b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:34.973376 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec661ec0-b814-4fbe-9357-10f1480772b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:34.974187 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec661ec0-b814-4fbe-9357-10f1480772b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:05:34.974606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec661ec0-b814-4fbe-9357-10f1480772b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:34.976221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec661ec0-b814-4fbe-9357-10f1480772b2 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:35.005825 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 963/1931] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:05:35.005825 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec661ec0-b814-4fbe-9357-10f1480772b2 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:35.033231 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec661ec0-b814-4fbe-9357-10f1480772b2 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:35.037056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a699c4f-7752-4c29-9867-82ddae646aa0 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:35.039938 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b0626-23a1-462c-95b4-42ff1450abda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:35.040445 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b0626-23a1-462c-95b4-42ff1450abda admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:35.040839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b0626-23a1-462c-95b4-42ff1450abda admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:35.041107 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b0626-23a1-462c-95b4-42ff1450abda admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:35.041841 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b0626-23a1-462c-95b4-42ff1450abda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:35.046322 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b0626-23a1-462c-95b4-42ff1450abda admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:35.052853 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc19bfd-6ebe-405b-a282-ff0ce47eb044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:35.054903 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc19bfd-6ebe-405b-a282-ff0ce47eb044 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:35.055261 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc19bfd-6ebe-405b-a282-ff0ce47eb044 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:35.068906 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc19bfd-6ebe-405b-a282-ff0ce47eb044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:35.118660 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc19bfd-6ebe-405b-a282-ff0ce47eb044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:35.130823 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc19bfd-6ebe-405b-a282-ff0ce47eb044 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:35.146897 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 969/1932] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 01:05:35.164065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 964/1933] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:34 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:35.165712 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc19bfd-6ebe-405b-a282-ff0ce47eb044 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:35.169156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-adc19bfd-6ebe-405b-a282-ff0ce47eb044 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:35.169646 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b0626-23a1-462c-95b4-42ff1450abda admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:35.188991 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc19bfd-6ebe-405b-a282-ff0ce47eb044 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:35.327334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b0626-23a1-462c-95b4-42ff1450abda admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:35.335242 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db54dc7-a602-4b67-8dce-ac493fff344f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:35.336024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db54dc7-a602-4b67-8dce-ac493fff344f admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:35.336435 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db54dc7-a602-4b67-8dce-ac493fff344f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:35.337296 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db54dc7-a602-4b67-8dce-ac493fff344f admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:35.337415 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db54dc7-a602-4b67-8dce-ac493fff344f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:35.341499 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db54dc7-a602-4b67-8dce-ac493fff344f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:35.388629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 965/1934] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:35 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:05:35.389624 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db54dc7-a602-4b67-8dce-ac493fff344f admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:35.393585 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3db54dc7-a602-4b67-8dce-ac493fff344f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:35.409275 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649d427-271d-4806-9fa0-83d5c0e657da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:35.412515 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649d427-271d-4806-9fa0-83d5c0e657da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:35.412805 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649d427-271d-4806-9fa0-83d5c0e657da admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:35.413105 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649d427-271d-4806-9fa0-83d5c0e657da admin admin] PATH_INFO: `/v3/projects/471a5b802a8844d295f40988da5441bd` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:35.418348 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db54dc7-a602-4b67-8dce-ac493fff344f admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:35.420304 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649d427-271d-4806-9fa0-83d5c0e657da admin admin] RBAC: Authorizing `identity:delete_project(project_id=471a5b802a8844d295f40988da5441bd)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:35.426292 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649d427-271d-4806-9fa0-83d5c0e657da admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:35.432595 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117edc63-84a3-4961-9b6a-61024e7d6f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:35.435482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117edc63-84a3-4961-9b6a-61024e7d6f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:35.436206 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117edc63-84a3-4961-9b6a-61024e7d6f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:35.436945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117edc63-84a3-4961-9b6a-61024e7d6f0b admin admin] PATH_INFO: `/v3/projects/0f6478f30db14189940c15b17b6ecc9b` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:35.442005 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117edc63-84a3-4961-9b6a-61024e7d6f0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f6478f30db14189940c15b17b6ecc9b)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:35.447733 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117edc63-84a3-4961-9b6a-61024e7d6f0b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:35.492928 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:35.532178 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-117edc63-84a3-4961-9b6a-61024e7d6f0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f6478f30db14189940c15b17b6ecc9b', 'request_id': 'req-117edc63-84a3-4961-9b6a-61024e7d6f0b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:35.541510 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0649d427-271d-4806-9fa0-83d5c0e657da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '471a5b802a8844d295f40988da5441bd', 'request_id': 'req-0649d427-271d-4806-9fa0-83d5c0e657da'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:35.545906 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-117edc63-84a3-4961-9b6a-61024e7d6f0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f6478f30db14189940c15b17b6ecc9b', 'request_id': 'req-117edc63-84a3-4961-9b6a-61024e7d6f0b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:35.557077 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0649d427-271d-4806-9fa0-83d5c0e657da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '471a5b802a8844d295f40988da5441bd', 'request_id': 'req-0649d427-271d-4806-9fa0-83d5c0e657da'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:35.560488 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-117edc63-84a3-4961-9b6a-61024e7d6f0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f6478f30db14189940c15b17b6ecc9b', 'request_id': 'req-117edc63-84a3-4961-9b6a-61024e7d6f0b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:35.566280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0649d427-271d-4806-9fa0-83d5c0e657da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '471a5b802a8844d295f40988da5441bd', 'request_id': 'req-0649d427-271d-4806-9fa0-83d5c0e657da'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:35.590288 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-117edc63-84a3-4961-9b6a-61024e7d6f0b admin admin] The token cache is being invalidate because project 0f6478f30db14189940c15b17b6ecc9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:35.590630 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-117edc63-84a3-4961-9b6a-61024e7d6f0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:35.591320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-117edc63-84a3-4961-9b6a-61024e7d6f0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:35.593608 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 966/1935] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:35 2022] DELETE /identity/v3/projects/0f6478f30db14189940c15b17b6ecc9b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:35.594963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117edc63-84a3-4961-9b6a-61024e7d6f0b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:35.597201 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-117edc63-84a3-4961-9b6a-61024e7d6f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:35.599045 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0649d427-271d-4806-9fa0-83d5c0e657da admin admin] The token cache is being invalidate because project 471a5b802a8844d295f40988da5441bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:35.599557 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0649d427-271d-4806-9fa0-83d5c0e657da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:35.600252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0649d427-271d-4806-9fa0-83d5c0e657da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:35.602039 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 970/1936] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:35 2022] DELETE /identity/v3/projects/471a5b802a8844d295f40988da5441bd => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:35.604939 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606573e-6c50-41d1-972b-a3f1a689b5ac None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:35.604939 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606573e-6c50-41d1-972b-a3f1a689b5ac None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:35.604939 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606573e-6c50-41d1-972b-a3f1a689b5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:35.626007 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:35.636794 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-c606573e-6c50-41d1-972b-a3f1a689b5ac None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:35.638535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c606573e-6c50-41d1-972b-a3f1a689b5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:35.702875 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117edc63-84a3-4961-9b6a-61024e7d6f0b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:35.722452 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 971/1937] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:35.724130 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606573e-6c50-41d1-972b-a3f1a689b5ac None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:35.726091 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c606573e-6c50-41d1-972b-a3f1a689b5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:35.743762 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606573e-6c50-41d1-972b-a3f1a689b5ac None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:35.758089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c05e80-08a4-4772-83db-32fc3c9ef954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:35.758730 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c05e80-08a4-4772-83db-32fc3c9ef954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:35.759006 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c05e80-08a4-4772-83db-32fc3c9ef954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:35.759274 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c05e80-08a4-4772-83db-32fc3c9ef954 admin admin] PATH_INFO: `/v3/projects/48993d72ac2a41dabc5210bfb318f5e4` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:35.761191 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c05e80-08a4-4772-83db-32fc3c9ef954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48993d72ac2a41dabc5210bfb318f5e4)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:35.763627 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c05e80-08a4-4772-83db-32fc3c9ef954 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:35.770197 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69e00d-aa6a-4d68-a3a4-bf08a7eb7e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:35.770919 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69e00d-aa6a-4d68-a3a4-bf08a7eb7e35 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:35.771265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69e00d-aa6a-4d68-a3a4-bf08a7eb7e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:35.771621 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69e00d-aa6a-4d68-a3a4-bf08a7eb7e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:35.772268 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69e00d-aa6a-4d68-a3a4-bf08a7eb7e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:35.774218 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69e00d-aa6a-4d68-a3a4-bf08a7eb7e35 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:35.784657 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 967/1938] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:35.787519 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69e00d-aa6a-4d68-a3a4-bf08a7eb7e35 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:35.789416 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-db69e00d-aa6a-4d68-a3a4-bf08a7eb7e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:35.807896 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69e00d-aa6a-4d68-a3a4-bf08a7eb7e35 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:35.821792 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-39c05e80-08a4-4772-83db-32fc3c9ef954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48993d72ac2a41dabc5210bfb318f5e4', 'request_id': 'req-39c05e80-08a4-4772-83db-32fc3c9ef954'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:35.832409 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-39c05e80-08a4-4772-83db-32fc3c9ef954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48993d72ac2a41dabc5210bfb318f5e4', 'request_id': 'req-39c05e80-08a4-4772-83db-32fc3c9ef954'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:35.840443 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-39c05e80-08a4-4772-83db-32fc3c9ef954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48993d72ac2a41dabc5210bfb318f5e4', 'request_id': 'req-39c05e80-08a4-4772-83db-32fc3c9ef954'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:35.852124 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-39c05e80-08a4-4772-83db-32fc3c9ef954 admin admin] The token cache is being invalidate because project 48993d72ac2a41dabc5210bfb318f5e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:35.852409 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-39c05e80-08a4-4772-83db-32fc3c9ef954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:35.853585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-39c05e80-08a4-4772-83db-32fc3c9ef954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:35.854837 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 972/1939] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:35 2022] DELETE /identity/v3/projects/48993d72ac2a41dabc5210bfb318f5e4 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:35.856098 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e684fe3-55e8-4043-af8f-56b30e702281 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:35.856382 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e684fe3-55e8-4043-af8f-56b30e702281 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:35.856651 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e684fe3-55e8-4043-af8f-56b30e702281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:35.867487 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:35.876807 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfee75b-2fd6-4a85-aa11-c0aac991a32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:35.878063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfee75b-2fd6-4a85-aa11-c0aac991a32d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:35.878381 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-1e684fe3-55e8-4043-af8f-56b30e702281 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:35.879077 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfee75b-2fd6-4a85-aa11-c0aac991a32d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:35.879644 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1e684fe3-55e8-4043-af8f-56b30e702281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:35.880326 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfee75b-2fd6-4a85-aa11-c0aac991a32d admin admin] PATH_INFO: `/v3/users/1088e9ec9dae4775a70b6649646bfb4a` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:35.882023 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfee75b-2fd6-4a85-aa11-c0aac991a32d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1088e9ec9dae4775a70b6649646bfb4a)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:35.884707 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfee75b-2fd6-4a85-aa11-c0aac991a32d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:35.888253 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 973/1940] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:35.889409 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e684fe3-55e8-4043-af8f-56b30e702281 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:35.893017 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1e684fe3-55e8-4043-af8f-56b30e702281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:35.907787 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e684fe3-55e8-4043-af8f-56b30e702281 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:35.914841 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8d9c4-5fc1-48d5-9260-a664bfe9b55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:35.915343 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8d9c4-5fc1-48d5-9260-a664bfe9b55c admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:35.915707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8d9c4-5fc1-48d5-9260-a664bfe9b55c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:35.915979 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8d9c4-5fc1-48d5-9260-a664bfe9b55c admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:35.916675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8d9c4-5fc1-48d5-9260-a664bfe9b55c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:35.918305 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8d9c4-5fc1-48d5-9260-a664bfe9b55c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:35.934618 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 974/1941] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:35.934618 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8d9c4-5fc1-48d5-9260-a664bfe9b55c admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:35.939286 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-eba8d9c4-5fc1-48d5-9260-a664bfe9b55c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:35.949199 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-bcfee75b-2fd6-4a85-aa11-c0aac991a32d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1088e9ec9dae4775a70b6649646bfb4a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:35.950847 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-bcfee75b-2fd6-4a85-aa11-c0aac991a32d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1088e9ec9dae4775a70b6649646bfb4a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:35.954445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8d9c4-5fc1-48d5-9260-a664bfe9b55c admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:35.959568 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-bcfee75b-2fd6-4a85-aa11-c0aac991a32d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1088e9ec9dae4775a70b6649646bfb4a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:35.960539 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3057874-3a98-4ea9-a847-f039c94b6bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:35.961182 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3057874-3a98-4ea9-a847-f039c94b6bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:35.961460 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3057874-3a98-4ea9-a847-f039c94b6bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:35.961732 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3057874-3a98-4ea9-a847-f039c94b6bc5 admin admin] PATH_INFO: `/v3/users/bec09e19bf5d401aad0dd56e0ac2f3c8` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:35.962908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3057874-3a98-4ea9-a847-f039c94b6bc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bec09e19bf5d401aad0dd56e0ac2f3c8)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:35.965134 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3057874-3a98-4ea9-a847-f039c94b6bc5 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:35.976444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-bcfee75b-2fd6-4a85-aa11-c0aac991a32d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1088e9ec9dae4775a70b6649646bfb4a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:35.978534 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-bcfee75b-2fd6-4a85-aa11-c0aac991a32d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1088e9ec9dae4775a70b6649646bfb4a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:36.005496 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 968/1942] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:35 2022] DELETE /identity/v3/users/1088e9ec9dae4775a70b6649646bfb4a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:36.006695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfee75b-2fd6-4a85-aa11-c0aac991a32d admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:36.008318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-bcfee75b-2fd6-4a85-aa11-c0aac991a32d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:36.076253 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b3057874-3a98-4ea9-a847-f039c94b6bc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bec09e19bf5d401aad0dd56e0ac2f3c8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:36.086295 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b3057874-3a98-4ea9-a847-f039c94b6bc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bec09e19bf5d401aad0dd56e0ac2f3c8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:36.098534 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:36.108884 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b3057874-3a98-4ea9-a847-f039c94b6bc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bec09e19bf5d401aad0dd56e0ac2f3c8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:36.110727 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b3057874-3a98-4ea9-a847-f039c94b6bc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bec09e19bf5d401aad0dd56e0ac2f3c8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:36.112912 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b3057874-3a98-4ea9-a847-f039c94b6bc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bec09e19bf5d401aad0dd56e0ac2f3c8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:36.136822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 975/1943] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:35 2022] DELETE /identity/v3/users/bec09e19bf5d401aad0dd56e0ac2f3c8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:36.138286 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3057874-3a98-4ea9-a847-f039c94b6bc5 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:36.140020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b3057874-3a98-4ea9-a847-f039c94b6bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:36.189185 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfee75b-2fd6-4a85-aa11-c0aac991a32d admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:36.223985 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3057874-3a98-4ea9-a847-f039c94b6bc5 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:36.229532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61766bad-a903-405e-8be0-949c8dee9b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:36.230377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61766bad-a903-405e-8be0-949c8dee9b83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:36.231071 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61766bad-a903-405e-8be0-949c8dee9b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:36.231071 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61766bad-a903-405e-8be0-949c8dee9b83 admin admin] PATH_INFO: `/v3/projects/2723239ff67b4ee1a8cb16b700f7ecdb/users/abad14e930a34629b9ac41790e7a82f5/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:36.247796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61766bad-a903-405e-8be0-949c8dee9b83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2723239ff67b4ee1a8cb16b700f7ecdb, user_id=abad14e930a34629b9ac41790e7a82f5, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:36.250969 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61766bad-a903-405e-8be0-949c8dee9b83 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:36.283357 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 976/1944] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:36 2022] PUT /identity/v3/projects/2723239ff67b4ee1a8cb16b700f7ecdb/users/abad14e930a34629b9ac41790e7a82f5/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:36.295524 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbf8ab-f863-4c2b-bb51-4c312d641d90 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:36.295893 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbf8ab-f863-4c2b-bb51-4c312d641d90 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:36.296101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbf8ab-f863-4c2b-bb51-4c312d641d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:36.324567 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a978116-305a-4a9b-830e-c665a86d4451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:36.326451 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a978116-305a-4a9b-830e-c665a86d4451 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:36.327217 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a978116-305a-4a9b-830e-c665a86d4451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:36.327938 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a978116-305a-4a9b-830e-c665a86d4451 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:36.328863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a978116-305a-4a9b-830e-c665a86d4451 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:05:36.328982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-0dcbf8ab-f863-4c2b-bb51-4c312d641d90 None None] MFA Rules not processed for user `abad14e930a34629b9ac41790e7a82f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:36.329501 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a978116-305a-4a9b-830e-c665a86d4451 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:36.330354 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0dcbf8ab-f863-4c2b-bb51-4c312d641d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:36.331941 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a978116-305a-4a9b-830e-c665a86d4451 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:36.350979 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 969/1945] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:05:36.375680 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a978116-305a-4a9b-830e-c665a86d4451 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:36.392370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7a978116-305a-4a9b-830e-c665a86d4451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:36.411389 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a978116-305a-4a9b-830e-c665a86d4451 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:36.434673 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 977/1946] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:36.436407 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:36.443117 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbf8ab-f863-4c2b-bb51-4c312d641d90 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:36.446542 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0dcbf8ab-f863-4c2b-bb51-4c312d641d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:36.511424 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9fd15-6d88-4da6-9fcb-0e20d8ac0284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:36.512214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9fd15-6d88-4da6-9fcb-0e20d8ac0284 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:36.512491 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9fd15-6d88-4da6-9fcb-0e20d8ac0284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:36.512816 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9fd15-6d88-4da6-9fcb-0e20d8ac0284 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:36.513467 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9fd15-6d88-4da6-9fcb-0e20d8ac0284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:36.515410 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9fd15-6d88-4da6-9fcb-0e20d8ac0284 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:36.526773 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbf8ab-f863-4c2b-bb51-4c312d641d90 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:36.534953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de684bba-f064-48bf-a838-1548c70f5788 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:36.535584 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de684bba-f064-48bf-a838-1548c70f5788 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:36.536042 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de684bba-f064-48bf-a838-1548c70f5788 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:36.536222 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de684bba-f064-48bf-a838-1548c70f5788 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:36.545517 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de684bba-f064-48bf-a838-1548c70f5788 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:36.547778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de684bba-f064-48bf-a838-1548c70f5788 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:36.553294 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:36.560024 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 978/1947] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:36.571788 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 970/1948] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:36 2022] POST /identity/v3/projects => generated 401 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:36.575942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de684bba-f064-48bf-a838-1548c70f5788 service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:36.589907 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de684bba-f064-48bf-a838-1548c70f5788 service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:36.670540 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb16c6-195c-4005-8467-b9424d3acec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:36.671935 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb16c6-195c-4005-8467-b9424d3acec7 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:36.672264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb16c6-195c-4005-8467-b9424d3acec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:36.672661 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb16c6-195c-4005-8467-b9424d3acec7 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:36.673358 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb16c6-195c-4005-8467-b9424d3acec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:36.677435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb16c6-195c-4005-8467-b9424d3acec7 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:36.712892 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 979/1949] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:36 2022] POST /identity/v3/users => generated 301 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:36.714725 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9fd15-6d88-4da6-9fcb-0e20d8ac0284 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:36.716427 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-92c9fd15-6d88-4da6-9fcb-0e20d8ac0284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:36.732429 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb16c6-195c-4005-8467-b9424d3acec7 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:36.744525 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9fd15-6d88-4da6-9fcb-0e20d8ac0284 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:36.753947 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb16c6-195c-4005-8467-b9424d3acec7 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:36.761828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fde296-7464-482b-aeba-c00d280b1655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:36.762648 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fde296-7464-482b-aeba-c00d280b1655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:36.762925 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fde296-7464-482b-aeba-c00d280b1655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:36.763193 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fde296-7464-482b-aeba-c00d280b1655 admin admin] PATH_INFO: `/v3/projects/592ffc31cdb945f497ac6fbd486d7244` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:36.764707 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fde296-7464-482b-aeba-c00d280b1655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=592ffc31cdb945f497ac6fbd486d7244)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:36.768548 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fde296-7464-482b-aeba-c00d280b1655 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:36.794709 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977357de-05b7-4400-9a71-18c9698199e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:36.795528 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977357de-05b7-4400-9a71-18c9698199e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:36.795974 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977357de-05b7-4400-9a71-18c9698199e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:36.796376 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977357de-05b7-4400-9a71-18c9698199e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:36.797249 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977357de-05b7-4400-9a71-18c9698199e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:36.801933 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977357de-05b7-4400-9a71-18c9698199e5 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:36.822872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 980/1950] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:36.824604 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977357de-05b7-4400-9a71-18c9698199e5 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:36.827831 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-977357de-05b7-4400-9a71-18c9698199e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:36.846794 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977357de-05b7-4400-9a71-18c9698199e5 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:36.861507 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-95fde296-7464-482b-aeba-c00d280b1655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '592ffc31cdb945f497ac6fbd486d7244', 'request_id': 'req-95fde296-7464-482b-aeba-c00d280b1655'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:36.875069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-95fde296-7464-482b-aeba-c00d280b1655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '592ffc31cdb945f497ac6fbd486d7244', 'request_id': 'req-95fde296-7464-482b-aeba-c00d280b1655'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:36.886802 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-95fde296-7464-482b-aeba-c00d280b1655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '592ffc31cdb945f497ac6fbd486d7244', 'request_id': 'req-95fde296-7464-482b-aeba-c00d280b1655'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:36.910668 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-95fde296-7464-482b-aeba-c00d280b1655 admin admin] The token cache is being invalidate because project 592ffc31cdb945f497ac6fbd486d7244 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:36.911391 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-95fde296-7464-482b-aeba-c00d280b1655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:36.913873 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-95fde296-7464-482b-aeba-c00d280b1655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:36.923150 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 971/1951] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:36 2022] DELETE /identity/v3/projects/592ffc31cdb945f497ac6fbd486d7244 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:36.924400 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fde296-7464-482b-aeba-c00d280b1655 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:36.930611 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-95fde296-7464-482b-aeba-c00d280b1655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:36.965083 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6c635-c6fc-489f-b33d-f65da21134f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:36.965740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6c635-c6fc-489f-b33d-f65da21134f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:36.966087 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6c635-c6fc-489f-b33d-f65da21134f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:36.966373 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6c635-c6fc-489f-b33d-f65da21134f9 admin admin] PATH_INFO: `/v3/projects/7e72e05ea7af4697b414ad7eeca427e6` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:36.967858 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6c635-c6fc-489f-b33d-f65da21134f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e72e05ea7af4697b414ad7eeca427e6)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:36.970053 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6c635-c6fc-489f-b33d-f65da21134f9 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:37.103136 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-54d6c635-c6fc-489f-b33d-f65da21134f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e72e05ea7af4697b414ad7eeca427e6', 'request_id': 'req-54d6c635-c6fc-489f-b33d-f65da21134f9'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:37.116089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fde296-7464-482b-aeba-c00d280b1655 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:37.127939 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-54d6c635-c6fc-489f-b33d-f65da21134f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e72e05ea7af4697b414ad7eeca427e6', 'request_id': 'req-54d6c635-c6fc-489f-b33d-f65da21134f9'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:37.153725 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-54d6c635-c6fc-489f-b33d-f65da21134f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e72e05ea7af4697b414ad7eeca427e6', 'request_id': 'req-54d6c635-c6fc-489f-b33d-f65da21134f9'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:37.189790 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:37.209433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-54d6c635-c6fc-489f-b33d-f65da21134f9 admin admin] The token cache is being invalidate because project 7e72e05ea7af4697b414ad7eeca427e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:37.209782 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-54d6c635-c6fc-489f-b33d-f65da21134f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:37.211256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-54d6c635-c6fc-489f-b33d-f65da21134f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:37.215504 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 981/1952] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:36 2022] DELETE /identity/v3/projects/7e72e05ea7af4697b414ad7eeca427e6 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:37.223701 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df22f44-2f0b-41c5-b9a0-71c856596fe8 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:37.224009 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df22f44-2f0b-41c5-b9a0-71c856596fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:37.224278 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df22f44-2f0b-41c5-b9a0-71c856596fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:37.279761 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ff958-34f2-4736-8ad4-1b01b2d7b223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:37.280425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ff958-34f2-4736-8ad4-1b01b2d7b223 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:37.280786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ff958-34f2-4736-8ad4-1b01b2d7b223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:37.281029 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ff958-34f2-4736-8ad4-1b01b2d7b223 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:37.282105 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ff958-34f2-4736-8ad4-1b01b2d7b223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:37.301489 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-0df22f44-2f0b-41c5-b9a0-71c856596fe8 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:37.302772 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0df22f44-2f0b-41c5-b9a0-71c856596fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:37.303358 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ff958-34f2-4736-8ad4-1b01b2d7b223 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:37.334483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 982/1953] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:37.335885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cfa3b-120b-4ea0-af11-163084dd436d None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:37.336170 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cfa3b-120b-4ea0-af11-163084dd436d None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:37.336445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cfa3b-120b-4ea0-af11-163084dd436d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:37.348822 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 972/1954] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:37.349528 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b47db-b44e-4132-a57c-f9ecb6f24405 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:37.349867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b47db-b44e-4132-a57c-f9ecb6f24405 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:37.352079 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b47db-b44e-4132-a57c-f9ecb6f24405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:37.352290 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:37.376800 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-650cfa3b-120b-4ea0-af11-163084dd436d None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:37.378518 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-650cfa3b-120b-4ea0-af11-163084dd436d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:37.387886 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 983/1955] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:37.388892 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650cfa3b-120b-4ea0-af11-163084dd436d None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:37.390191 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-650cfa3b-120b-4ea0-af11-163084dd436d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:37.404762 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650cfa3b-120b-4ea0-af11-163084dd436d None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:37.409741 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b7b46-0265-46ca-b1af-6ade332560fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:37.410630 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b7b46-0265-46ca-b1af-6ade332560fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:37.411316 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b7b46-0265-46ca-b1af-6ade332560fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:37.411316 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b7b46-0265-46ca-b1af-6ade332560fa admin admin] PATH_INFO: `/v3/projects/bdb959d7b1274f6cb8798eadf09d3d1c/users/1d2ddc06c375418aa9f673f9c99a6ad5/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:37.426394 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-180b47db-b44e-4132-a57c-f9ecb6f24405 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:37.428889 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-180b47db-b44e-4132-a57c-f9ecb6f24405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:37.440173 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b7b46-0265-46ca-b1af-6ade332560fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdb959d7b1274f6cb8798eadf09d3d1c, user_id=1d2ddc06c375418aa9f673f9c99a6ad5, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:37.444724 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b7b46-0265-46ca-b1af-6ade332560fa admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:37.449769 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 973/1956] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:37.451198 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a924cd-a084-4b4d-9f5d-1b88a8c99e42 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:37.451472 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a924cd-a084-4b4d-9f5d-1b88a8c99e42 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:37.451846 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a924cd-a084-4b4d-9f5d-1b88a8c99e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:37.478503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-e0a924cd-a084-4b4d-9f5d-1b88a8c99e42 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:37.479963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e0a924cd-a084-4b4d-9f5d-1b88a8c99e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:37.491488 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 984/1957] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:37 2022] PUT /identity/v3/projects/bdb959d7b1274f6cb8798eadf09d3d1c/users/1d2ddc06c375418aa9f673f9c99a6ad5/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:37.495302 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b7b46-0265-46ca-b1af-6ade332560fa admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:37.565620 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 974/1958] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:37.567455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab56da0-d5ec-450d-a43f-3ff402cc2683 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:37.567840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab56da0-d5ec-450d-a43f-3ff402cc2683 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:37.569578 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab56da0-d5ec-450d-a43f-3ff402cc2683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:37.602164 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-9ab56da0-d5ec-450d-a43f-3ff402cc2683 None None] MFA Rules not processed for user `1d2ddc06c375418aa9f673f9c99a6ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:37.603433 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9ab56da0-d5ec-450d-a43f-3ff402cc2683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:37.627328 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b7b46-0265-46ca-b1af-6ade332560fa admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:37.639073 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44d2a4-796f-44a3-b049-b42ea7ec1384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:37.639945 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44d2a4-796f-44a3-b049-b42ea7ec1384 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:37.642346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44d2a4-796f-44a3-b049-b42ea7ec1384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:37.643109 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44d2a4-796f-44a3-b049-b42ea7ec1384 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:37.645070 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44d2a4-796f-44a3-b049-b42ea7ec1384 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:05:37.645269 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44d2a4-796f-44a3-b049-b42ea7ec1384 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:37.648302 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44d2a4-796f-44a3-b049-b42ea7ec1384 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:37.696376 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 985/1959] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:05:37.696376 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44d2a4-796f-44a3-b049-b42ea7ec1384 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:37.714359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44d2a4-796f-44a3-b049-b42ea7ec1384 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:37.730220 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155c891-be76-45f0-886e-022e91a168fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:37.730848 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155c891-be76-45f0-886e-022e91a168fe admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:37.731133 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155c891-be76-45f0-886e-022e91a168fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:37.731409 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155c891-be76-45f0-886e-022e91a168fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:37.732062 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155c891-be76-45f0-886e-022e91a168fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:05:37.733249 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155c891-be76-45f0-886e-022e91a168fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:37.741244 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 975/1960] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:37 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:37.741428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155c891-be76-45f0-886e-022e91a168fe admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:37.741505 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab56da0-d5ec-450d-a43f-3ff402cc2683 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:37.760762 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 986/1961] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:05:37.763391 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155c891-be76-45f0-886e-022e91a168fe admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:37.778607 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab56da0-d5ec-450d-a43f-3ff402cc2683 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:37.786718 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b011328-45d2-4779-b8b5-cc2c875af514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:37.787816 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b011328-45d2-4779-b8b5-cc2c875af514 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:37.788298 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b011328-45d2-4779-b8b5-cc2c875af514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:37.789231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155c891-be76-45f0-886e-022e91a168fe admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:37.789750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b011328-45d2-4779-b8b5-cc2c875af514 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:37.791334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b011328-45d2-4779-b8b5-cc2c875af514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:37.794388 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b011328-45d2-4779-b8b5-cc2c875af514 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:37.794989 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d822a86-49a1-443a-81da-3797235ffce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:37.798268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d822a86-49a1-443a-81da-3797235ffce4 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:37.799031 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d822a86-49a1-443a-81da-3797235ffce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:37.799467 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d822a86-49a1-443a-81da-3797235ffce4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:37.800846 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d822a86-49a1-443a-81da-3797235ffce4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:37.808523 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d822a86-49a1-443a-81da-3797235ffce4 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:37.850339 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 976/1962] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:37 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:37.852416 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b011328-45d2-4779-b8b5-cc2c875af514 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:37.857275 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 987/1963] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:37 2022] POST /identity/v3/projects => generated 401 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:37.859260 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d822a86-49a1-443a-81da-3797235ffce4 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:37.917240 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:37.990579 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d822a86-49a1-443a-81da-3797235ffce4 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:37.991949 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b011328-45d2-4779-b8b5-cc2c875af514 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:37.996873 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a73ba-9809-4778-8376-f3d5748eb2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:37.997539 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a73ba-9809-4778-8376-f3d5748eb2ba admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:37.997843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a73ba-9809-4778-8376-f3d5748eb2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:37.998175 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a73ba-9809-4778-8376-f3d5748eb2ba admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:37.998871 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a73ba-9809-4778-8376-f3d5748eb2ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:38.001066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a73ba-9809-4778-8376-f3d5748eb2ba admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:38.005833 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31c2d6-5600-44b5-bb7e-0a641fb28023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:38.006462 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31c2d6-5600-44b5-bb7e-0a641fb28023 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:38.006742 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31c2d6-5600-44b5-bb7e-0a641fb28023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:38.007556 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31c2d6-5600-44b5-bb7e-0a641fb28023 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:38.008273 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31c2d6-5600-44b5-bb7e-0a641fb28023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:38.012831 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31c2d6-5600-44b5-bb7e-0a641fb28023 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:38.033608 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 988/1964] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:37 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:38.034737 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a73ba-9809-4778-8376-f3d5748eb2ba admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:38.048999 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a73ba-9809-4778-8376-f3d5748eb2ba admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:38.066560 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee4332-a6b3-44c7-b6cb-720ae51aae40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:38.067968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee4332-a6b3-44c7-b6cb-720ae51aae40 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:38.068779 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee4332-a6b3-44c7-b6cb-720ae51aae40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:38.069063 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee4332-a6b3-44c7-b6cb-720ae51aae40 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:38.069850 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee4332-a6b3-44c7-b6cb-720ae51aae40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:38.071855 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee4332-a6b3-44c7-b6cb-720ae51aae40 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:38.082637 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 977/1965] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:37 2022] POST /identity/v3/projects => generated 379 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:38.083582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31c2d6-5600-44b5-bb7e-0a641fb28023 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:38.124823 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 989/1966] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:38 2022] POST /identity/v3/users => generated 307 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:38.126846 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee4332-a6b3-44c7-b6cb-720ae51aae40 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:38.134278 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:38.142124 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee4332-a6b3-44c7-b6cb-720ae51aae40 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:38.238637 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31c2d6-5600-44b5-bb7e-0a641fb28023 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:38.241078 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a106f02-e53a-46bd-889d-22ea4ac255e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:38.241858 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a106f02-e53a-46bd-889d-22ea4ac255e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:38.242253 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a106f02-e53a-46bd-889d-22ea4ac255e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:38.242966 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a106f02-e53a-46bd-889d-22ea4ac255e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:38.243569 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a106f02-e53a-46bd-889d-22ea4ac255e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:38.244463 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875436e6-fcbe-4dc4-a131-99dbbff04f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:38.244683 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875436e6-fcbe-4dc4-a131-99dbbff04f4e admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:38.244965 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875436e6-fcbe-4dc4-a131-99dbbff04f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:38.245237 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875436e6-fcbe-4dc4-a131-99dbbff04f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:38.245920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875436e6-fcbe-4dc4-a131-99dbbff04f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:38.246122 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a106f02-e53a-46bd-889d-22ea4ac255e0 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:38.247728 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875436e6-fcbe-4dc4-a131-99dbbff04f4e admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:38.265241 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 978/1967] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:38.265241 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875436e6-fcbe-4dc4-a131-99dbbff04f4e admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:38.277266 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875436e6-fcbe-4dc4-a131-99dbbff04f4e admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:38.279426 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 990/1968] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:38 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:38.280435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a106f02-e53a-46bd-889d-22ea4ac255e0 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:38.287281 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c23c2-bb1c-4247-bc35-1198255b5f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:38.287904 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c23c2-bb1c-4247-bc35-1198255b5f62 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:38.288184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c23c2-bb1c-4247-bc35-1198255b5f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:38.290039 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c23c2-bb1c-4247-bc35-1198255b5f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:38.290835 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c23c2-bb1c-4247-bc35-1198255b5f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:38.294240 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c23c2-bb1c-4247-bc35-1198255b5f62 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:38.296595 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a106f02-e53a-46bd-889d-22ea4ac255e0 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:38.316026 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 979/1969] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:38.317069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c23c2-bb1c-4247-bc35-1198255b5f62 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:38.324039 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810c752-fbbe-486c-be87-9ab4c761bc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:38.326659 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810c752-fbbe-486c-be87-9ab4c761bc8d admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:38.327176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810c752-fbbe-486c-be87-9ab4c761bc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:38.327511 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810c752-fbbe-486c-be87-9ab4c761bc8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:38.328240 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810c752-fbbe-486c-be87-9ab4c761bc8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:38.332735 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c23c2-bb1c-4247-bc35-1198255b5f62 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:38.334673 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810c752-fbbe-486c-be87-9ab4c761bc8d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:38.340799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74700304-0b59-4104-b4ed-6ea76572aff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:38.341494 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74700304-0b59-4104-b4ed-6ea76572aff2 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:38.342110 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74700304-0b59-4104-b4ed-6ea76572aff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:38.342597 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74700304-0b59-4104-b4ed-6ea76572aff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:38.344592 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74700304-0b59-4104-b4ed-6ea76572aff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:38.349028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 991/1970] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:38.349913 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74700304-0b59-4104-b4ed-6ea76572aff2 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:38.350405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810c752-fbbe-486c-be87-9ab4c761bc8d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:38.368613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810c752-fbbe-486c-be87-9ab4c761bc8d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:38.379085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e168850-c129-47c8-a20e-79686fec6075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:38.380043 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e168850-c129-47c8-a20e-79686fec6075 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:38.380501 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e168850-c129-47c8-a20e-79686fec6075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:38.381693 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e168850-c129-47c8-a20e-79686fec6075 admin admin] PATH_INFO: `/v3/projects/9cb5d14b8700464da4c9c82f4dc6f98c/users/29610e5c567c4beab761f71f628ee2fa/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:38.385579 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 980/1971] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:38.388093 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74700304-0b59-4104-b4ed-6ea76572aff2 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:38.420506 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e168850-c129-47c8-a20e-79686fec6075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb5d14b8700464da4c9c82f4dc6f98c, user_id=29610e5c567c4beab761f71f628ee2fa, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:38.423354 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e168850-c129-47c8-a20e-79686fec6075 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:38.439032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74700304-0b59-4104-b4ed-6ea76572aff2 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:38.455102 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 992/1972] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:38 2022] PUT /identity/v3/projects/9cb5d14b8700464da4c9c82f4dc6f98c/users/29610e5c567c4beab761f71f628ee2fa/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:38.459070 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e168850-c129-47c8-a20e-79686fec6075 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:38.464907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c574d-0647-4f80-bc5f-b72fb95ab150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:38.466853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c574d-0647-4f80-bc5f-b72fb95ab150 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:38.472755 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c574d-0647-4f80-bc5f-b72fb95ab150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:38.473473 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c574d-0647-4f80-bc5f-b72fb95ab150 admin admin] PATH_INFO: `/v3/projects/e00c1bb347eb48ec9498e47bdb3541ac/users/832b461a5ffd4ef18b984e04c6c5c62d/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:38.501399 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c574d-0647-4f80-bc5f-b72fb95ab150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e00c1bb347eb48ec9498e47bdb3541ac, user_id=832b461a5ffd4ef18b984e04c6c5c62d, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:38.504265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c574d-0647-4f80-bc5f-b72fb95ab150 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:38.549737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 981/1973] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:38 2022] PUT /identity/v3/projects/e00c1bb347eb48ec9498e47bdb3541ac/users/832b461a5ffd4ef18b984e04c6c5c62d/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:38.553254 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c574d-0647-4f80-bc5f-b72fb95ab150 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:38.602819 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e168850-c129-47c8-a20e-79686fec6075 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:38.680084 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c574d-0647-4f80-bc5f-b72fb95ab150 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:38.689022 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2237735-0ee3-46fd-94d4-5f495f807893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:38.689633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2237735-0ee3-46fd-94d4-5f495f807893 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:38.690156 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2237735-0ee3-46fd-94d4-5f495f807893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:38.690426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2237735-0ee3-46fd-94d4-5f495f807893 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:38.692376 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2237735-0ee3-46fd-94d4-5f495f807893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:38.694088 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2237735-0ee3-46fd-94d4-5f495f807893 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:38.706487 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:38.718031 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 982/1974] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:38.722857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87e490-757f-43ba-a538-b62d1a793000 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:38.723145 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87e490-757f-43ba-a538-b62d1a793000 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:38.723411 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87e490-757f-43ba-a538-b62d1a793000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:38.727650 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58191395-eb5d-4642-b36c-8abeb4465166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:38.728321 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58191395-eb5d-4642-b36c-8abeb4465166 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:38.728641 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58191395-eb5d-4642-b36c-8abeb4465166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:38.728977 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58191395-eb5d-4642-b36c-8abeb4465166 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:38.729636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58191395-eb5d-4642-b36c-8abeb4465166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:38.731274 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58191395-eb5d-4642-b36c-8abeb4465166 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:38.756210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:38.783918 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 993/1975] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:38.786680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58191395-eb5d-4642-b36c-8abeb4465166 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:38.812986 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-8e87e490-757f-43ba-a538-b62d1a793000 None None] MFA Rules not processed for user `832b461a5ffd4ef18b984e04c6c5c62d`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:38.815797 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8e87e490-757f-43ba-a538-b62d1a793000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:38.825022 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58191395-eb5d-4642-b36c-8abeb4465166 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:38.840701 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c2607-5bf2-4615-b30e-c2835c558b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:38.841392 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c2607-5bf2-4615-b30e-c2835c558b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:38.847513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c2607-5bf2-4615-b30e-c2835c558b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:38.847842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c2607-5bf2-4615-b30e-c2835c558b05 admin admin] PATH_INFO: `/v3/projects/9cb5d14b8700464da4c9c82f4dc6f98c/users/29610e5c567c4beab761f71f628ee2fa/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:38.852607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c2607-5bf2-4615-b30e-c2835c558b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb5d14b8700464da4c9c82f4dc6f98c, user_id=29610e5c567c4beab761f71f628ee2fa, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:38.863738 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c2607-5bf2-4615-b30e-c2835c558b05 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:38.920694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 994/1976] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:38 2022] PUT /identity/v3/projects/9cb5d14b8700464da4c9c82f4dc6f98c/users/29610e5c567c4beab761f71f628ee2fa/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:38.923526 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c2607-5bf2-4615-b30e-c2835c558b05 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:38.989780 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 983/1977] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:38.993192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4214c2-d85a-4159-a896-d9500398ba0f None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:38.993501 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4214c2-d85a-4159-a896-d9500398ba0f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:38.994269 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4214c2-d85a-4159-a896-d9500398ba0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:39.011562 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c2607-5bf2-4615-b30e-c2835c558b05 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:39.018290 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb00ce-4bb7-4480-b0ec-133ea116dfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:39.019380 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb00ce-4bb7-4480-b0ec-133ea116dfca admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:39.019621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb00ce-4bb7-4480-b0ec-133ea116dfca admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:39.019960 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb00ce-4bb7-4480-b0ec-133ea116dfca admin admin] PATH_INFO: `/v3/projects/23fc26b63cc24c178e1dae92ca19526a/users/bdb61ca3f4364046a8cec8b782fcf4b7/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:39.038151 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb00ce-4bb7-4480-b0ec-133ea116dfca admin admin] RBAC: Authorizing `identity:create_grant(project_id=23fc26b63cc24c178e1dae92ca19526a, user_id=bdb61ca3f4364046a8cec8b782fcf4b7, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:39.040189 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-eb4214c2-d85a-4159-a896-d9500398ba0f None None] MFA Rules not processed for user `29610e5c567c4beab761f71f628ee2fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:39.041256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb00ce-4bb7-4480-b0ec-133ea116dfca admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:39.041736 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-eb4214c2-d85a-4159-a896-d9500398ba0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:39.069851 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 995/1978] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:38 2022] PUT /identity/v3/projects/23fc26b63cc24c178e1dae92ca19526a/users/bdb61ca3f4364046a8cec8b782fcf4b7/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:39.071026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb00ce-4bb7-4480-b0ec-133ea116dfca admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:39.073131 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-facb00ce-4bb7-4480-b0ec-133ea116dfca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:39.136335 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 984/1979] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:38 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:39.137698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc74f7-414a-4218-96ef-502c155e6bf4 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:39.138087 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc74f7-414a-4218-96ef-502c155e6bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:39.138411 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc74f7-414a-4218-96ef-502c155e6bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:39.146852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb00ce-4bb7-4480-b0ec-133ea116dfca admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:39.150976 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a00d2e-2818-4e15-95dc-6252aefc859a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:39.151677 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a00d2e-2818-4e15-95dc-6252aefc859a service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:39.152155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a00d2e-2818-4e15-95dc-6252aefc859a service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:39.152516 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a00d2e-2818-4e15-95dc-6252aefc859a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:39.174164 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-6bbc74f7-414a-4218-96ef-502c155e6bf4 None None] MFA Rules not processed for user `bdb61ca3f4364046a8cec8b782fcf4b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:39.175598 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6bbc74f7-414a-4218-96ef-502c155e6bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:39.226122 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a00d2e-2818-4e15-95dc-6252aefc859a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:39.228161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a00d2e-2818-4e15-95dc-6252aefc859a service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:39.242935 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 996/1980] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:39.243645 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a00d2e-2818-4e15-95dc-6252aefc859a service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:39.245142 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-81a00d2e-2818-4e15-95dc-6252aefc859a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:39.258592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a00d2e-2818-4e15-95dc-6252aefc859a service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:39.259066 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 985/1981] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:39.263585 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc74f7-414a-4218-96ef-502c155e6bf4 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:39.263896 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54caeb96-4416-4a95-8e94-3ff724628519 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:39.264880 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caeb96-4416-4a95-8e94-3ff724628519 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:39.265347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caeb96-4416-4a95-8e94-3ff724628519 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:39.266048 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caeb96-4416-4a95-8e94-3ff724628519 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:39.270654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:39.296846 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:39.345987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc74f7-414a-4218-96ef-502c155e6bf4 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:39.347839 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54caeb96-4416-4a95-8e94-3ff724628519 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:39.349273 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54caeb96-4416-4a95-8e94-3ff724628519 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:39.351667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44973f-cdbe-4ee9-9727-9c34820edb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:39.352660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44973f-cdbe-4ee9-9727-9c34820edb83 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:39.352660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44973f-cdbe-4ee9-9727-9c34820edb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:39.352832 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44973f-cdbe-4ee9-9727-9c34820edb83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:39.353505 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44973f-cdbe-4ee9-9727-9c34820edb83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:39.355465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44973f-cdbe-4ee9-9727-9c34820edb83 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:39.362998 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 997/1982] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:39 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:39.390339 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 986/1983] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:39 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:05:39.394292 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54caeb96-4416-4a95-8e94-3ff724628519 service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:39.411269 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54caeb96-4416-4a95-8e94-3ff724628519 service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:39.492461 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f7f84-993e-4a27-962e-273d7e72e5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:39.493202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f7f84-993e-4a27-962e-273d7e72e5e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:39.493584 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f7f84-993e-4a27-962e-273d7e72e5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:39.494025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f7f84-993e-4a27-962e-273d7e72e5e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:39.494969 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f7f84-993e-4a27-962e-273d7e72e5e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:39.497249 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f7f84-993e-4a27-962e-273d7e72e5e6 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:39.533978 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 998/1984] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:39 2022] POST /identity/v3/users => generated 296 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:39.535977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44973f-cdbe-4ee9-9727-9c34820edb83 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:39.542434 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f7f84-993e-4a27-962e-273d7e72e5e6 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:39.556832 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f7f84-993e-4a27-962e-273d7e72e5e6 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:39.562425 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d903d-a074-4cc0-aaff-15131b642fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:39.563318 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d903d-a074-4cc0-aaff-15131b642fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:39.563735 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d903d-a074-4cc0-aaff-15131b642fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:39.564011 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d903d-a074-4cc0-aaff-15131b642fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:39.564762 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d903d-a074-4cc0-aaff-15131b642fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:39.567121 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d903d-a074-4cc0-aaff-15131b642fd5 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:39.580972 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 999/1985] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 01:05:39.586230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d903d-a074-4cc0-aaff-15131b642fd5 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:39.619267 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d903d-a074-4cc0-aaff-15131b642fd5 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:39.624978 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3e837-e0cf-412b-ae67-7ba1a5895a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:39.625744 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3e837-e0cf-412b-ae67-7ba1a5895a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:39.626399 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3e837-e0cf-412b-ae67-7ba1a5895a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:39.626761 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3e837-e0cf-412b-ae67-7ba1a5895a7a admin admin] PATH_INFO: `/v3/projects/4b2db7fc2bf34f78ba752260ec8a47c0/users/3979395a42044ed79a6e58296d736bb5/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:39.646033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44973f-cdbe-4ee9-9727-9c34820edb83 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:39.647477 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd3e837-e0cf-412b-ae67-7ba1a5895a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b2db7fc2bf34f78ba752260ec8a47c0, user_id=3979395a42044ed79a6e58296d736bb5, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:39.650260 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd3e837-e0cf-412b-ae67-7ba1a5895a7a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:39.650762 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a01ed-8bc9-4505-93e8-f65f5a9b4914 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:39.651628 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a01ed-8bc9-4505-93e8-f65f5a9b4914 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:39.652004 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a01ed-8bc9-4505-93e8-f65f5a9b4914 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:39.652379 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a01ed-8bc9-4505-93e8-f65f5a9b4914 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:39.673048 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1000/1986] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:39 2022] PUT /identity/v3/projects/4b2db7fc2bf34f78ba752260ec8a47c0/users/3979395a42044ed79a6e58296d736bb5/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:39.677830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3e837-e0cf-412b-ae67-7ba1a5895a7a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:39.723333 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a01ed-8bc9-4505-93e8-f65f5a9b4914 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:39.724793 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a01ed-8bc9-4505-93e8-f65f5a9b4914 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:39.735472 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 987/1987] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:39 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:39.749774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3e837-e0cf-412b-ae67-7ba1a5895a7a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:39.755139 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e7e86-ca18-460d-a9b1-fbc554c613ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:39.755767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e7e86-ca18-460d-a9b1-fbc554c613ee admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:39.756045 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e7e86-ca18-460d-a9b1-fbc554c613ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:39.756317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e7e86-ca18-460d-a9b1-fbc554c613ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:39.756971 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e7e86-ca18-460d-a9b1-fbc554c613ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:39.758745 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e7e86-ca18-460d-a9b1-fbc554c613ee admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:39.771320 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1001/1988] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:39.775788 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a01ed-8bc9-4505-93e8-f65f5a9b4914 service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:39.789396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a01ed-8bc9-4505-93e8-f65f5a9b4914 service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:39.795013 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f66cd4-0088-4f7f-abd1-6f2db0bdb3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:39.795768 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f66cd4-0088-4f7f-abd1-6f2db0bdb3a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:39.796121 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f66cd4-0088-4f7f-abd1-6f2db0bdb3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:39.796464 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f66cd4-0088-4f7f-abd1-6f2db0bdb3a4 admin admin] PATH_INFO: `/v3/projects/4b2db7fc2bf34f78ba752260ec8a47c0/users/3979395a42044ed79a6e58296d736bb5/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:39.799976 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f66cd4-0088-4f7f-abd1-6f2db0bdb3a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b2db7fc2bf34f78ba752260ec8a47c0, user_id=3979395a42044ed79a6e58296d736bb5, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:39.803523 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f66cd4-0088-4f7f-abd1-6f2db0bdb3a4 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:39.821842 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 988/1989] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:39 2022] PUT /identity/v3/projects/4b2db7fc2bf34f78ba752260ec8a47c0/users/3979395a42044ed79a6e58296d736bb5/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:05:39.830098 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f01a39-b6a2-4415-8ab5-99a8dbecb4ad None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:39.830739 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f01a39-b6a2-4415-8ab5-99a8dbecb4ad None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:39.831274 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f01a39-b6a2-4415-8ab5-99a8dbecb4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:39.854904 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:39.864923 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-22f01a39-b6a2-4415-8ab5-99a8dbecb4ad None None] MFA Rules not processed for user `3979395a42044ed79a6e58296d736bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:39.866150 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-22f01a39-b6a2-4415-8ab5-99a8dbecb4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:40.036539 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1002/1990] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:39 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:40.160799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f66cd4-0088-4f7f-abd1-6f2db0bdb3a4 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:40.254341 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:40.317530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f66cd4-0088-4f7f-abd1-6f2db0bdb3a4 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:40.321422 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876029a7-1369-4c5e-9097-a3552f8d8826 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:40.322213 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876029a7-1369-4c5e-9097-a3552f8d8826 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:40.322495 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876029a7-1369-4c5e-9097-a3552f8d8826 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:40.322916 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876029a7-1369-4c5e-9097-a3552f8d8826 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:40.334974 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876029a7-1369-4c5e-9097-a3552f8d8826 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:40.336673 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876029a7-1369-4c5e-9097-a3552f8d8826 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:40.347735 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 989/1991] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:40 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:40.784029 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f01a39-b6a2-4415-8ab5-99a8dbecb4ad None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:40.799039 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f01a39-b6a2-4415-8ab5-99a8dbecb4ad None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:40.806375 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb805ef-782c-4bce-80f6-c25820d3eb50 tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3979395a42044ed79a6e58296d736bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b2db7fc2bf34f78ba752260ec8a47c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:40.807369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb805ef-782c-4bce-80f6-c25820d3eb50 tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:40.807713 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb805ef-782c-4bce-80f6-c25820d3eb50 tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:40.808093 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb805ef-782c-4bce-80f6-c25820d3eb50 tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:40.809978 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb805ef-782c-4bce-80f6-c25820d3eb50 tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:05:40.809978 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb805ef-782c-4bce-80f6-c25820d3eb50 tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:40.811999 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb805ef-782c-4bce-80f6-c25820d3eb50 tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:40.826962 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1003/1992] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:05:40.831987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876029a7-1369-4c5e-9097-a3552f8d8826 service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:40.847008 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876029a7-1369-4c5e-9097-a3552f8d8826 service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:40.852037 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1eba1f-7d8c-4365-b600-ab7df4556178 tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3979395a42044ed79a6e58296d736bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b2db7fc2bf34f78ba752260ec8a47c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:40.852733 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1eba1f-7d8c-4365-b600-ab7df4556178 tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:40.853088 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1eba1f-7d8c-4365-b600-ab7df4556178 tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:40.853433 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1eba1f-7d8c-4365-b600-ab7df4556178 tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:40.854198 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1eba1f-7d8c-4365-b600-ab7df4556178 tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:40.856471 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1eba1f-7d8c-4365-b600-ab7df4556178 tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:40.893638 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 990/1993] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:40 2022] POST /identity/v3/projects => generated 355 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:40.895385 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb805ef-782c-4bce-80f6-c25820d3eb50 tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:40.908241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb805ef-782c-4bce-80f6-c25820d3eb50 tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:40.983559 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9be90-e16f-45c6-87a6-99d5590dfbd7 tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3979395a42044ed79a6e58296d736bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b2db7fc2bf34f78ba752260ec8a47c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:40.984340 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9be90-e16f-45c6-87a6-99d5590dfbd7 tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:40.985365 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9be90-e16f-45c6-87a6-99d5590dfbd7 tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:40.985697 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9be90-e16f-45c6-87a6-99d5590dfbd7 tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:40.986535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9be90-e16f-45c6-87a6-99d5590dfbd7 tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:05:40.986742 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9be90-e16f-45c6-87a6-99d5590dfbd7 tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:40.988771 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9be90-e16f-45c6-87a6-99d5590dfbd7 tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:41.006390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1004/1994] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:05:41.044512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1eba1f-7d8c-4365-b600-ab7df4556178 tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:41.055664 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1eba1f-7d8c-4365-b600-ab7df4556178 tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:41.060227 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba573175-3310-4d7d-a1a5-94a301689bdc tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3979395a42044ed79a6e58296d736bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b2db7fc2bf34f78ba752260ec8a47c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:41.060852 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba573175-3310-4d7d-a1a5-94a301689bdc tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:41.061661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba573175-3310-4d7d-a1a5-94a301689bdc tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:41.061661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba573175-3310-4d7d-a1a5-94a301689bdc tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] PATH_INFO: `/v3/projects/52aa8c8897a848b5a9c10754a02e4a97` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:41.062587 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba573175-3310-4d7d-a1a5-94a301689bdc tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] RBAC: Authorizing `identity:delete_project(project_id=52aa8c8897a848b5a9c10754a02e4a97)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:41.065124 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba573175-3310-4d7d-a1a5-94a301689bdc tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:41.112518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ba573175-3310-4d7d-a1a5-94a301689bdc tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52aa8c8897a848b5a9c10754a02e4a97', 'request_id': 'req-ba573175-3310-4d7d-a1a5-94a301689bdc'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:41.121426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ba573175-3310-4d7d-a1a5-94a301689bdc tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52aa8c8897a848b5a9c10754a02e4a97', 'request_id': 'req-ba573175-3310-4d7d-a1a5-94a301689bdc'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:41.129120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ba573175-3310-4d7d-a1a5-94a301689bdc tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52aa8c8897a848b5a9c10754a02e4a97', 'request_id': 'req-ba573175-3310-4d7d-a1a5-94a301689bdc'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:41.141347 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ba573175-3310-4d7d-a1a5-94a301689bdc tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] The token cache is being invalidate because project 52aa8c8897a848b5a9c10754a02e4a97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:41.141672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ba573175-3310-4d7d-a1a5-94a301689bdc tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:41.142370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ba573175-3310-4d7d-a1a5-94a301689bdc tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:41.144094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 991/1995] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:41 2022] DELETE /identity/v3/projects/52aa8c8897a848b5a9c10754a02e4a97 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:41.409443 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9be90-e16f-45c6-87a6-99d5590dfbd7 tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:41.411901 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-69d9be90-e16f-45c6-87a6-99d5590dfbd7 tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:41.487859 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9be90-e16f-45c6-87a6-99d5590dfbd7 tempest-VolumeQuotaClassesTest-297455826 tempest-VolumeQuotaClassesTest-297455826-project-admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:41.507609 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:41.550306 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259b15c-b950-49b9-b7dd-5261a27fdf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:41.551104 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259b15c-b950-49b9-b7dd-5261a27fdf39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:41.551490 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259b15c-b950-49b9-b7dd-5261a27fdf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:41.551739 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259b15c-b950-49b9-b7dd-5261a27fdf39 admin admin] PATH_INFO: `/v3/users/bdb61ca3f4364046a8cec8b782fcf4b7` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:41.552996 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259b15c-b950-49b9-b7dd-5261a27fdf39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdb61ca3f4364046a8cec8b782fcf4b7)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:41.554991 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259b15c-b950-49b9-b7dd-5261a27fdf39 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:41.606554 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1259b15c-b950-49b9-b7dd-5261a27fdf39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdb61ca3f4364046a8cec8b782fcf4b7'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:41.617009 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1259b15c-b950-49b9-b7dd-5261a27fdf39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdb61ca3f4364046a8cec8b782fcf4b7'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:41.631651 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1259b15c-b950-49b9-b7dd-5261a27fdf39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdb61ca3f4364046a8cec8b782fcf4b7'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:41.632436 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1259b15c-b950-49b9-b7dd-5261a27fdf39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdb61ca3f4364046a8cec8b782fcf4b7'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:41.633022 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1259b15c-b950-49b9-b7dd-5261a27fdf39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdb61ca3f4364046a8cec8b782fcf4b7'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:41.645650 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1005/1996] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:41 2022] DELETE /identity/v3/users/bdb61ca3f4364046a8cec8b782fcf4b7 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:41.650930 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f9e34-4d66-4fd8-b688-fae04fb2cfc6 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:41.651431 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f9e34-4d66-4fd8-b688-fae04fb2cfc6 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:41.651739 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f9e34-4d66-4fd8-b688-fae04fb2cfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:41.673166 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-9a6f9e34-4d66-4fd8-b688-fae04fb2cfc6 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:41.674436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9a6f9e34-4d66-4fd8-b688-fae04fb2cfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:41.733412 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 992/1997] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:41.743477 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259b15c-b950-49b9-b7dd-5261a27fdf39 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:41.745519 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1259b15c-b950-49b9-b7dd-5261a27fdf39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:41.803040 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259b15c-b950-49b9-b7dd-5261a27fdf39 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:41.806735 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8ba8a-cb2a-4489-b5e4-2565492befd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:41.807362 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8ba8a-cb2a-4489-b5e4-2565492befd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:41.807645 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8ba8a-cb2a-4489-b5e4-2565492befd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:41.807919 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8ba8a-cb2a-4489-b5e4-2565492befd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:41.817235 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8ba8a-cb2a-4489-b5e4-2565492befd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:41.818640 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8ba8a-cb2a-4489-b5e4-2565492befd8 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:41.829193 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1006/1998] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 01:05:42.271510 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f9e34-4d66-4fd8-b688-fae04fb2cfc6 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:42.273055 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9a6f9e34-4d66-4fd8-b688-fae04fb2cfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:42.298808 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f9e34-4d66-4fd8-b688-fae04fb2cfc6 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:42.318820 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0346e-0027-47f9-9542-f05baa69e752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:42.319628 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0346e-0027-47f9-9542-f05baa69e752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:42.319909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0346e-0027-47f9-9542-f05baa69e752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:42.320185 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0346e-0027-47f9-9542-f05baa69e752 admin admin] PATH_INFO: `/v3/projects/23fc26b63cc24c178e1dae92ca19526a` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:42.321330 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0346e-0027-47f9-9542-f05baa69e752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23fc26b63cc24c178e1dae92ca19526a)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:42.323376 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0346e-0027-47f9-9542-f05baa69e752 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:42.374207 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:42.398235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-89c0346e-0027-47f9-9542-f05baa69e752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23fc26b63cc24c178e1dae92ca19526a', 'request_id': 'req-89c0346e-0027-47f9-9542-f05baa69e752'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:42.409972 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-89c0346e-0027-47f9-9542-f05baa69e752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23fc26b63cc24c178e1dae92ca19526a', 'request_id': 'req-89c0346e-0027-47f9-9542-f05baa69e752'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:42.435090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-89c0346e-0027-47f9-9542-f05baa69e752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23fc26b63cc24c178e1dae92ca19526a', 'request_id': 'req-89c0346e-0027-47f9-9542-f05baa69e752'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:42.447611 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-89c0346e-0027-47f9-9542-f05baa69e752 admin admin] The token cache is being invalidate because project 23fc26b63cc24c178e1dae92ca19526a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:42.448041 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-89c0346e-0027-47f9-9542-f05baa69e752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:42.448859 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-89c0346e-0027-47f9-9542-f05baa69e752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:42.454316 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 993/1999] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:42 2022] DELETE /identity/v3/projects/23fc26b63cc24c178e1dae92ca19526a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:42.455129 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8ba8a-cb2a-4489-b5e4-2565492befd8 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:42.468507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8ba8a-cb2a-4489-b5e4-2565492befd8 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:42.526280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:42.548066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8f61d-788a-4435-8af4-ad951c51543d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:42.548855 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8f61d-788a-4435-8af4-ad951c51543d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:42.549259 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8f61d-788a-4435-8af4-ad951c51543d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:42.549821 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8f61d-788a-4435-8af4-ad951c51543d admin admin] PATH_INFO: `/v3/users/3979395a42044ed79a6e58296d736bb5` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:42.550895 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8f61d-788a-4435-8af4-ad951c51543d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3979395a42044ed79a6e58296d736bb5)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:42.552788 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8f61d-788a-4435-8af4-ad951c51543d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:42.626582 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d9b8f61d-788a-4435-8af4-ad951c51543d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3979395a42044ed79a6e58296d736bb5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:42.638718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d9b8f61d-788a-4435-8af4-ad951c51543d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3979395a42044ed79a6e58296d736bb5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:42.656481 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d9b8f61d-788a-4435-8af4-ad951c51543d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3979395a42044ed79a6e58296d736bb5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:42.656481 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d9b8f61d-788a-4435-8af4-ad951c51543d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3979395a42044ed79a6e58296d736bb5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:42.656752 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d9b8f61d-788a-4435-8af4-ad951c51543d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3979395a42044ed79a6e58296d736bb5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:42.680528 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1007/2000] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:42 2022] DELETE /identity/v3/users/3979395a42044ed79a6e58296d736bb5 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:05:43.073076 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0346e-0027-47f9-9542-f05baa69e752 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:43.083224 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-89c0346e-0027-47f9-9542-f05baa69e752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:43.101843 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0346e-0027-47f9-9542-f05baa69e752 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:43.202125 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182471f4-2a9d-4098-b6f6-f1473f134eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:43.202842 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182471f4-2a9d-4098-b6f6-f1473f134eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:43.203716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182471f4-2a9d-4098-b6f6-f1473f134eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:43.204080 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182471f4-2a9d-4098-b6f6-f1473f134eb8 admin admin] PATH_INFO: `/v3/projects/4b2db7fc2bf34f78ba752260ec8a47c0` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:43.205241 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182471f4-2a9d-4098-b6f6-f1473f134eb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b2db7fc2bf34f78ba752260ec8a47c0)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:43.207191 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182471f4-2a9d-4098-b6f6-f1473f134eb8 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:43.254895 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-182471f4-2a9d-4098-b6f6-f1473f134eb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b2db7fc2bf34f78ba752260ec8a47c0', 'request_id': 'req-182471f4-2a9d-4098-b6f6-f1473f134eb8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:43.262383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-182471f4-2a9d-4098-b6f6-f1473f134eb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b2db7fc2bf34f78ba752260ec8a47c0', 'request_id': 'req-182471f4-2a9d-4098-b6f6-f1473f134eb8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:43.270032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-182471f4-2a9d-4098-b6f6-f1473f134eb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b2db7fc2bf34f78ba752260ec8a47c0', 'request_id': 'req-182471f4-2a9d-4098-b6f6-f1473f134eb8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:43.282871 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-182471f4-2a9d-4098-b6f6-f1473f134eb8 admin admin] The token cache is being invalidate because project 4b2db7fc2bf34f78ba752260ec8a47c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:43.283159 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-182471f4-2a9d-4098-b6f6-f1473f134eb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:43.283984 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-182471f4-2a9d-4098-b6f6-f1473f134eb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:43.286254 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 994/2001] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:43 2022] DELETE /identity/v3/projects/4b2db7fc2bf34f78ba752260ec8a47c0 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:43.292047 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e46728-0fbd-4b19-b76d-4b7dbb844d12 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:43.293310 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e46728-0fbd-4b19-b76d-4b7dbb844d12 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:43.293978 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e46728-0fbd-4b19-b76d-4b7dbb844d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:43.324337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-46e46728-0fbd-4b19-b76d-4b7dbb844d12 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:43.325699 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-46e46728-0fbd-4b19-b76d-4b7dbb844d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:43.399724 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1008/2002] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:43.407863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bbbb6-4ff2-4f57-bfb5-5a98d3383144 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:43.408126 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bbbb6-4ff2-4f57-bfb5-5a98d3383144 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:43.408399 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bbbb6-4ff2-4f57-bfb5-5a98d3383144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:43.431799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-af2bbbb6-4ff2-4f57-bfb5-5a98d3383144 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:43.433202 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-af2bbbb6-4ff2-4f57-bfb5-5a98d3383144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:43.442554 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 995/2003] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:05:43.447097 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e46728-0fbd-4b19-b76d-4b7dbb844d12 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:43.459314 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e46728-0fbd-4b19-b76d-4b7dbb844d12 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:43.464424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e67ab-603d-4baf-88cf-4aa60194f613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:43.465354 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e67ab-603d-4baf-88cf-4aa60194f613 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:43.465756 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e67ab-603d-4baf-88cf-4aa60194f613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:43.466235 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e67ab-603d-4baf-88cf-4aa60194f613 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:43.467165 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e67ab-603d-4baf-88cf-4aa60194f613 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:05:43.467531 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e67ab-603d-4baf-88cf-4aa60194f613 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:43.469342 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e67ab-603d-4baf-88cf-4aa60194f613 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:43.482871 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1009/2004] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:05:43.488225 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2bbbb6-4ff2-4f57-bfb5-5a98d3383144 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:43.497994 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2bbbb6-4ff2-4f57-bfb5-5a98d3383144 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:43.509870 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f8607-8a41-4a8c-87ab-8cbf3038cac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:43.511188 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f8607-8a41-4a8c-87ab-8cbf3038cac4 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:43.512039 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f8607-8a41-4a8c-87ab-8cbf3038cac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:43.512652 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f8607-8a41-4a8c-87ab-8cbf3038cac4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:43.513706 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f8607-8a41-4a8c-87ab-8cbf3038cac4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:43.515798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f8607-8a41-4a8c-87ab-8cbf3038cac4 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:43.557822 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 996/2005] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:43 2022] POST /identity/v3/projects => generated 409 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:43.561195 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e67ab-603d-4baf-88cf-4aa60194f613 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:43.572207 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e67ab-603d-4baf-88cf-4aa60194f613 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:43.627144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:43.639501 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6895d-a0a9-4ef7-9abf-3828d376c5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:43.640153 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6895d-a0a9-4ef7-9abf-3828d376c5f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:43.640543 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6895d-a0a9-4ef7-9abf-3828d376c5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:43.640984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6895d-a0a9-4ef7-9abf-3828d376c5f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:43.641659 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6895d-a0a9-4ef7-9abf-3828d376c5f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:43.643618 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6895d-a0a9-4ef7-9abf-3828d376c5f5 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:43.669654 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1010/2006] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:43 2022] POST /identity/v3/users => generated 305 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:43.674467 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f8607-8a41-4a8c-87ab-8cbf3038cac4 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:43.685075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f8607-8a41-4a8c-87ab-8cbf3038cac4 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:43.690156 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc59efd-8e2e-4289-8589-cecbb171dd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:43.690787 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc59efd-8e2e-4289-8589-cecbb171dd2e admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:43.691066 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc59efd-8e2e-4289-8589-cecbb171dd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:43.691363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc59efd-8e2e-4289-8589-cecbb171dd2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:43.692006 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc59efd-8e2e-4289-8589-cecbb171dd2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:43.693591 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc59efd-8e2e-4289-8589-cecbb171dd2e admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:43.704880 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 997/2007] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:43.708801 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6895d-a0a9-4ef7-9abf-3828d376c5f5 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:43.719445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6895d-a0a9-4ef7-9abf-3828d376c5f5 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:43.723989 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b83fa-e982-42b5-8bcf-082ef37210c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:43.724580 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b83fa-e982-42b5-8bcf-082ef37210c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:43.724854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b83fa-e982-42b5-8bcf-082ef37210c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:43.725126 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b83fa-e982-42b5-8bcf-082ef37210c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:43.725755 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b83fa-e982-42b5-8bcf-082ef37210c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:43.727352 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b83fa-e982-42b5-8bcf-082ef37210c3 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:43.738289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1011/2008] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:43.742189 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc59efd-8e2e-4289-8589-cecbb171dd2e admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:43.751783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc59efd-8e2e-4289-8589-cecbb171dd2e admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:43.756340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5878cd-6f9f-429d-9f67-b2420fd79da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:43.756964 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5878cd-6f9f-429d-9f67-b2420fd79da5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:43.757236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5878cd-6f9f-429d-9f67-b2420fd79da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:43.757499 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5878cd-6f9f-429d-9f67-b2420fd79da5 admin admin] PATH_INFO: `/v3/projects/bdecd08792804c07a46e8c28ac3e6c08/users/574e79885b4e4949be961dcc38613edd/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:43.760812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:43.774192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5878cd-6f9f-429d-9f67-b2420fd79da5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdecd08792804c07a46e8c28ac3e6c08, user_id=574e79885b4e4949be961dcc38613edd, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:43.777116 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5878cd-6f9f-429d-9f67-b2420fd79da5 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:43.790725 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 998/2009] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:43 2022] PUT /identity/v3/projects/bdecd08792804c07a46e8c28ac3e6c08/users/574e79885b4e4949be961dcc38613edd/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:05:43.802547 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe75b9c-b6c1-4195-9af7-2928b8acef97 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:43.802832 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe75b9c-b6c1-4195-9af7-2928b8acef97 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:43.803106 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe75b9c-b6c1-4195-9af7-2928b8acef97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:43.830197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-1fe75b9c-b6c1-4195-9af7-2928b8acef97 None None] MFA Rules not processed for user `574e79885b4e4949be961dcc38613edd`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:43.831455 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1fe75b9c-b6c1-4195-9af7-2928b8acef97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:43.893888 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1012/2010] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:43 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:43.898516 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5878cd-6f9f-429d-9f67-b2420fd79da5 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:43.960627 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5878cd-6f9f-429d-9f67-b2420fd79da5 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:43.965422 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee3e8c-8ed8-4fa2-a5d8-320aab200b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:43.965899 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee3e8c-8ed8-4fa2-a5d8-320aab200b84 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:43.966173 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee3e8c-8ed8-4fa2-a5d8-320aab200b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:43.966436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee3e8c-8ed8-4fa2-a5d8-320aab200b84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:43.967075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee3e8c-8ed8-4fa2-a5d8-320aab200b84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:43.969662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee3e8c-8ed8-4fa2-a5d8-320aab200b84 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:44.003105 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 999/2011] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:43 2022] POST /identity/v3/projects => generated 409 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:44.007498 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe75b9c-b6c1-4195-9af7-2928b8acef97 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:44.018834 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe75b9c-b6c1-4195-9af7-2928b8acef97 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:44.076474 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d0d5d-d952-41af-b882-a22a66e744f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:44.077404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d0d5d-d952-41af-b882-a22a66e744f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:44.077732 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d0d5d-d952-41af-b882-a22a66e744f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:44.078057 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d0d5d-d952-41af-b882-a22a66e744f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:44.079216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d0d5d-d952-41af-b882-a22a66e744f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:44.081115 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d0d5d-d952-41af-b882-a22a66e744f9 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:44.105587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1013/2012] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:44 2022] POST /identity/v3/users => generated 311 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:44.110148 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee3e8c-8ed8-4fa2-a5d8-320aab200b84 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:44.123880 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee3e8c-8ed8-4fa2-a5d8-320aab200b84 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:44.130192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5a989-ceb7-4830-9f9d-e92f1064f8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:44.130803 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5a989-ceb7-4830-9f9d-e92f1064f8bb admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:44.131078 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5a989-ceb7-4830-9f9d-e92f1064f8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:44.131348 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5a989-ceb7-4830-9f9d-e92f1064f8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:44.131986 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5a989-ceb7-4830-9f9d-e92f1064f8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:44.133848 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5a989-ceb7-4830-9f9d-e92f1064f8bb admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:44.148974 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1000/2013] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:44.153209 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d0d5d-d952-41af-b882-a22a66e744f9 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:44.163435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d0d5d-d952-41af-b882-a22a66e744f9 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:44.169722 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba801aa5-0754-437b-b6a9-f597d3f788a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:44.174157 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba801aa5-0754-437b-b6a9-f597d3f788a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:44.174444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba801aa5-0754-437b-b6a9-f597d3f788a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:44.174746 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba801aa5-0754-437b-b6a9-f597d3f788a5 admin admin] PATH_INFO: `/v3/projects/a0777435f1484c849c8d35bc0996cefd/users/5cebca4ab0584c9fa667a16dc85b89ce/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:44.198626 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba801aa5-0754-437b-b6a9-f597d3f788a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0777435f1484c849c8d35bc0996cefd, user_id=5cebca4ab0584c9fa667a16dc85b89ce, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:44.201329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba801aa5-0754-437b-b6a9-f597d3f788a5 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:44.215631 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1014/2014] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:44 2022] PUT /identity/v3/projects/a0777435f1484c849c8d35bc0996cefd/users/5cebca4ab0584c9fa667a16dc85b89ce/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:44.219305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5a989-ceb7-4830-9f9d-e92f1064f8bb admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:44.230951 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5a989-ceb7-4830-9f9d-e92f1064f8bb admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:44.323316 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc1bdd-014a-4b81-9482-5fe22df27555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:44.323919 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc1bdd-014a-4b81-9482-5fe22df27555 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:44.324200 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc1bdd-014a-4b81-9482-5fe22df27555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:44.324469 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc1bdd-014a-4b81-9482-5fe22df27555 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:44.325106 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc1bdd-014a-4b81-9482-5fe22df27555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:44.326727 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc1bdd-014a-4b81-9482-5fe22df27555 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:44.334184 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba801aa5-0754-437b-b6a9-f597d3f788a5 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:44.336019 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ba801aa5-0754-437b-b6a9-f597d3f788a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:44.341123 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1001/2015] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:44.342078 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc1bdd-014a-4b81-9482-5fe22df27555 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:44.349842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba801aa5-0754-437b-b6a9-f597d3f788a5 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:44.352308 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc1bdd-014a-4b81-9482-5fe22df27555 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:44.354887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa9c3f-1f8c-4348-936f-f2a7e9ff7a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:44.355509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa9c3f-1f8c-4348-936f-f2a7e9ff7a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:44.355844 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa9c3f-1f8c-4348-936f-f2a7e9ff7a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:44.356115 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa9c3f-1f8c-4348-936f-f2a7e9ff7a1b admin admin] PATH_INFO: `/v3/users/1d2ddc06c375418aa9f673f9c99a6ad5` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:44.357204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658b8b0-ebab-4170-88f2-d7a0ba3d7426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:44.357343 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa9c3f-1f8c-4348-936f-f2a7e9ff7a1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d2ddc06c375418aa9f673f9c99a6ad5)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:44.357862 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658b8b0-ebab-4170-88f2-d7a0ba3d7426 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:44.358142 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658b8b0-ebab-4170-88f2-d7a0ba3d7426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:44.358464 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658b8b0-ebab-4170-88f2-d7a0ba3d7426 admin admin] PATH_INFO: `/v3/projects/a0777435f1484c849c8d35bc0996cefd/users/5cebca4ab0584c9fa667a16dc85b89ce/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:44.359166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa9c3f-1f8c-4348-936f-f2a7e9ff7a1b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:44.360967 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658b8b0-ebab-4170-88f2-d7a0ba3d7426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0777435f1484c849c8d35bc0996cefd, user_id=5cebca4ab0584c9fa667a16dc85b89ce, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:44.363683 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658b8b0-ebab-4170-88f2-d7a0ba3d7426 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:44.375514 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1002/2016] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:44 2022] PUT /identity/v3/projects/a0777435f1484c849c8d35bc0996cefd/users/5cebca4ab0584c9fa667a16dc85b89ce/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:05:44.382286 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:DELETE=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:44.387914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe04577-a96a-45a8-b94a-e0c960c17837 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:44.388367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe04577-a96a-45a8-b94a-e0c960c17837 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:44.389000 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe04577-a96a-45a8-b94a-e0c960c17837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:44.411033 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-85fa9c3f-1f8c-4348-936f-f2a7e9ff7a1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d2ddc06c375418aa9f673f9c99a6ad5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:44.418980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-85fa9c3f-1f8c-4348-936f-f2a7e9ff7a1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d2ddc06c375418aa9f673f9c99a6ad5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:44.422161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-3fe04577-a96a-45a8-b94a-e0c960c17837 None None] MFA Rules not processed for user `5cebca4ab0584c9fa667a16dc85b89ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:44.423372 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3fe04577-a96a-45a8-b94a-e0c960c17837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:44.431734 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-85fa9c3f-1f8c-4348-936f-f2a7e9ff7a1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d2ddc06c375418aa9f673f9c99a6ad5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:44.432634 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-85fa9c3f-1f8c-4348-936f-f2a7e9ff7a1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d2ddc06c375418aa9f673f9c99a6ad5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:44.433333 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-85fa9c3f-1f8c-4348-936f-f2a7e9ff7a1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d2ddc06c375418aa9f673f9c99a6ad5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:44.447327 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1015/2017] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:44 2022] DELETE /identity/v3/users/1d2ddc06c375418aa9f673f9c99a6ad5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:05:44.452309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a1657-aeae-48cc-885f-9305495b942c None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:44.452587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a1657-aeae-48cc-885f-9305495b942c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:44.452960 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a1657-aeae-48cc-885f-9305495b942c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:44.456973 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:44.474620 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-7b8a1657-aeae-48cc-885f-9305495b942c None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:44.475905 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7b8a1657-aeae-48cc-885f-9305495b942c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:44.497594 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1003/2018] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:44 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:05:44.510057 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe04577-a96a-45a8-b94a-e0c960c17837 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:44.511399 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3fe04577-a96a-45a8-b94a-e0c960c17837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:44.549194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1016/2019] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:05:44.560379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a1657-aeae-48cc-885f-9305495b942c None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:44.563925 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7b8a1657-aeae-48cc-885f-9305495b942c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:44.584470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe04577-a96a-45a8-b94a-e0c960c17837 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:44.639059 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a1657-aeae-48cc-885f-9305495b942c None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:44.643521 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b8259-dad8-4834-b225-66512f7d57b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:44.644137 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b8259-dad8-4834-b225-66512f7d57b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:44.644473 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b8259-dad8-4834-b225-66512f7d57b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:44.644745 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b8259-dad8-4834-b225-66512f7d57b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:44.654903 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b8259-dad8-4834-b225-66512f7d57b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:44.656401 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b8259-dad8-4834-b225-66512f7d57b4 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:44.656574 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8612382-1e47-423a-a119-73d28a5f0a00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:44.657502 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8612382-1e47-423a-a119-73d28a5f0a00 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:44.657502 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8612382-1e47-423a-a119-73d28a5f0a00 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:44.657769 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8612382-1e47-423a-a119-73d28a5f0a00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:44.672822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1017/2020] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:44.729659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8612382-1e47-423a-a119-73d28a5f0a00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:44.731212 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8612382-1e47-423a-a119-73d28a5f0a00 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:44.755485 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1004/2021] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:44 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:44.951660 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b8259-dad8-4834-b225-66512f7d57b4 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:44.962040 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b8259-dad8-4834-b225-66512f7d57b4 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:44.965528 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed658d87-88a1-4a6e-9743-d5d8c9ca7955 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:44.966167 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed658d87-88a1-4a6e-9743-d5d8c9ca7955 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:44.966565 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed658d87-88a1-4a6e-9743-d5d8c9ca7955 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:44.966841 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed658d87-88a1-4a6e-9743-d5d8c9ca7955 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:44.968540 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ed658d87-88a1-4a6e-9743-d5d8c9ca7955 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:45.011694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:45.040751 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed658d87-88a1-4a6e-9743-d5d8c9ca7955 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:45.042644 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed658d87-88a1-4a6e-9743-d5d8c9ca7955 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:45.053446 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1018/2022] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:44 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:45.062409 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8612382-1e47-423a-a119-73d28a5f0a00 service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:45.064432 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e8612382-1e47-423a-a119-73d28a5f0a00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:45.081086 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8612382-1e47-423a-a119-73d28a5f0a00 service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:45.086350 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c96df9-91be-4378-9f48-e981e7fc76b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:45.087009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c96df9-91be-4378-9f48-e981e7fc76b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:45.087319 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c96df9-91be-4378-9f48-e981e7fc76b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:45.087689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c96df9-91be-4378-9f48-e981e7fc76b1 admin admin] PATH_INFO: `/v3/projects/bdb959d7b1274f6cb8798eadf09d3d1c` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:45.088726 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c96df9-91be-4378-9f48-e981e7fc76b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdb959d7b1274f6cb8798eadf09d3d1c)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:45.091064 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c96df9-91be-4378-9f48-e981e7fc76b1 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:45.126860 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:45.144278 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c7c96df9-91be-4378-9f48-e981e7fc76b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdb959d7b1274f6cb8798eadf09d3d1c', 'request_id': 'req-c7c96df9-91be-4378-9f48-e981e7fc76b1'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:45.151529 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c7c96df9-91be-4378-9f48-e981e7fc76b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdb959d7b1274f6cb8798eadf09d3d1c', 'request_id': 'req-c7c96df9-91be-4378-9f48-e981e7fc76b1'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:45.158304 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c7c96df9-91be-4378-9f48-e981e7fc76b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdb959d7b1274f6cb8798eadf09d3d1c', 'request_id': 'req-c7c96df9-91be-4378-9f48-e981e7fc76b1'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:45.168721 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c7c96df9-91be-4378-9f48-e981e7fc76b1 admin admin] The token cache is being invalidate because project bdb959d7b1274f6cb8798eadf09d3d1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:45.169025 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c7c96df9-91be-4378-9f48-e981e7fc76b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:45.169757 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c7c96df9-91be-4378-9f48-e981e7fc76b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:45.171280 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1005/2023] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:45 2022] DELETE /identity/v3/projects/bdb959d7b1274f6cb8798eadf09d3d1c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:45.175452 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed658d87-88a1-4a6e-9743-d5d8c9ca7955 service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:45.188536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed658d87-88a1-4a6e-9743-d5d8c9ca7955 service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:45.268753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8363479-32ae-4314-a6b2-3f531b3df08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:45.270061 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8363479-32ae-4314-a6b2-3f531b3df08d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:45.270419 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8363479-32ae-4314-a6b2-3f531b3df08d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:45.271024 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8363479-32ae-4314-a6b2-3f531b3df08d admin admin] PATH_INFO: `/v3/users/29610e5c567c4beab761f71f628ee2fa` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:45.272322 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8363479-32ae-4314-a6b2-3f531b3df08d admin admin] RBAC: Authorizing `identity:delete_user(user_id=29610e5c567c4beab761f71f628ee2fa)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:45.274394 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8363479-32ae-4314-a6b2-3f531b3df08d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:45.333443 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e8363479-32ae-4314-a6b2-3f531b3df08d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29610e5c567c4beab761f71f628ee2fa'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:45.360330 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c96df9-91be-4378-9f48-e981e7fc76b1 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:45.362147 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e8363479-32ae-4314-a6b2-3f531b3df08d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29610e5c567c4beab761f71f628ee2fa'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:45.362514 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c7c96df9-91be-4378-9f48-e981e7fc76b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:45.385464 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c96df9-91be-4378-9f48-e981e7fc76b1 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:45.390435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e8363479-32ae-4314-a6b2-3f531b3df08d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29610e5c567c4beab761f71f628ee2fa'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:45.391891 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e8363479-32ae-4314-a6b2-3f531b3df08d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29610e5c567c4beab761f71f628ee2fa'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:45.392972 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e16fb-5350-4410-baf2-0abba3410207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:45.393116 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e8363479-32ae-4314-a6b2-3f531b3df08d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29610e5c567c4beab761f71f628ee2fa'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:45.393931 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e16fb-5350-4410-baf2-0abba3410207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:45.394358 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e16fb-5350-4410-baf2-0abba3410207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:45.394960 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e16fb-5350-4410-baf2-0abba3410207 admin admin] PATH_INFO: `/v3/users/832b461a5ffd4ef18b984e04c6c5c62d` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:45.396986 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e16fb-5350-4410-baf2-0abba3410207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=832b461a5ffd4ef18b984e04c6c5c62d)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:45.399625 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e16fb-5350-4410-baf2-0abba3410207 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:45.423053 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1019/2024] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:45 2022] DELETE /identity/v3/users/29610e5c567c4beab761f71f628ee2fa => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:45.486935 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8b7e16fb-5350-4410-baf2-0abba3410207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '832b461a5ffd4ef18b984e04c6c5c62d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:45.487596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8b7e16fb-5350-4410-baf2-0abba3410207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '832b461a5ffd4ef18b984e04c6c5c62d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:45.495927 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8b7e16fb-5350-4410-baf2-0abba3410207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '832b461a5ffd4ef18b984e04c6c5c62d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:45.519442 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8b7e16fb-5350-4410-baf2-0abba3410207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '832b461a5ffd4ef18b984e04c6c5c62d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:45.521403 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8b7e16fb-5350-4410-baf2-0abba3410207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '832b461a5ffd4ef18b984e04c6c5c62d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:45.547324 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1006/2025] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:45 2022] DELETE /identity/v3/users/832b461a5ffd4ef18b984e04c6c5c62d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:45.552440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca61f2-be3f-4df5-9196-f549782dfae6 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:45.552821 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca61f2-be3f-4df5-9196-f549782dfae6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:45.553315 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca61f2-be3f-4df5-9196-f549782dfae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:45.580872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-a4ca61f2-be3f-4df5-9196-f549782dfae6 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:45.582804 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a4ca61f2-be3f-4df5-9196-f549782dfae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:45.665982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:45.694154 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1020/2026] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:45.694952 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e16fb-5350-4410-baf2-0abba3410207 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:45.696378 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8b7e16fb-5350-4410-baf2-0abba3410207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:45.767123 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e16fb-5350-4410-baf2-0abba3410207 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:45.770819 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e89e50-ffd2-4fcb-8f61-a716a8667161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:45.771398 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e89e50-ffd2-4fcb-8f61-a716a8667161 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:45.771675 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e89e50-ffd2-4fcb-8f61-a716a8667161 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:45.772008 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e89e50-ffd2-4fcb-8f61-a716a8667161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:45.774546 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca61f2-be3f-4df5-9196-f549782dfae6 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:45.776261 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a4ca61f2-be3f-4df5-9196-f549782dfae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:45.785668 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e89e50-ffd2-4fcb-8f61-a716a8667161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:45.787154 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e89e50-ffd2-4fcb-8f61-a716a8667161 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:45.788959 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca61f2-be3f-4df5-9196-f549782dfae6 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:45.796438 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8edf2-40bd-4c6b-a4a2-9622275ee61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:45.797648 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8edf2-40bd-4c6b-a4a2-9622275ee61d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:45.798023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8edf2-40bd-4c6b-a4a2-9622275ee61d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:45.798347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8edf2-40bd-4c6b-a4a2-9622275ee61d admin admin] PATH_INFO: `/v3/projects/9cb5d14b8700464da4c9c82f4dc6f98c` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:45.800042 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8edf2-40bd-4c6b-a4a2-9622275ee61d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cb5d14b8700464da4c9c82f4dc6f98c)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:45.802191 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1007/2027] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:45.802344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8edf2-40bd-4c6b-a4a2-9622275ee61d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:45.867296 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7ea8edf2-40bd-4c6b-a4a2-9622275ee61d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cb5d14b8700464da4c9c82f4dc6f98c', 'request_id': 'req-7ea8edf2-40bd-4c6b-a4a2-9622275ee61d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:45.876784 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7ea8edf2-40bd-4c6b-a4a2-9622275ee61d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cb5d14b8700464da4c9c82f4dc6f98c', 'request_id': 'req-7ea8edf2-40bd-4c6b-a4a2-9622275ee61d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:45.883705 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7ea8edf2-40bd-4c6b-a4a2-9622275ee61d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cb5d14b8700464da4c9c82f4dc6f98c', 'request_id': 'req-7ea8edf2-40bd-4c6b-a4a2-9622275ee61d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:45.894893 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7ea8edf2-40bd-4c6b-a4a2-9622275ee61d admin admin] The token cache is being invalidate because project 9cb5d14b8700464da4c9c82f4dc6f98c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:45.895170 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7ea8edf2-40bd-4c6b-a4a2-9622275ee61d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:45.895835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7ea8edf2-40bd-4c6b-a4a2-9622275ee61d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:45.897341 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1021/2028] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:45 2022] DELETE /identity/v3/projects/9cb5d14b8700464da4c9c82f4dc6f98c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:45.902684 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e44b37-ab04-414c-9cbc-488236124f3a None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:45.902979 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e44b37-ab04-414c-9cbc-488236124f3a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:45.903260 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e44b37-ab04-414c-9cbc-488236124f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:45.926225 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-69e44b37-ab04-414c-9cbc-488236124f3a None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:45.927620 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-69e44b37-ab04-414c-9cbc-488236124f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:45.955053 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:45.993318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1008/2029] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:46.003471 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89b2d5-eed7-4900-a8ef-a985d7ed898b None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:46.003790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89b2d5-eed7-4900-a8ef-a985d7ed898b None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:46.004465 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89b2d5-eed7-4900-a8ef-a985d7ed898b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:46.026614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-3b89b2d5-eed7-4900-a8ef-a985d7ed898b None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:46.028434 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3b89b2d5-eed7-4900-a8ef-a985d7ed898b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:46.039677 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1022/2030] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:46.044006 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e44b37-ab04-414c-9cbc-488236124f3a None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:46.057055 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e44b37-ab04-414c-9cbc-488236124f3a None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:46.062827 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28fe034-7d14-4599-a99a-15fe9961fa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:46.063502 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fe034-7d14-4599-a99a-15fe9961fa2f admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:46.063781 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fe034-7d14-4599-a99a-15fe9961fa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:46.064053 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fe034-7d14-4599-a99a-15fe9961fa2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:46.064704 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28fe034-7d14-4599-a99a-15fe9961fa2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:05:46.065052 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28fe034-7d14-4599-a99a-15fe9961fa2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:46.066751 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28fe034-7d14-4599-a99a-15fe9961fa2f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:46.082030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1009/2031] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:05:46.087034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89b2d5-eed7-4900-a8ef-a985d7ed898b None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:46.097253 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89b2d5-eed7-4900-a8ef-a985d7ed898b None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:46.102308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f484a5-0b50-42be-ae92-428b1336b524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:46.102922 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f484a5-0b50-42be-ae92-428b1336b524 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:46.103236 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f484a5-0b50-42be-ae92-428b1336b524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:46.103512 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f484a5-0b50-42be-ae92-428b1336b524 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:46.104171 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f484a5-0b50-42be-ae92-428b1336b524 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:46.106248 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f484a5-0b50-42be-ae92-428b1336b524 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:46.135844 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1023/2032] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:46 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:05:46.140428 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28fe034-7d14-4599-a99a-15fe9961fa2f admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:46.152469 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28fe034-7d14-4599-a99a-15fe9961fa2f admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:46.234052 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a604ef6-5bfc-44a6-87c0-92f66dce5a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:46.235202 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a604ef6-5bfc-44a6-87c0-92f66dce5a2b admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:46.235484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a604ef6-5bfc-44a6-87c0-92f66dce5a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:46.235756 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a604ef6-5bfc-44a6-87c0-92f66dce5a2b admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:46.236914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a604ef6-5bfc-44a6-87c0-92f66dce5a2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:46.238908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a604ef6-5bfc-44a6-87c0-92f66dce5a2b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:46.272838 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1010/2033] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:46 2022] POST /identity/v3/users => generated 288 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:46.274021 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f484a5-0b50-42be-ae92-428b1336b524 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:46.286563 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f484a5-0b50-42be-ae92-428b1336b524 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:46.291991 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617de71-d61e-4463-af36-34d88fa88979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:46.292885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617de71-d61e-4463-af36-34d88fa88979 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:46.293309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617de71-d61e-4463-af36-34d88fa88979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:46.293710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617de71-d61e-4463-af36-34d88fa88979 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:46.295114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617de71-d61e-4463-af36-34d88fa88979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:46.297930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617de71-d61e-4463-af36-34d88fa88979 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:46.311150 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1024/2034] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 01:05:46.315270 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a604ef6-5bfc-44a6-87c0-92f66dce5a2b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:46.325567 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a604ef6-5bfc-44a6-87c0-92f66dce5a2b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:46.331301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3505b0-dd70-405d-9787-e3ef239e9a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:46.331914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3505b0-dd70-405d-9787-e3ef239e9a0d admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:46.332195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3505b0-dd70-405d-9787-e3ef239e9a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:46.332465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3505b0-dd70-405d-9787-e3ef239e9a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:46.333185 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3505b0-dd70-405d-9787-e3ef239e9a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:46.334879 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3505b0-dd70-405d-9787-e3ef239e9a0d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:46.346872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1011/2035] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:46.351146 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617de71-d61e-4463-af36-34d88fa88979 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:46.366264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617de71-d61e-4463-af36-34d88fa88979 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:46.366834 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3505b0-dd70-405d-9787-e3ef239e9a0d admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:46.368461 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fa3505b0-dd70-405d-9787-e3ef239e9a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:46.372768 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88c723-5d9a-4c9b-9250-1a80c9f7aa43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:46.373729 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88c723-5d9a-4c9b-9250-1a80c9f7aa43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:46.374191 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88c723-5d9a-4c9b-9250-1a80c9f7aa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:46.374769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88c723-5d9a-4c9b-9250-1a80c9f7aa43 admin admin] PATH_INFO: `/v3/projects/ee4a0aece9a04a59b29b77b2589f9f50/users/1fec9806069e4aad88f2db5963d89285/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:46.391976 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3505b0-dd70-405d-9787-e3ef239e9a0d admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:46.398301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c01280-e88d-43ea-94d0-75625a036dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:46.399697 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c01280-e88d-43ea-94d0-75625a036dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:46.400131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c01280-e88d-43ea-94d0-75625a036dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:46.400801 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c01280-e88d-43ea-94d0-75625a036dda admin admin] PATH_INFO: `/v3/projects/e00c1bb347eb48ec9498e47bdb3541ac` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:46.402157 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c01280-e88d-43ea-94d0-75625a036dda admin admin] RBAC: Authorizing `identity:delete_project(project_id=e00c1bb347eb48ec9498e47bdb3541ac)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:46.405838 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c01280-e88d-43ea-94d0-75625a036dda admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:46.409379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88c723-5d9a-4c9b-9250-1a80c9f7aa43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee4a0aece9a04a59b29b77b2589f9f50, user_id=1fec9806069e4aad88f2db5963d89285, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:46.415062 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88c723-5d9a-4c9b-9250-1a80c9f7aa43 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:46.432842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1025/2036] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:46 2022] PUT /identity/v3/projects/ee4a0aece9a04a59b29b77b2589f9f50/users/1fec9806069e4aad88f2db5963d89285/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:46.443104 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3c294-2a63-47c1-9741-3298a90a193e None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:46.443394 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3c294-2a63-47c1-9741-3298a90a193e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:46.443672 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3c294-2a63-47c1-9741-3298a90a193e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:46.475485 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-81c3c294-2a63-47c1-9741-3298a90a193e None None] MFA Rules not processed for user `1fec9806069e4aad88f2db5963d89285`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:46.476702 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-81c3c294-2a63-47c1-9741-3298a90a193e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:46.490481 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-01c01280-e88d-43ea-94d0-75625a036dda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e00c1bb347eb48ec9498e47bdb3541ac', 'request_id': 'req-01c01280-e88d-43ea-94d0-75625a036dda'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:46.497013 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-01c01280-e88d-43ea-94d0-75625a036dda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e00c1bb347eb48ec9498e47bdb3541ac', 'request_id': 'req-01c01280-e88d-43ea-94d0-75625a036dda'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:46.506324 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-01c01280-e88d-43ea-94d0-75625a036dda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e00c1bb347eb48ec9498e47bdb3541ac', 'request_id': 'req-01c01280-e88d-43ea-94d0-75625a036dda'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:46.527097 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-01c01280-e88d-43ea-94d0-75625a036dda admin admin] The token cache is being invalidate because project e00c1bb347eb48ec9498e47bdb3541ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:46.527097 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-01c01280-e88d-43ea-94d0-75625a036dda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:46.527261 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-01c01280-e88d-43ea-94d0-75625a036dda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:46.529099 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1012/2037] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:46 2022] DELETE /identity/v3/projects/e00c1bb347eb48ec9498e47bdb3541ac => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:05:46.534834 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cea04-c2d3-452d-bb99-47a69fcc7ee5 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:46.535870 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cea04-c2d3-452d-bb99-47a69fcc7ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:46.536210 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cea04-c2d3-452d-bb99-47a69fcc7ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:46.560905 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-b66cea04-c2d3-452d-bb99-47a69fcc7ee5 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:46.562363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b66cea04-c2d3-452d-bb99-47a69fcc7ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:46.579538 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:46.631084 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1026/2038] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:05:46.644410 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1013/2039] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:46.644802 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3c294-2a63-47c1-9741-3298a90a193e None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:46.648009 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-81c3c294-2a63-47c1-9741-3298a90a193e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:46.659623 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201224ce-5c59-4356-8de8-ce148d94eb40 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:46.659907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201224ce-5c59-4356-8de8-ce148d94eb40 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:46.660224 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201224ce-5c59-4356-8de8-ce148d94eb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:46.666275 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:46.728728 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-201224ce-5c59-4356-8de8-ce148d94eb40 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:46.730083 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-201224ce-5c59-4356-8de8-ce148d94eb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:46.751026 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1014/2040] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:46.754994 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201224ce-5c59-4356-8de8-ce148d94eb40 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:46.778400 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201224ce-5c59-4356-8de8-ce148d94eb40 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:46.786072 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3c294-2a63-47c1-9741-3298a90a193e None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:46.790922 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b9e92-9f09-49ef-a2ca-612adcfd11b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:46.791835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b9e92-9f09-49ef-a2ca-612adcfd11b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:46.792535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b9e92-9f09-49ef-a2ca-612adcfd11b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:46.793251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b9e92-9f09-49ef-a2ca-612adcfd11b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:46.807719 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b9e92-9f09-49ef-a2ca-612adcfd11b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:46.809429 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b9e92-9f09-49ef-a2ca-612adcfd11b5 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:46.823480 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1027/2041] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 01:05:46.838120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b363e57-1b92-4048-ab6c-2199512449d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:46.838748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b363e57-1b92-4048-ab6c-2199512449d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:46.839020 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b363e57-1b92-4048-ab6c-2199512449d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:46.839283 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b363e57-1b92-4048-ab6c-2199512449d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:46.840886 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b363e57-1b92-4048-ab6c-2199512449d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:05:46.841082 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b363e57-1b92-4048-ab6c-2199512449d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:46.845737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b363e57-1b92-4048-ab6c-2199512449d4 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:46.884668 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1015/2042] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:05:46.891208 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b9e92-9f09-49ef-a2ca-612adcfd11b5 service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:46.905762 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b9e92-9f09-49ef-a2ca-612adcfd11b5 service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:46.918172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355b629-6a02-4252-9542-c0041da2615b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:46.919135 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355b629-6a02-4252-9542-c0041da2615b admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:46.919668 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355b629-6a02-4252-9542-c0041da2615b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:46.920144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355b629-6a02-4252-9542-c0041da2615b admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:46.921006 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355b629-6a02-4252-9542-c0041da2615b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:46.923216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355b629-6a02-4252-9542-c0041da2615b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:46.994417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1028/2043] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:46 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:46.998179 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b363e57-1b92-4048-ab6c-2199512449d4 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:47.012399 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b363e57-1b92-4048-ab6c-2199512449d4 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:47.172080 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853be59-3879-4bcd-917f-5819305b693d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:47.173072 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853be59-3879-4bcd-917f-5819305b693d admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:47.173450 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853be59-3879-4bcd-917f-5819305b693d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:47.173834 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853be59-3879-4bcd-917f-5819305b693d admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:47.175634 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853be59-3879-4bcd-917f-5819305b693d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:47.177939 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853be59-3879-4bcd-917f-5819305b693d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:47.206858 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1016/2044] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:46 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:47.211755 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355b629-6a02-4252-9542-c0041da2615b admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:47.228791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355b629-6a02-4252-9542-c0041da2615b admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:47.235498 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3b146-6631-4679-bfeb-3affcd28ff9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:47.236846 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3b146-6631-4679-bfeb-3affcd28ff9c admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:47.237316 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3b146-6631-4679-bfeb-3affcd28ff9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:47.237772 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3b146-6631-4679-bfeb-3affcd28ff9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:47.239537 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3b146-6631-4679-bfeb-3affcd28ff9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:47.243197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3b146-6631-4679-bfeb-3affcd28ff9c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:47.262480 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1029/2045] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 01:05:47.268000 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853be59-3879-4bcd-917f-5819305b693d admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:47.288634 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853be59-3879-4bcd-917f-5819305b693d admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:47.327093 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d61f2-a3fa-417b-80f4-70433fd5cb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:47.330962 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d61f2-a3fa-417b-80f4-70433fd5cb0b admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:47.331687 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d61f2-a3fa-417b-80f4-70433fd5cb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:47.333424 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d61f2-a3fa-417b-80f4-70433fd5cb0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:47.334121 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d61f2-a3fa-417b-80f4-70433fd5cb0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:47.342986 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d61f2-a3fa-417b-80f4-70433fd5cb0b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:47.425714 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1017/2046] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:47.427853 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3b146-6631-4679-bfeb-3affcd28ff9c admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:47.459988 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3b146-6631-4679-bfeb-3affcd28ff9c admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:47.465230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bdb64-3901-418f-89e7-cdb7b08df04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:47.466005 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bdb64-3901-418f-89e7-cdb7b08df04c admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:47.467005 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bdb64-3901-418f-89e7-cdb7b08df04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:47.467360 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bdb64-3901-418f-89e7-cdb7b08df04c admin admin] PATH_INFO: `/v3/projects/62a993571cdb4fcc9f7bd368ee96540e/users/f15bb355d55e45d6bf501c7bb93314d0/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:47.523454 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784bdb64-3901-418f-89e7-cdb7b08df04c admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a993571cdb4fcc9f7bd368ee96540e, user_id=f15bb355d55e45d6bf501c7bb93314d0, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:47.526343 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784bdb64-3901-418f-89e7-cdb7b08df04c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:47.545469 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1030/2047] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:47 2022] PUT /identity/v3/projects/62a993571cdb4fcc9f7bd368ee96540e/users/f15bb355d55e45d6bf501c7bb93314d0/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:47.559722 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f177f7-0632-4d7a-b579-207485af0e25 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:47.560526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f177f7-0632-4d7a-b579-207485af0e25 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:47.560526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f177f7-0632-4d7a-b579-207485af0e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:47.596563 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-98f177f7-0632-4d7a-b579-207485af0e25 None None] MFA Rules not processed for user `f15bb355d55e45d6bf501c7bb93314d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:47.599095 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-98f177f7-0632-4d7a-b579-207485af0e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:47.675399 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1018/2048] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:47.680385 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bdb64-3901-418f-89e7-cdb7b08df04c admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:47.781500 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bdb64-3901-418f-89e7-cdb7b08df04c admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:47.787139 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa044a-aca6-42f8-be3a-3f1afd28ddf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:47.787813 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa044a-aca6-42f8-be3a-3f1afd28ddf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:47.788116 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa044a-aca6-42f8-be3a-3f1afd28ddf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:47.788386 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa044a-aca6-42f8-be3a-3f1afd28ddf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:47.789058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa044a-aca6-42f8-be3a-3f1afd28ddf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:47.791202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa044a-aca6-42f8-be3a-3f1afd28ddf2 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:47.829387 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1031/2049] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:47 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:05:47.830789 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f177f7-0632-4d7a-b579-207485af0e25 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:47.842545 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f177f7-0632-4d7a-b579-207485af0e25 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:47.847779 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:47.918407 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f2b5a-fd55-4d20-8554-68ef9c9d7f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:47.918995 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f2b5a-fd55-4d20-8554-68ef9c9d7f3f admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:47.919272 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f2b5a-fd55-4d20-8554-68ef9c9d7f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:47.919540 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f2b5a-fd55-4d20-8554-68ef9c9d7f3f admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:47.920171 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f2b5a-fd55-4d20-8554-68ef9c9d7f3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:47.922657 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f2b5a-fd55-4d20-8554-68ef9c9d7f3f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:47.948745 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1019/2050] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:47 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:47.952896 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa044a-aca6-42f8-be3a-3f1afd28ddf2 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:47.966109 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa044a-aca6-42f8-be3a-3f1afd28ddf2 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:47.975696 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d8455-b1f4-40b9-8945-73214ab415c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:47.976446 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d8455-b1f4-40b9-8945-73214ab415c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:47.977091 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d8455-b1f4-40b9-8945-73214ab415c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:47.977225 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d8455-b1f4-40b9-8945-73214ab415c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:47.977937 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d8455-b1f4-40b9-8945-73214ab415c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:47.980183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d8455-b1f4-40b9-8945-73214ab415c7 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:47.993090 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1032/2051] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:47.997258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f2b5a-fd55-4d20-8554-68ef9c9d7f3f admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:48.011603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f2b5a-fd55-4d20-8554-68ef9c9d7f3f admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:48.017096 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40edaf-47cf-40c5-b067-32d5ef27af33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:48.017836 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40edaf-47cf-40c5-b067-32d5ef27af33 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:48.018226 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40edaf-47cf-40c5-b067-32d5ef27af33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:48.018538 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40edaf-47cf-40c5-b067-32d5ef27af33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:48.019255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40edaf-47cf-40c5-b067-32d5ef27af33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:48.020936 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40edaf-47cf-40c5-b067-32d5ef27af33 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:48.032235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1020/2052] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:48.036795 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d8455-b1f4-40b9-8945-73214ab415c7 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:48.047873 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d8455-b1f4-40b9-8945-73214ab415c7 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:48.054889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ba66a-e6bb-4eec-ba38-fa5224d97aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:48.055557 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ba66a-e6bb-4eec-ba38-fa5224d97aaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:48.055960 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ba66a-e6bb-4eec-ba38-fa5224d97aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:48.056234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ba66a-e6bb-4eec-ba38-fa5224d97aaf admin admin] PATH_INFO: `/v3/projects/8a40ff9e215d41c496ceace4d9aacf5a/users/878394577e874958b9ab304df1e9de82/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:48.072431 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ba66a-e6bb-4eec-ba38-fa5224d97aaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a40ff9e215d41c496ceace4d9aacf5a, user_id=878394577e874958b9ab304df1e9de82, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:48.075115 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ba66a-e6bb-4eec-ba38-fa5224d97aaf admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:48.097943 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1033/2053] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:48 2022] PUT /identity/v3/projects/8a40ff9e215d41c496ceace4d9aacf5a/users/878394577e874958b9ab304df1e9de82/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:05:48.107251 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358afb60-2f2a-41cb-907b-b1f987a4d691 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:48.107529 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358afb60-2f2a-41cb-907b-b1f987a4d691 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:48.107796 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358afb60-2f2a-41cb-907b-b1f987a4d691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:48.143405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-358afb60-2f2a-41cb-907b-b1f987a4d691 None None] MFA Rules not processed for user `878394577e874958b9ab304df1e9de82`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:48.144993 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-358afb60-2f2a-41cb-907b-b1f987a4d691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:48.225041 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1021/2054] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:05:48.229600 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ba66a-e6bb-4eec-ba38-fa5224d97aaf admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:48.234245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:48.305536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ba66a-e6bb-4eec-ba38-fa5224d97aaf admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:48.310999 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cdd79-f7a8-4a68-ad5b-97d8419a924e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:48.311616 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cdd79-f7a8-4a68-ad5b-97d8419a924e admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:48.311899 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cdd79-f7a8-4a68-ad5b-97d8419a924e admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:48.312171 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cdd79-f7a8-4a68-ad5b-97d8419a924e admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:48.313334 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200cdd79-f7a8-4a68-ad5b-97d8419a924e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:48.315886 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200cdd79-f7a8-4a68-ad5b-97d8419a924e admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:48.352858 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1034/2055] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:48 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:48.355154 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358afb60-2f2a-41cb-907b-b1f987a4d691 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:48.366538 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358afb60-2f2a-41cb-907b-b1f987a4d691 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:48.452428 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722dcb0-2e0d-4519-b778-d0b29202b754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:48.464761 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722dcb0-2e0d-4519-b778-d0b29202b754 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:48.465061 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722dcb0-2e0d-4519-b778-d0b29202b754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:48.465377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722dcb0-2e0d-4519-b778-d0b29202b754 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:48.469501 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722dcb0-2e0d-4519-b778-d0b29202b754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:48.471324 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722dcb0-2e0d-4519-b778-d0b29202b754 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:48.511774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1022/2056] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:48 2022] POST /identity/v3/users => generated 299 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:05:48.518485 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cdd79-f7a8-4a68-ad5b-97d8419a924e admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:48.543976 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cdd79-f7a8-4a68-ad5b-97d8419a924e admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:48.561285 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a18e3-2d81-4d6b-aaf2-cd48c5a709e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:48.562410 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a18e3-2d81-4d6b-aaf2-cd48c5a709e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:48.562817 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a18e3-2d81-4d6b-aaf2-cd48c5a709e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:48.563181 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a18e3-2d81-4d6b-aaf2-cd48c5a709e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:48.563983 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a18e3-2d81-4d6b-aaf2-cd48c5a709e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:48.565914 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a18e3-2d81-4d6b-aaf2-cd48c5a709e2 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:48.588554 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722dcb0-2e0d-4519-b778-d0b29202b754 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:48.601503 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1035/2057] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:48.615314 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722dcb0-2e0d-4519-b778-d0b29202b754 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:48.636009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2cf0d-662d-4481-8570-1373a1938a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:48.640916 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2cf0d-662d-4481-8570-1373a1938a06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:48.641286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2cf0d-662d-4481-8570-1373a1938a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:48.648137 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2cf0d-662d-4481-8570-1373a1938a06 admin admin] PATH_INFO: `/v3/projects/7d1c149d58f14ab0b5deb8e0e5e2ceac/users/0d9a13425c48487e85fa7c0113a3d8b8/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:48.649393 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:48.683504 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2cf0d-662d-4481-8570-1373a1938a06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d1c149d58f14ab0b5deb8e0e5e2ceac, user_id=0d9a13425c48487e85fa7c0113a3d8b8, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:48.691705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2cf0d-662d-4481-8570-1373a1938a06 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:48.733787 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1023/2058] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:48 2022] PUT /identity/v3/projects/7d1c149d58f14ab0b5deb8e0e5e2ceac/users/0d9a13425c48487e85fa7c0113a3d8b8/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:48.738597 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a18e3-2d81-4d6b-aaf2-cd48c5a709e2 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:48.752157 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a18e3-2d81-4d6b-aaf2-cd48c5a709e2 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:48.895950 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01f9bc-d667-4cdb-8620-b4ae95f134cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:48.896675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01f9bc-d667-4cdb-8620-b4ae95f134cc admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:48.897032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01f9bc-d667-4cdb-8620-b4ae95f134cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:48.897327 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01f9bc-d667-4cdb-8620-b4ae95f134cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:48.898005 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01f9bc-d667-4cdb-8620-b4ae95f134cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:48.899852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01f9bc-d667-4cdb-8620-b4ae95f134cc admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:48.918262 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1036/2059] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:48.924895 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2cf0d-662d-4481-8570-1373a1938a06 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:48.948214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2cf0d-662d-4481-8570-1373a1938a06 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:48.961718 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0437cd8-b14f-46fd-8497-d065ceaa9532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:48.962745 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0437cd8-b14f-46fd-8497-d065ceaa9532 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:48.963230 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0437cd8-b14f-46fd-8497-d065ceaa9532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:48.963850 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0437cd8-b14f-46fd-8497-d065ceaa9532 admin admin] PATH_INFO: `/v3/projects/7d1c149d58f14ab0b5deb8e0e5e2ceac/users/0d9a13425c48487e85fa7c0113a3d8b8/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:48.970379 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0437cd8-b14f-46fd-8497-d065ceaa9532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d1c149d58f14ab0b5deb8e0e5e2ceac, user_id=0d9a13425c48487e85fa7c0113a3d8b8, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:48.973348 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0437cd8-b14f-46fd-8497-d065ceaa9532 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:49.019709 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1024/2060] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:48 2022] PUT /identity/v3/projects/7d1c149d58f14ab0b5deb8e0e5e2ceac/users/0d9a13425c48487e85fa7c0113a3d8b8/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:49.033726 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab250bd-15ff-43ec-ba3f-b744628ab131 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:49.034096 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab250bd-15ff-43ec-ba3f-b744628ab131 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:49.034377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab250bd-15ff-43ec-ba3f-b744628ab131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:49.088481 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-2ab250bd-15ff-43ec-ba3f-b744628ab131 None None] MFA Rules not processed for user `0d9a13425c48487e85fa7c0113a3d8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:49.090630 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2ab250bd-15ff-43ec-ba3f-b744628ab131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:49.224080 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:49.238292 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1037/2061] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:49.279753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0437cd8-b14f-46fd-8497-d065ceaa9532 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:49.358543 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0437cd8-b14f-46fd-8497-d065ceaa9532 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:49.363931 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d804c4-3dcd-4abb-9418-c3b957fff71e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:49.364568 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d804c4-3dcd-4abb-9418-c3b957fff71e service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:49.364843 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d804c4-3dcd-4abb-9418-c3b957fff71e service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:49.365217 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d804c4-3dcd-4abb-9418-c3b957fff71e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:49.442051 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d804c4-3dcd-4abb-9418-c3b957fff71e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:49.443641 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d804c4-3dcd-4abb-9418-c3b957fff71e service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:49.458585 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1025/2062] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:50.208411 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab250bd-15ff-43ec-ba3f-b744628ab131 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:50.209966 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2ab250bd-15ff-43ec-ba3f-b744628ab131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:50.335394 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab250bd-15ff-43ec-ba3f-b744628ab131 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:50.346592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b753655-4bed-4804-bb24-db3e0f0e492e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:50.348221 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b753655-4bed-4804-bb24-db3e0f0e492e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:50.348646 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b753655-4bed-4804-bb24-db3e0f0e492e admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:50.349089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b753655-4bed-4804-bb24-db3e0f0e492e admin admin] PATH_INFO: `/v3/users/abad14e930a34629b9ac41790e7a82f5` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:50.350770 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b753655-4bed-4804-bb24-db3e0f0e492e admin admin] RBAC: Authorizing `identity:delete_user(user_id=abad14e930a34629b9ac41790e7a82f5)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:50.353523 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b753655-4bed-4804-bb24-db3e0f0e492e admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:50.429500 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7b753655-4bed-4804-bb24-db3e0f0e492e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abad14e930a34629b9ac41790e7a82f5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:50.444264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7b753655-4bed-4804-bb24-db3e0f0e492e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abad14e930a34629b9ac41790e7a82f5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:50.465399 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7b753655-4bed-4804-bb24-db3e0f0e492e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abad14e930a34629b9ac41790e7a82f5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:50.466632 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7b753655-4bed-4804-bb24-db3e0f0e492e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abad14e930a34629b9ac41790e7a82f5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:50.467253 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7b753655-4bed-4804-bb24-db3e0f0e492e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abad14e930a34629b9ac41790e7a82f5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:50.488246 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1038/2063] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:50 2022] DELETE /identity/v3/users/abad14e930a34629b9ac41790e7a82f5 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:50.491269 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef80759-4953-465d-b968-0cf1115f5bf2 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:50.491787 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef80759-4953-465d-b968-0cf1115f5bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:50.491881 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef80759-4953-465d-b968-0cf1115f5bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:50.513724 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-fef80759-4953-465d-b968-0cf1115f5bf2 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:50.517367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fef80759-4953-465d-b968-0cf1115f5bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:50.604810 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1026/2064] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:50.616602 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b753655-4bed-4804-bb24-db3e0f0e492e admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:50.618137 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7b753655-4bed-4804-bb24-db3e0f0e492e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:50.696956 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b753655-4bed-4804-bb24-db3e0f0e492e admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:50.702571 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f7122-a0b2-4283-94db-0d950bb212fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:50.704526 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f7122-a0b2-4283-94db-0d950bb212fd service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:50.704990 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f7122-a0b2-4283-94db-0d950bb212fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:50.705684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f7122-a0b2-4283-94db-0d950bb212fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:50.732645 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f7122-a0b2-4283-94db-0d950bb212fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:50.735859 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f7122-a0b2-4283-94db-0d950bb212fd service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:50.748887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1039/2065] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:50.988996 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef80759-4953-465d-b968-0cf1115f5bf2 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:50.990467 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fef80759-4953-465d-b968-0cf1115f5bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:51.007627 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef80759-4953-465d-b968-0cf1115f5bf2 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:51.013631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92919168-d171-483d-98e3-99508a7b8977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:51.014662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92919168-d171-483d-98e3-99508a7b8977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:51.015260 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92919168-d171-483d-98e3-99508a7b8977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:51.016145 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92919168-d171-483d-98e3-99508a7b8977 admin admin] PATH_INFO: `/v3/users/574e79885b4e4949be961dcc38613edd` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:51.018011 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92919168-d171-483d-98e3-99508a7b8977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=574e79885b4e4949be961dcc38613edd)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:51.020021 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92919168-d171-483d-98e3-99508a7b8977 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:51.076417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f7122-a0b2-4283-94db-0d950bb212fd service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:51.079018 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a90f7122-a0b2-4283-94db-0d950bb212fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:51.087004 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:51.099091 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f7122-a0b2-4283-94db-0d950bb212fd service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:51.106505 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b889027-94d3-4f3a-ac82-8f95d0adebab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:51.107414 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b889027-94d3-4f3a-ac82-8f95d0adebab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:51.107921 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b889027-94d3-4f3a-ac82-8f95d0adebab admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:51.108401 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b889027-94d3-4f3a-ac82-8f95d0adebab admin admin] PATH_INFO: `/v3/users/1fec9806069e4aad88f2db5963d89285` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:51.110751 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b889027-94d3-4f3a-ac82-8f95d0adebab admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fec9806069e4aad88f2db5963d89285)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:51.113300 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b889027-94d3-4f3a-ac82-8f95d0adebab admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:51.137044 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:51.144765 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-92919168-d171-483d-98e3-99508a7b8977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '574e79885b4e4949be961dcc38613edd'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:51.145848 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-92919168-d171-483d-98e3-99508a7b8977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '574e79885b4e4949be961dcc38613edd'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:51.166688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-92919168-d171-483d-98e3-99508a7b8977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '574e79885b4e4949be961dcc38613edd'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:51.198374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-92919168-d171-483d-98e3-99508a7b8977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '574e79885b4e4949be961dcc38613edd'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:51.199189 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-92919168-d171-483d-98e3-99508a7b8977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '574e79885b4e4949be961dcc38613edd'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:51.200316 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4b889027-94d3-4f3a-ac82-8f95d0adebab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fec9806069e4aad88f2db5963d89285'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:51.218925 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4b889027-94d3-4f3a-ac82-8f95d0adebab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fec9806069e4aad88f2db5963d89285'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:51.222699 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1027/2066] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:50 2022] DELETE /identity/v3/users/574e79885b4e4949be961dcc38613edd => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:51.223600 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92919168-d171-483d-98e3-99508a7b8977 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:51.225103 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-92919168-d171-483d-98e3-99508a7b8977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:51.241505 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4b889027-94d3-4f3a-ac82-8f95d0adebab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fec9806069e4aad88f2db5963d89285'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:51.244037 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4b889027-94d3-4f3a-ac82-8f95d0adebab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fec9806069e4aad88f2db5963d89285'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:51.246255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4b889027-94d3-4f3a-ac82-8f95d0adebab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fec9806069e4aad88f2db5963d89285'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:51.274107 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1040/2067] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:51 2022] DELETE /identity/v3/users/1fec9806069e4aad88f2db5963d89285 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:05:51.275892 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d7623-b252-4479-99c2-1097139ea7c7 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:51.277190 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d7623-b252-4479-99c2-1097139ea7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:51.277679 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d7623-b252-4479-99c2-1097139ea7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:51.306483 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92919168-d171-483d-98e3-99508a7b8977 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:51.319155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-aa2d7623-b252-4479-99c2-1097139ea7c7 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:51.321045 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-aa2d7623-b252-4479-99c2-1097139ea7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:51.386403 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a9636-b6ee-470d-ba0d-4f917a8a9f86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:51.388270 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a9636-b6ee-470d-ba0d-4f917a8a9f86 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:51.388583 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a9636-b6ee-470d-ba0d-4f917a8a9f86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:51.389027 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a9636-b6ee-470d-ba0d-4f917a8a9f86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:51.392012 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-556a9636-b6ee-470d-ba0d-4f917a8a9f86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:51.410645 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1041/2068] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:51.412121 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d5c05-e14d-470c-ab97-3c4490ebfb5c None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:51.412626 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d5c05-e14d-470c-ab97-3c4490ebfb5c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:51.413038 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d5c05-e14d-470c-ab97-3c4490ebfb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:51.437425 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-322d5c05-e14d-470c-ab97-3c4490ebfb5c None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:51.438894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-322d5c05-e14d-470c-ab97-3c4490ebfb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:51.448150 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1042/2069] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:51.453728 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d5c05-e14d-470c-ab97-3c4490ebfb5c None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:51.455436 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-322d5c05-e14d-470c-ab97-3c4490ebfb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:51.473932 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d5c05-e14d-470c-ab97-3c4490ebfb5c None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:51.476917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a9636-b6ee-470d-ba0d-4f917a8a9f86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:51.479393 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a9636-b6ee-470d-ba0d-4f917a8a9f86 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:51.480288 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4499d6-0ad6-46c0-86ab-3052d76a6b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:51.481101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4499d6-0ad6-46c0-86ab-3052d76a6b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:51.481471 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4499d6-0ad6-46c0-86ab-3052d76a6b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:51.481871 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4499d6-0ad6-46c0-86ab-3052d76a6b29 admin admin] PATH_INFO: `/v3/projects/2723239ff67b4ee1a8cb16b700f7ecdb` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:51.483663 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4499d6-0ad6-46c0-86ab-3052d76a6b29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2723239ff67b4ee1a8cb16b700f7ecdb)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:51.486194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4499d6-0ad6-46c0-86ab-3052d76a6b29 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:51.489233 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1028/2070] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:51.502479 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a9636-b6ee-470d-ba0d-4f917a8a9f86 service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:51.506135 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-556a9636-b6ee-470d-ba0d-4f917a8a9f86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:51.517623 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:51.559853 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3a4499d6-0ad6-46c0-86ab-3052d76a6b29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2723239ff67b4ee1a8cb16b700f7ecdb', 'request_id': 'req-3a4499d6-0ad6-46c0-86ab-3052d76a6b29'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:51.581853 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3a4499d6-0ad6-46c0-86ab-3052d76a6b29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2723239ff67b4ee1a8cb16b700f7ecdb', 'request_id': 'req-3a4499d6-0ad6-46c0-86ab-3052d76a6b29'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:51.597126 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3a4499d6-0ad6-46c0-86ab-3052d76a6b29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2723239ff67b4ee1a8cb16b700f7ecdb', 'request_id': 'req-3a4499d6-0ad6-46c0-86ab-3052d76a6b29'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:51.599983 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a9636-b6ee-470d-ba0d-4f917a8a9f86 service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:51.616377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3a4499d6-0ad6-46c0-86ab-3052d76a6b29 admin admin] The token cache is being invalidate because project 2723239ff67b4ee1a8cb16b700f7ecdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:51.616807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3a4499d6-0ad6-46c0-86ab-3052d76a6b29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:51.619188 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3a4499d6-0ad6-46c0-86ab-3052d76a6b29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:51.621826 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1043/2071] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:51 2022] DELETE /identity/v3/projects/2723239ff67b4ee1a8cb16b700f7ecdb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:51.623075 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4499d6-0ad6-46c0-86ab-3052d76a6b29 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:51.624887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3a4499d6-0ad6-46c0-86ab-3052d76a6b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:51.641363 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:51.662491 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b158d00-45ea-43c1-9278-a10d12fe1527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:51.663430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b158d00-45ea-43c1-9278-a10d12fe1527 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:51.663910 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b158d00-45ea-43c1-9278-a10d12fe1527 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:51.664391 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b158d00-45ea-43c1-9278-a10d12fe1527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:51.666497 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3b158d00-45ea-43c1-9278-a10d12fe1527 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:51.721970 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4499d6-0ad6-46c0-86ab-3052d76a6b29 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:51.726666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da9ec1-a7f7-42df-a5f1-da8ae1fb38f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:51.727289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da9ec1-a7f7-42df-a5f1-da8ae1fb38f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:51.727565 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da9ec1-a7f7-42df-a5f1-da8ae1fb38f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:51.728181 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da9ec1-a7f7-42df-a5f1-da8ae1fb38f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:51.730624 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d7da9ec1-a7f7-42df-a5f1-da8ae1fb38f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:51.760731 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b158d00-45ea-43c1-9278-a10d12fe1527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:51.762534 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b158d00-45ea-43c1-9278-a10d12fe1527 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:51.774783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1029/2072] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:51.776505 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1627c-3e4f-4878-8b00-5a3c3b401afd None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:51.776853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1627c-3e4f-4878-8b00-5a3c3b401afd None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:51.777186 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1627c-3e4f-4878-8b00-5a3c3b401afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:51.815831 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-1de1627c-3e4f-4878-8b00-5a3c3b401afd None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:51.816945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1de1627c-3e4f-4878-8b00-5a3c3b401afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:51.824731 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da9ec1-a7f7-42df-a5f1-da8ae1fb38f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:51.826438 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da9ec1-a7f7-42df-a5f1-da8ae1fb38f3 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:51.837760 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1030/2073] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:51.839012 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1044/2074] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:51.848462 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dbdf1-58ea-4d19-a6f2-e3696503f3e3 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:51.848731 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dbdf1-58ea-4d19-a6f2-e3696503f3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:51.848992 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dbdf1-58ea-4d19-a6f2-e3696503f3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:51.873872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-a92dbdf1-58ea-4d19-a6f2-e3696503f3e3 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:51.875584 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a92dbdf1-58ea-4d19-a6f2-e3696503f3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:51.900298 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1031/2075] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:51.904967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da9ec1-a7f7-42df-a5f1-da8ae1fb38f3 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:51.917953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da9ec1-a7f7-42df-a5f1-da8ae1fb38f3 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:51.924173 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0555eba-839d-4f57-a26f-0a272391eb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:51.924873 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0555eba-839d-4f57-a26f-0a272391eb8c admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:51.925228 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0555eba-839d-4f57-a26f-0a272391eb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:51.925579 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0555eba-839d-4f57-a26f-0a272391eb8c admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:51.926329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0555eba-839d-4f57-a26f-0a272391eb8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:05:51.926697 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0555eba-839d-4f57-a26f-0a272391eb8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:51.928404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0555eba-839d-4f57-a26f-0a272391eb8c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:51.945525 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1045/2076] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:05:51.950398 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92dbdf1-58ea-4d19-a6f2-e3696503f3e3 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:51.965275 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92dbdf1-58ea-4d19-a6f2-e3696503f3e3 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:51.971626 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b8d0c-ceac-4ed0-a4d3-71162e97102b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:51.976016 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b8d0c-ceac-4ed0-a4d3-71162e97102b admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:51.976800 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b8d0c-ceac-4ed0-a4d3-71162e97102b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:51.978680 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b8d0c-ceac-4ed0-a4d3-71162e97102b admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:51.979342 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b8d0c-ceac-4ed0-a4d3-71162e97102b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:51.982301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b8d0c-ceac-4ed0-a4d3-71162e97102b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:52.049210 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1032/2077] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:51 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:05:52.052548 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0555eba-839d-4f57-a26f-0a272391eb8c admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:52.067789 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0555eba-839d-4f57-a26f-0a272391eb8c admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:52.183388 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604847c-eeaa-434b-940e-8ff41ce88db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:52.184010 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604847c-eeaa-434b-940e-8ff41ce88db4 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:52.184288 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604847c-eeaa-434b-940e-8ff41ce88db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:52.184560 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604847c-eeaa-434b-940e-8ff41ce88db4 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:52.185192 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604847c-eeaa-434b-940e-8ff41ce88db4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:52.188634 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604847c-eeaa-434b-940e-8ff41ce88db4 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:52.233729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b8d0c-ceac-4ed0-a4d3-71162e97102b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:52.246688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b8d0c-ceac-4ed0-a4d3-71162e97102b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:52.247779 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1046/2078] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:52 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:52.252228 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a69b31-5fac-4c6c-bfe1-0ec38d5850e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:52.252961 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a69b31-5fac-4c6c-bfe1-0ec38d5850e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:52.253303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a69b31-5fac-4c6c-bfe1-0ec38d5850e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:52.253722 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a69b31-5fac-4c6c-bfe1-0ec38d5850e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:52.254475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a69b31-5fac-4c6c-bfe1-0ec38d5850e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:52.256136 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a69b31-5fac-4c6c-bfe1-0ec38d5850e2 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:52.269853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1033/2079] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:52.271968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604847c-eeaa-434b-940e-8ff41ce88db4 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:52.287567 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604847c-eeaa-434b-940e-8ff41ce88db4 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:52.295403 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d95e0-7acc-4fd7-b909-e57973ed65d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:52.296263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d95e0-7acc-4fd7-b909-e57973ed65d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:52.297285 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d95e0-7acc-4fd7-b909-e57973ed65d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:52.297683 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d95e0-7acc-4fd7-b909-e57973ed65d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:52.298460 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d95e0-7acc-4fd7-b909-e57973ed65d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:52.302076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d95e0-7acc-4fd7-b909-e57973ed65d4 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:52.320879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1047/2080] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:52.322339 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a69b31-5fac-4c6c-bfe1-0ec38d5850e2 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:52.334863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a69b31-5fac-4c6c-bfe1-0ec38d5850e2 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:52.340858 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7fcb9-9ca5-435c-bf2f-c439182b7732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:52.341753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7fcb9-9ca5-435c-bf2f-c439182b7732 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:52.342379 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7fcb9-9ca5-435c-bf2f-c439182b7732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:52.342498 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7fcb9-9ca5-435c-bf2f-c439182b7732 admin admin] PATH_INFO: `/v3/projects/c7aef744a723418381ef606c86daa4bd/users/eb5424c4976f4d55b8213ae7b003d26a/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:52.396072 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d95e0-7acc-4fd7-b909-e57973ed65d4 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:52.396836 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7fcb9-9ca5-435c-bf2f-c439182b7732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7aef744a723418381ef606c86daa4bd, user_id=eb5424c4976f4d55b8213ae7b003d26a, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:52.398024 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-474d95e0-7acc-4fd7-b909-e57973ed65d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:52.399918 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7fcb9-9ca5-435c-bf2f-c439182b7732 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:52.417236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1034/2081] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:52 2022] PUT /identity/v3/projects/c7aef744a723418381ef606c86daa4bd/users/eb5424c4976f4d55b8213ae7b003d26a/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:52.418479 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7fcb9-9ca5-435c-bf2f-c439182b7732 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:52.420460 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-60e7fcb9-9ca5-435c-bf2f-c439182b7732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:52.426869 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:52.460558 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:52.530412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d95e0-7acc-4fd7-b909-e57973ed65d4 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:52.530832 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7fcb9-9ca5-435c-bf2f-c439182b7732 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:52.535987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdde0e-e200-4be1-a764-9fc5b3ed1651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:52.536696 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdde0e-e200-4be1-a764-9fc5b3ed1651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:52.537042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdde0e-e200-4be1-a764-9fc5b3ed1651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:52.537516 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdde0e-e200-4be1-a764-9fc5b3ed1651 admin admin] PATH_INFO: `/v3/projects/bdecd08792804c07a46e8c28ac3e6c08` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:52.538805 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fdde0e-e200-4be1-a764-9fc5b3ed1651 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdecd08792804c07a46e8c28ac3e6c08)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:52.540798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fdde0e-e200-4be1-a764-9fc5b3ed1651 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:52.589572 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bc024-2e3b-42b7-a1e7-1a8eaa1b774b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:52.590499 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bc024-2e3b-42b7-a1e7-1a8eaa1b774b service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:52.591109 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bc024-2e3b-42b7-a1e7-1a8eaa1b774b service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:52.591482 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bc024-2e3b-42b7-a1e7-1a8eaa1b774b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:52.594277 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2f6bc024-2e3b-42b7-a1e7-1a8eaa1b774b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:52.605470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d5fdde0e-e200-4be1-a764-9fc5b3ed1651 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdecd08792804c07a46e8c28ac3e6c08', 'request_id': 'req-d5fdde0e-e200-4be1-a764-9fc5b3ed1651'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:52.621674 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d5fdde0e-e200-4be1-a764-9fc5b3ed1651 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdecd08792804c07a46e8c28ac3e6c08', 'request_id': 'req-d5fdde0e-e200-4be1-a764-9fc5b3ed1651'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:52.630612 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d5fdde0e-e200-4be1-a764-9fc5b3ed1651 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdecd08792804c07a46e8c28ac3e6c08', 'request_id': 'req-d5fdde0e-e200-4be1-a764-9fc5b3ed1651'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:52.645515 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d5fdde0e-e200-4be1-a764-9fc5b3ed1651 admin admin] The token cache is being invalidate because project bdecd08792804c07a46e8c28ac3e6c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:52.646149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d5fdde0e-e200-4be1-a764-9fc5b3ed1651 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:52.647007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d5fdde0e-e200-4be1-a764-9fc5b3ed1651 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:52.649218 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1035/2082] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:52 2022] DELETE /identity/v3/projects/bdecd08792804c07a46e8c28ac3e6c08 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:52.650877 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa357d6-e25b-430c-826d-4cb2fb0f08b1 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:52.651469 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa357d6-e25b-430c-826d-4cb2fb0f08b1 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:52.651883 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa357d6-e25b-430c-826d-4cb2fb0f08b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:52.683511 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-daa357d6-e25b-430c-826d-4cb2fb0f08b1 None None] MFA Rules not processed for user `eb5424c4976f4d55b8213ae7b003d26a`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:52.685829 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-daa357d6-e25b-430c-826d-4cb2fb0f08b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:52.691546 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6bc024-2e3b-42b7-a1e7-1a8eaa1b774b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:52.694072 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6bc024-2e3b-42b7-a1e7-1a8eaa1b774b service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:52.705690 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1048/2083] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 01:05:52.706673 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bc024-2e3b-42b7-a1e7-1a8eaa1b774b service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:52.708027 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2f6bc024-2e3b-42b7-a1e7-1a8eaa1b774b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:52.723043 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bc024-2e3b-42b7-a1e7-1a8eaa1b774b service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:52.797892 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dccd1a-3ee6-466b-99b9-1fe6e3e7872e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:52.799110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dccd1a-3ee6-466b-99b9-1fe6e3e7872e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:52.799529 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dccd1a-3ee6-466b-99b9-1fe6e3e7872e admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:52.799955 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dccd1a-3ee6-466b-99b9-1fe6e3e7872e admin admin] PATH_INFO: `/v3/projects/ee4a0aece9a04a59b29b77b2589f9f50` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:52.801156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dccd1a-3ee6-466b-99b9-1fe6e3e7872e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee4a0aece9a04a59b29b77b2589f9f50)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:52.803513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dccd1a-3ee6-466b-99b9-1fe6e3e7872e admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:52.827321 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1036/2084] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:52.830325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa357d6-e25b-430c-826d-4cb2fb0f08b1 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:52.832961 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-daa357d6-e25b-430c-826d-4cb2fb0f08b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:52.854802 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa357d6-e25b-430c-826d-4cb2fb0f08b1 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:52.861998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1777b-37be-4902-9ed6-0ee2d8365793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:52.863100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1777b-37be-4902-9ed6-0ee2d8365793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:52.863966 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:52.864726 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1777b-37be-4902-9ed6-0ee2d8365793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:52.864726 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1777b-37be-4902-9ed6-0ee2d8365793 admin admin] PATH_INFO: `/v3/users/5cebca4ab0584c9fa667a16dc85b89ce` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:52.866511 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1777b-37be-4902-9ed6-0ee2d8365793 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cebca4ab0584c9fa667a16dc85b89ce)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:52.870260 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1777b-37be-4902-9ed6-0ee2d8365793 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:52.885718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-13dccd1a-3ee6-466b-99b9-1fe6e3e7872e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee4a0aece9a04a59b29b77b2589f9f50', 'request_id': 'req-13dccd1a-3ee6-466b-99b9-1fe6e3e7872e'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:52.893575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:52.895521 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-13dccd1a-3ee6-466b-99b9-1fe6e3e7872e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee4a0aece9a04a59b29b77b2589f9f50', 'request_id': 'req-13dccd1a-3ee6-466b-99b9-1fe6e3e7872e'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:52.907998 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-13dccd1a-3ee6-466b-99b9-1fe6e3e7872e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee4a0aece9a04a59b29b77b2589f9f50', 'request_id': 'req-13dccd1a-3ee6-466b-99b9-1fe6e3e7872e'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:52.931187 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-13dccd1a-3ee6-466b-99b9-1fe6e3e7872e admin admin] The token cache is being invalidate because project ee4a0aece9a04a59b29b77b2589f9f50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:52.931423 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-13dccd1a-3ee6-466b-99b9-1fe6e3e7872e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:52.932276 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-13dccd1a-3ee6-466b-99b9-1fe6e3e7872e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:52.934280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1049/2085] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:52 2022] DELETE /identity/v3/projects/ee4a0aece9a04a59b29b77b2589f9f50 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:52.935081 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dccd1a-3ee6-466b-99b9-1fe6e3e7872e admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:52.937141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-13dccd1a-3ee6-466b-99b9-1fe6e3e7872e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:52.951366 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-eed1777b-37be-4902-9ed6-0ee2d8365793 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cebca4ab0584c9fa667a16dc85b89ce'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:52.952276 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-eed1777b-37be-4902-9ed6-0ee2d8365793 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cebca4ab0584c9fa667a16dc85b89ce'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:52.970257 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-eed1777b-37be-4902-9ed6-0ee2d8365793 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cebca4ab0584c9fa667a16dc85b89ce'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:53.005728 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-eed1777b-37be-4902-9ed6-0ee2d8365793 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cebca4ab0584c9fa667a16dc85b89ce'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:53.007440 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-eed1777b-37be-4902-9ed6-0ee2d8365793 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cebca4ab0584c9fa667a16dc85b89ce'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:53.023481 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1037/2086] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:52 2022] DELETE /identity/v3/users/5cebca4ab0584c9fa667a16dc85b89ce => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:53.026704 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a076893-0fc1-4222-b12c-0422bcc3ccd1 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:53.026704 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a076893-0fc1-4222-b12c-0422bcc3ccd1 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:53.026704 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a076893-0fc1-4222-b12c-0422bcc3ccd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:53.052560 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dccd1a-3ee6-466b-99b9-1fe6e3e7872e admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:53.082198 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-1a076893-0fc1-4222-b12c-0422bcc3ccd1 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:53.085881 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1a076893-0fc1-4222-b12c-0422bcc3ccd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:53.137968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630e068-8c03-4c02-aa2b-6a3431c22b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:53.138542 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630e068-8c03-4c02-aa2b-6a3431c22b6b admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:53.138877 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630e068-8c03-4c02-aa2b-6a3431c22b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:53.139643 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630e068-8c03-4c02-aa2b-6a3431c22b6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:53.141098 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630e068-8c03-4c02-aa2b-6a3431c22b6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:53.144143 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630e068-8c03-4c02-aa2b-6a3431c22b6b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:53.206764 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1050/2087] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:52 2022] POST /identity/v3/projects => generated 385 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:53.206764 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630e068-8c03-4c02-aa2b-6a3431c22b6b admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:53.209441 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6630e068-8c03-4c02-aa2b-6a3431c22b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:53.249517 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1038/2088] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:53.258928 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26d0c4-2c9b-4893-a799-e5f9c2030bb1 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:53.259302 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26d0c4-2c9b-4893-a799-e5f9c2030bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:53.259629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26d0c4-2c9b-4893-a799-e5f9c2030bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:53.281972 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-4a26d0c4-2c9b-4893-a799-e5f9c2030bb1 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:53.283272 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4a26d0c4-2c9b-4893-a799-e5f9c2030bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:53.318664 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:53.344339 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630e068-8c03-4c02-aa2b-6a3431c22b6b admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:53.349656 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24419a95-9d8a-4e47-8185-fadd44f1d089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:53.350377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24419a95-9d8a-4e47-8185-fadd44f1d089 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:53.350727 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24419a95-9d8a-4e47-8185-fadd44f1d089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:53.351066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24419a95-9d8a-4e47-8185-fadd44f1d089 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:53.351771 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24419a95-9d8a-4e47-8185-fadd44f1d089 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:53.354275 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24419a95-9d8a-4e47-8185-fadd44f1d089 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:53.386783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1051/2089] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:53 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:05:53.389461 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24419a95-9d8a-4e47-8185-fadd44f1d089 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:53.399105 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1039/2090] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:05:53.407824 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26d0c4-2c9b-4893-a799-e5f9c2030bb1 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:53.412419 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24419a95-9d8a-4e47-8185-fadd44f1d089 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:53.419540 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26d0c4-2c9b-4893-a799-e5f9c2030bb1 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:53.425695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9ef49-0f0e-4e64-b0ce-a7e28364dd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:53.426474 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9ef49-0f0e-4e64-b0ce-a7e28364dd28 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:53.426753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9ef49-0f0e-4e64-b0ce-a7e28364dd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:53.427026 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9ef49-0f0e-4e64-b0ce-a7e28364dd28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:53.427674 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9ef49-0f0e-4e64-b0ce-a7e28364dd28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:05:53.427977 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23713ef3-5de9-4652-b3a8-f914d88e7786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:53.428110 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9ef49-0f0e-4e64-b0ce-a7e28364dd28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:53.428599 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23713ef3-5de9-4652-b3a8-f914d88e7786 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:53.428876 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23713ef3-5de9-4652-b3a8-f914d88e7786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:53.429278 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23713ef3-5de9-4652-b3a8-f914d88e7786 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:53.429671 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9ef49-0f0e-4e64-b0ce-a7e28364dd28 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:53.429950 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23713ef3-5de9-4652-b3a8-f914d88e7786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:53.431527 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23713ef3-5de9-4652-b3a8-f914d88e7786 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:53.444877 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1040/2091] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:05:53.450068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9ef49-0f0e-4e64-b0ce-a7e28364dd28 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:53.452258 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1052/2092] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 01:05:53.457692 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23713ef3-5de9-4652-b3a8-f914d88e7786 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:53.462110 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9ef49-0f0e-4e64-b0ce-a7e28364dd28 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:53.470892 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec2ce0-6969-4557-a6e3-fb5120a2dc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:53.471993 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec2ce0-6969-4557-a6e3-fb5120a2dc91 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:53.472429 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec2ce0-6969-4557-a6e3-fb5120a2dc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:53.472689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec2ce0-6969-4557-a6e3-fb5120a2dc91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:53.473336 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec2ce0-6969-4557-a6e3-fb5120a2dc91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:53.475704 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec2ce0-6969-4557-a6e3-fb5120a2dc91 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:53.499339 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23713ef3-5de9-4652-b3a8-f914d88e7786 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:53.512030 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417d0e8-90f4-46fe-a75c-52048191813a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:53.513789 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417d0e8-90f4-46fe-a75c-52048191813a admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:53.515263 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:53.516206 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417d0e8-90f4-46fe-a75c-52048191813a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:53.518119 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417d0e8-90f4-46fe-a75c-52048191813a admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:53.520123 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417d0e8-90f4-46fe-a75c-52048191813a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:53.522460 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417d0e8-90f4-46fe-a75c-52048191813a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:53.534526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1041/2093] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:53 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:53.537234 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec2ce0-6969-4557-a6e3-fb5120a2dc91 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:53.540442 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3dec2ce0-6969-4557-a6e3-fb5120a2dc91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:53.549563 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1053/2094] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:53.554107 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417d0e8-90f4-46fe-a75c-52048191813a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:53.577675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417d0e8-90f4-46fe-a75c-52048191813a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:53.644628 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec2ce0-6969-4557-a6e3-fb5120a2dc91 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:53.653130 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3dc53-bb0e-4285-9d5f-28518f9c7fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:53.654022 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3dc53-bb0e-4285-9d5f-28518f9c7fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:53.658136 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3dc53-bb0e-4285-9d5f-28518f9c7fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:53.658630 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3dc53-bb0e-4285-9d5f-28518f9c7fd8 admin admin] PATH_INFO: `/v3/projects/a0777435f1484c849c8d35bc0996cefd` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:53.660490 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3dc53-bb0e-4285-9d5f-28518f9c7fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0777435f1484c849c8d35bc0996cefd)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:53.662719 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3dc53-bb0e-4285-9d5f-28518f9c7fd8 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:53.663828 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce184113-b718-48a1-9aa9-0a53a42d66fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:53.664630 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce184113-b718-48a1-9aa9-0a53a42d66fb admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:53.664984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce184113-b718-48a1-9aa9-0a53a42d66fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:53.665323 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce184113-b718-48a1-9aa9-0a53a42d66fb admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:53.666111 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce184113-b718-48a1-9aa9-0a53a42d66fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:53.668263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce184113-b718-48a1-9aa9-0a53a42d66fb admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:53.696796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1054/2095] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:53 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:53.697687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce184113-b718-48a1-9aa9-0a53a42d66fb admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:53.712669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce184113-b718-48a1-9aa9-0a53a42d66fb admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:53.719764 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91902a7b-bfd2-42e1-bd12-b483ebfb3114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:53.720501 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91902a7b-bfd2-42e1-bd12-b483ebfb3114 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:53.720779 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91902a7b-bfd2-42e1-bd12-b483ebfb3114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:53.721052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91902a7b-bfd2-42e1-bd12-b483ebfb3114 admin admin] PATH_INFO: `/v3/projects/aa0629d68b584c998687826f8139833a/users/9e96d398768246d7ae1511de9257e053/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:53.733453 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b9e3dc53-bb0e-4285-9d5f-28518f9c7fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0777435f1484c849c8d35bc0996cefd', 'request_id': 'req-b9e3dc53-bb0e-4285-9d5f-28518f9c7fd8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:53.736746 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91902a7b-bfd2-42e1-bd12-b483ebfb3114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa0629d68b584c998687826f8139833a, user_id=9e96d398768246d7ae1511de9257e053, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:53.739813 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91902a7b-bfd2-42e1-bd12-b483ebfb3114 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:53.750692 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b9e3dc53-bb0e-4285-9d5f-28518f9c7fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0777435f1484c849c8d35bc0996cefd', 'request_id': 'req-b9e3dc53-bb0e-4285-9d5f-28518f9c7fd8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:53.756442 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1055/2096] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:53 2022] PUT /identity/v3/projects/aa0629d68b584c998687826f8139833a/users/9e96d398768246d7ae1511de9257e053/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:53.757436 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91902a7b-bfd2-42e1-bd12-b483ebfb3114 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:53.758123 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b9e3dc53-bb0e-4285-9d5f-28518f9c7fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0777435f1484c849c8d35bc0996cefd', 'request_id': 'req-b9e3dc53-bb0e-4285-9d5f-28518f9c7fd8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:53.771945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b9e3dc53-bb0e-4285-9d5f-28518f9c7fd8 admin admin] The token cache is being invalidate because project a0777435f1484c849c8d35bc0996cefd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:53.772269 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b9e3dc53-bb0e-4285-9d5f-28518f9c7fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:53.772969 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b9e3dc53-bb0e-4285-9d5f-28518f9c7fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:53.774717 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1042/2097] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:53 2022] DELETE /identity/v3/projects/a0777435f1484c849c8d35bc0996cefd => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:53.779206 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc19b6-a2f2-4b69-9beb-ffd929024476 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:53.779496 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc19b6-a2f2-4b69-9beb-ffd929024476 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:53.779800 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc19b6-a2f2-4b69-9beb-ffd929024476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:53.809500 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-5afc19b6-a2f2-4b69-9beb-ffd929024476 None None] MFA Rules not processed for user `9e96d398768246d7ae1511de9257e053`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:53.810840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5afc19b6-a2f2-4b69-9beb-ffd929024476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:53.838005 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91902a7b-bfd2-42e1-bd12-b483ebfb3114 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:53.843829 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8f9cf-2f34-4cbe-951a-b2030642808e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:53.844650 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8f9cf-2f34-4cbe-951a-b2030642808e admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:53.844926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8f9cf-2f34-4cbe-951a-b2030642808e admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:53.845195 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8f9cf-2f34-4cbe-951a-b2030642808e admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:53.845870 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8f9cf-2f34-4cbe-951a-b2030642808e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:53.847658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8f9cf-2f34-4cbe-951a-b2030642808e admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:53.861888 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1056/2098] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:53.863242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab9705-6452-4430-b063-698bc7eb09a6 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:53.863522 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab9705-6452-4430-b063-698bc7eb09a6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:53.863789 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab9705-6452-4430-b063-698bc7eb09a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:53.892305 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-29ab9705-6452-4430-b063-698bc7eb09a6 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:53.894434 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-29ab9705-6452-4430-b063-698bc7eb09a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:53.909426 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1057/2099] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:53.911479 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1043/2100] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:53.914693 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab9705-6452-4430-b063-698bc7eb09a6 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:53.916319 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-29ab9705-6452-4430-b063-698bc7eb09a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:53.920392 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a53270-6c33-47ea-bd82-1dec01b76e31 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:53.920694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a53270-6c33-47ea-bd82-1dec01b76e31 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:53.920967 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a53270-6c33-47ea-bd82-1dec01b76e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:53.940502 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab9705-6452-4430-b063-698bc7eb09a6 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:53.946583 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c06b34-b28c-45e8-adfe-d8f581d408a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:53.947372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c06b34-b28c-45e8-adfe-d8f581d408a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:53.947597 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-98a53270-6c33-47ea-bd82-1dec01b76e31 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:53.948082 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c06b34-b28c-45e8-adfe-d8f581d408a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:53.948451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c06b34-b28c-45e8-adfe-d8f581d408a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:53.948787 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-98a53270-6c33-47ea-bd82-1dec01b76e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:53.949488 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c06b34-b28c-45e8-adfe-d8f581d408a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:53.952145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c06b34-b28c-45e8-adfe-d8f581d408a1 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:53.958480 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1044/2101] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:53.959411 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a53270-6c33-47ea-bd82-1dec01b76e31 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:53.960676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-98a53270-6c33-47ea-bd82-1dec01b76e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:53.973122 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a53270-6c33-47ea-bd82-1dec01b76e31 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:53.974038 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1058/2102] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:53.974964 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c06b34-b28c-45e8-adfe-d8f581d408a1 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:53.978301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29080184-a9e9-43ca-ac65-a12e06a8ac85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:53.978918 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29080184-a9e9-43ca-ac65-a12e06a8ac85 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:53.979211 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29080184-a9e9-43ca-ac65-a12e06a8ac85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:53.979484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29080184-a9e9-43ca-ac65-a12e06a8ac85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:53.980109 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29080184-a9e9-43ca-ac65-a12e06a8ac85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:53.982512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29080184-a9e9-43ca-ac65-a12e06a8ac85 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:53.992531 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:54.009773 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:54.016457 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c06b34-b28c-45e8-adfe-d8f581d408a1 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:54.023625 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2adb5f-c9c9-4378-82d9-05983365f89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:54.024538 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2adb5f-c9c9-4378-82d9-05983365f89d admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:54.024832 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2adb5f-c9c9-4378-82d9-05983365f89d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:54.025226 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2adb5f-c9c9-4378-82d9-05983365f89d admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:54.026678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2adb5f-c9c9-4378-82d9-05983365f89d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:05:54.026995 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2adb5f-c9c9-4378-82d9-05983365f89d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:54.029415 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2adb5f-c9c9-4378-82d9-05983365f89d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:54.035916 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1045/2103] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:53 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:54.036944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29080184-a9e9-43ca-ac65-a12e06a8ac85 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:54.056938 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1059/2104] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:05:54.061566 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2adb5f-c9c9-4378-82d9-05983365f89d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:54.074255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2adb5f-c9c9-4378-82d9-05983365f89d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:54.170632 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90347b5a-b4d6-489e-b6ed-63060f45c8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:54.171721 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90347b5a-b4d6-489e-b6ed-63060f45c8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:54.172175 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90347b5a-b4d6-489e-b6ed-63060f45c8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:54.172567 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90347b5a-b4d6-489e-b6ed-63060f45c8b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:54.173403 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90347b5a-b4d6-489e-b6ed-63060f45c8b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:54.174583 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29080184-a9e9-43ca-ac65-a12e06a8ac85 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:54.181509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90347b5a-b4d6-489e-b6ed-63060f45c8b0 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:54.183694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff132e-7f59-4f7b-835b-8354dc8b367f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:54.184315 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff132e-7f59-4f7b-835b-8354dc8b367f admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:54.184596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff132e-7f59-4f7b-835b-8354dc8b367f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:54.185039 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff132e-7f59-4f7b-835b-8354dc8b367f admin admin] PATH_INFO: `/v3/projects/60a943ca092443e392084bb6ef44a623/users/f7368f2c6d934517b4b71206473795f4/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:54.210146 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff132e-7f59-4f7b-835b-8354dc8b367f admin admin] RBAC: Authorizing `identity:create_grant(project_id=60a943ca092443e392084bb6ef44a623, user_id=f7368f2c6d934517b4b71206473795f4, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:54.213018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff132e-7f59-4f7b-835b-8354dc8b367f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:54.231838 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1060/2105] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:54 2022] POST /identity/v3/users => generated 299 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:54.233016 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1046/2106] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:54 2022] PUT /identity/v3/projects/60a943ca092443e392084bb6ef44a623/users/f7368f2c6d934517b4b71206473795f4/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:54.234955 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90347b5a-b4d6-489e-b6ed-63060f45c8b0 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:54.236015 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff132e-7f59-4f7b-835b-8354dc8b367f admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:54.247820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90347b5a-b4d6-489e-b6ed-63060f45c8b0 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:54.341475 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8bc3e-f8dd-43b6-8965-4547eadc5783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:54.342826 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8bc3e-f8dd-43b6-8965-4547eadc5783 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:54.343113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8bc3e-f8dd-43b6-8965-4547eadc5783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:54.343418 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8bc3e-f8dd-43b6-8965-4547eadc5783 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:54.344061 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8bc3e-f8dd-43b6-8965-4547eadc5783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:54.347208 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8bc3e-f8dd-43b6-8965-4547eadc5783 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:54.354419 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff132e-7f59-4f7b-835b-8354dc8b367f admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:54.359820 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b4102-542b-4f15-8680-eee1eff37e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:54.360953 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b4102-542b-4f15-8680-eee1eff37e78 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:54.361275 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b4102-542b-4f15-8680-eee1eff37e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:54.361650 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b4102-542b-4f15-8680-eee1eff37e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:54.362475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b4102-542b-4f15-8680-eee1eff37e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:54.364488 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b4102-542b-4f15-8680-eee1eff37e78 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:54.392395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1047/2107] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:54.401862 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1061/2108] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:54 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:54.401862 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8bc3e-f8dd-43b6-8965-4547eadc5783 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:54.402071 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4355cf8-a80f-48a2-bd00-1374dea799e1 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:54.402071 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4355cf8-a80f-48a2-bd00-1374dea799e1 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:54.402071 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4355cf8-a80f-48a2-bd00-1374dea799e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:54.431200 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-e4355cf8-a80f-48a2-bd00-1374dea799e1 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:54.432568 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e4355cf8-a80f-48a2-bd00-1374dea799e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:54.484662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8bc3e-f8dd-43b6-8965-4547eadc5783 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:54.490725 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28881cb5-250f-4435-a27a-d533a66eae59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:54.491620 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28881cb5-250f-4435-a27a-d533a66eae59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:54.491919 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28881cb5-250f-4435-a27a-d533a66eae59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:54.492535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28881cb5-250f-4435-a27a-d533a66eae59 admin admin] PATH_INFO: `/v3/projects/c77d4d2bc259424c9a0ff6f99e92195d/users/d43f621256a14610b7f94d904dbd13cc/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:54.507400 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1048/2109] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:54.507400 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4355cf8-a80f-48a2-bd00-1374dea799e1 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:54.512174 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:54.518147 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28881cb5-250f-4435-a27a-d533a66eae59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c77d4d2bc259424c9a0ff6f99e92195d, user_id=d43f621256a14610b7f94d904dbd13cc, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:54.521821 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28881cb5-250f-4435-a27a-d533a66eae59 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:54.531373 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4355cf8-a80f-48a2-bd00-1374dea799e1 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:54.540557 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1062/2110] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:54 2022] PUT /identity/v3/projects/c77d4d2bc259424c9a0ff6f99e92195d/users/d43f621256a14610b7f94d904dbd13cc/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:54.541725 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28881cb5-250f-4435-a27a-d533a66eae59 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:54.543016 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:54.544618 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-28881cb5-250f-4435-a27a-d533a66eae59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:54.629752 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091526e4-5edf-41c5-9817-5ddc67b2f468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:54.630745 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091526e4-5edf-41c5-9817-5ddc67b2f468 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:54.631074 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091526e4-5edf-41c5-9817-5ddc67b2f468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:54.631390 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091526e4-5edf-41c5-9817-5ddc67b2f468 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:54.632092 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091526e4-5edf-41c5-9817-5ddc67b2f468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:54.634760 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091526e4-5edf-41c5-9817-5ddc67b2f468 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:54.635791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28881cb5-250f-4435-a27a-d533a66eae59 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:54.646464 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196d70a-6261-49b7-8b8e-53280d127787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:54.648015 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196d70a-6261-49b7-8b8e-53280d127787 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:54.649281 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196d70a-6261-49b7-8b8e-53280d127787 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:54.649832 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196d70a-6261-49b7-8b8e-53280d127787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:54.663722 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196d70a-6261-49b7-8b8e-53280d127787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:54.667734 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1049/2111] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:54 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:54.668803 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091526e4-5edf-41c5-9817-5ddc67b2f468 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:54.670746 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196d70a-6261-49b7-8b8e-53280d127787 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:54.716303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091526e4-5edf-41c5-9817-5ddc67b2f468 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:54.724591 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f98d3-00b7-44bb-840a-b1b6703b6111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:54.725297 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f98d3-00b7-44bb-840a-b1b6703b6111 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:54.725702 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f98d3-00b7-44bb-840a-b1b6703b6111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:54.726095 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f98d3-00b7-44bb-840a-b1b6703b6111 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:54.726859 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f98d3-00b7-44bb-840a-b1b6703b6111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:54.733515 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f98d3-00b7-44bb-840a-b1b6703b6111 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:54.740841 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1050/2112] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:54.741764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f98d3-00b7-44bb-840a-b1b6703b6111 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:54.743447 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1063/2113] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:54.744620 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196d70a-6261-49b7-8b8e-53280d127787 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:54.754939 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f98d3-00b7-44bb-840a-b1b6703b6111 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:54.762279 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b233a-b9ab-4a56-88f8-0bf8365c3b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:54.762644 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b233a-b9ab-4a56-88f8-0bf8365c3b86 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:54.763025 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b233a-b9ab-4a56-88f8-0bf8365c3b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:54.763450 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b233a-b9ab-4a56-88f8-0bf8365c3b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:54.764347 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b233a-b9ab-4a56-88f8-0bf8365c3b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:54.767449 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b233a-b9ab-4a56-88f8-0bf8365c3b86 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:54.775647 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196d70a-6261-49b7-8b8e-53280d127787 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:54.780765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411c110-1990-4439-92c7-9b701d7d0486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:54.782032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411c110-1990-4439-92c7-9b701d7d0486 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:54.782308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411c110-1990-4439-92c7-9b701d7d0486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:54.782580 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411c110-1990-4439-92c7-9b701d7d0486 admin admin] PATH_INFO: `/v3/projects/c77d4d2bc259424c9a0ff6f99e92195d/users/d43f621256a14610b7f94d904dbd13cc/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:54.784546 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3411c110-1990-4439-92c7-9b701d7d0486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c77d4d2bc259424c9a0ff6f99e92195d, user_id=d43f621256a14610b7f94d904dbd13cc, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:54.787466 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3411c110-1990-4439-92c7-9b701d7d0486 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:54.798120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1051/2114] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:54.799731 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b233a-b9ab-4a56-88f8-0bf8365c3b86 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:54.801586 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1064/2115] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:54 2022] PUT /identity/v3/projects/c77d4d2bc259424c9a0ff6f99e92195d/users/d43f621256a14610b7f94d904dbd13cc/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:54.814949 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d6642-7d4e-4c0d-b3df-bea766e5c2fa None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:54.815358 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d6642-7d4e-4c0d-b3df-bea766e5c2fa None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:54.815823 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d6642-7d4e-4c0d-b3df-bea766e5c2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:54.826531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b233a-b9ab-4a56-88f8-0bf8365c3b86 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:54.850117 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-416d6642-7d4e-4c0d-b3df-bea766e5c2fa None None] MFA Rules not processed for user `d43f621256a14610b7f94d904dbd13cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:54.851785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-416d6642-7d4e-4c0d-b3df-bea766e5c2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:54.965635 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4d74b-9d15-4296-9a58-89d207d8fe6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:54.966412 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4d74b-9d15-4296-9a58-89d207d8fe6c admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:54.966641 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4d74b-9d15-4296-9a58-89d207d8fe6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:54.966993 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4d74b-9d15-4296-9a58-89d207d8fe6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:54.967597 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4d74b-9d15-4296-9a58-89d207d8fe6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:54.973660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4d74b-9d15-4296-9a58-89d207d8fe6c admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:55.001411 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1052/2116] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:55.002452 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4d74b-9d15-4296-9a58-89d207d8fe6c admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:55.011678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1065/2117] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:55.020310 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d6642-7d4e-4c0d-b3df-bea766e5c2fa None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:55.022492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-416d6642-7d4e-4c0d-b3df-bea766e5c2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:55.033330 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4d74b-9d15-4296-9a58-89d207d8fe6c admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:55.042182 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278775dd-1535-4a0a-b4b6-b726d622750f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:55.043617 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278775dd-1535-4a0a-b4b6-b726d622750f admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:55.044396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278775dd-1535-4a0a-b4b6-b726d622750f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:55.044563 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278775dd-1535-4a0a-b4b6-b726d622750f admin admin] PATH_INFO: `/v3/projects/9f2006bb38e44dc3a5d7f609e758acce/users/f0ec4cf74d7b4c708c2fcbda3a4657da/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:55.068675 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278775dd-1535-4a0a-b4b6-b726d622750f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f2006bb38e44dc3a5d7f609e758acce, user_id=f0ec4cf74d7b4c708c2fcbda3a4657da, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:55.071752 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278775dd-1535-4a0a-b4b6-b726d622750f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:55.099116 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1053/2118] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:55 2022] PUT /identity/v3/projects/9f2006bb38e44dc3a5d7f609e758acce/users/f0ec4cf74d7b4c708c2fcbda3a4657da/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:55.109963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab9473-f1ba-4272-92aa-cf01b9f37f6a None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:55.110528 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab9473-f1ba-4272-92aa-cf01b9f37f6a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:55.111004 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab9473-f1ba-4272-92aa-cf01b9f37f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:55.155654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-14ab9473-f1ba-4272-92aa-cf01b9f37f6a None None] MFA Rules not processed for user `f0ec4cf74d7b4c708c2fcbda3a4657da`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:55.158317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-14ab9473-f1ba-4272-92aa-cf01b9f37f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:55.171352 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d6642-7d4e-4c0d-b3df-bea766e5c2fa None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:55.215722 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:55.254979 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:55.280597 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bd129-85e2-46ee-be9a-6783950e1de8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:55.282090 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bd129-85e2-46ee-be9a-6783950e1de8 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:55.282772 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bd129-85e2-46ee-be9a-6783950e1de8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:55.283543 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bd129-85e2-46ee-be9a-6783950e1de8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:55.285488 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ec3bd129-85e2-46ee-be9a-6783950e1de8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:55.294738 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1054/2119] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:05:55.299915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab9473-f1ba-4272-92aa-cf01b9f37f6a None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:55.387090 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3bd129-85e2-46ee-be9a-6783950e1de8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:55.389504 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3bd129-85e2-46ee-be9a-6783950e1de8 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:55.427043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab9473-f1ba-4272-92aa-cf01b9f37f6a None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:55.447808 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1066/2120] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:55.457662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa6372-6811-4015-9945-cfa360d454e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:55.461061 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa6372-6811-4015-9945-cfa360d454e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:55.462500 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa6372-6811-4015-9945-cfa360d454e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:55.462914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa6372-6811-4015-9945-cfa360d454e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:55.463919 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa6372-6811-4015-9945-cfa360d454e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:55.471454 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa6372-6811-4015-9945-cfa360d454e0 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:55.535862 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1055/2121] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:55 2022] POST /identity/v3/projects => generated 379 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:55.540135 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bd129-85e2-46ee-be9a-6783950e1de8 service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:55.559274 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bd129-85e2-46ee-be9a-6783950e1de8 service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:55.707320 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1a6f9-640b-436b-a20b-f4389f4bcce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:55.708433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1a6f9-640b-436b-a20b-f4389f4bcce1 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:55.708913 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1a6f9-640b-436b-a20b-f4389f4bcce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:55.709459 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1a6f9-640b-436b-a20b-f4389f4bcce1 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:55.711046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1a6f9-640b-436b-a20b-f4389f4bcce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:55.715531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3caf84-262c-41ab-bac5-a4a2d2f699e5 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:55.716009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3caf84-262c-41ab-bac5-a4a2d2f699e5 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:55.716318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3caf84-262c-41ab-bac5-a4a2d2f699e5 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:55.721886 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1056/2122] 10.222.0.20 () {54 vars in 921 bytes} [Wed Sep 14 01:05:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 01:05:55.730527 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f02d0-9e99-40a2-a287-cd577feeb7e3 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:55.730815 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f02d0-9e99-40a2-a287-cd577feeb7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:55.731090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f02d0-9e99-40a2-a287-cd577feeb7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:55.731387 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1a6f9-640b-436b-a20b-f4389f4bcce1 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:55.777719 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-201f02d0-9e99-40a2-a287-cd577feeb7e3 None None] MFA Rules not processed for user `abf9ab5fafe94afdb3ebe98536b5cc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:55.778655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-201f02d0-9e99-40a2-a287-cd577feeb7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:55.790657 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1067/2123] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:55 2022] POST /identity/v3/users => generated 290 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:55.795744 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1a6f9-640b-436b-a20b-f4389f4bcce1 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:55.800645 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1ee1a6f9-640b-436b-a20b-f4389f4bcce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:55.850400 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1a6f9-640b-436b-a20b-f4389f4bcce1 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:55.860420 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd5480-9b44-4988-9d66-c85fdae34f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:55.862508 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd5480-9b44-4988-9d66-c85fdae34f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:55.863521 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd5480-9b44-4988-9d66-c85fdae34f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:55.863798 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd5480-9b44-4988-9d66-c85fdae34f3a admin admin] PATH_INFO: `/v3/users/0cf99358484c49c8bb4b55f4d0d852bd` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:55.870665 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd5480-9b44-4988-9d66-c85fdae34f3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cf99358484c49c8bb4b55f4d0d852bd)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:55.872605 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd5480-9b44-4988-9d66-c85fdae34f3a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:55.911906 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1057/2124] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Sep 14 01:05:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:55.913661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f02d0-9e99-40a2-a287-cd577feeb7e3 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:55.937387 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f02d0-9e99-40a2-a287-cd577feeb7e3 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:55.943421 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f20c9-d595-4d71-86eb-fdea08035b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:55.944138 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f20c9-d595-4d71-86eb-fdea08035b50 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:55.944509 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f20c9-d595-4d71-86eb-fdea08035b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:55.944871 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f20c9-d595-4d71-86eb-fdea08035b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:55.945592 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f20c9-d595-4d71-86eb-fdea08035b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:55.947619 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f20c9-d595-4d71-86eb-fdea08035b50 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:55.968171 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1058/2125] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:55.970414 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623ff4f-e54c-492e-aae1-c4c8fa0cfcf3 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:55.970698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623ff4f-e54c-492e-aae1-c4c8fa0cfcf3 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:55.971028 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623ff4f-e54c-492e-aae1-c4c8fa0cfcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:55.986669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0abd5480-9b44-4988-9d66-c85fdae34f3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cf99358484c49c8bb4b55f4d0d852bd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:56.001244 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0abd5480-9b44-4988-9d66-c85fdae34f3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cf99358484c49c8bb4b55f4d0d852bd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:56.003665 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:56.048870 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0abd5480-9b44-4988-9d66-c85fdae34f3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cf99358484c49c8bb4b55f4d0d852bd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:56.050223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-c623ff4f-e54c-492e-aae1-c4c8fa0cfcf3 None None] MFA Rules not processed for user `f7368f2c6d934517b4b71206473795f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:56.052695 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0abd5480-9b44-4988-9d66-c85fdae34f3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cf99358484c49c8bb4b55f4d0d852bd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:56.053366 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0abd5480-9b44-4988-9d66-c85fdae34f3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cf99358484c49c8bb4b55f4d0d852bd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:56.056208 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c623ff4f-e54c-492e-aae1-c4c8fa0cfcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:56.083025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1068/2126] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:55 2022] DELETE /identity/v3/users/0cf99358484c49c8bb4b55f4d0d852bd => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:56.084270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd5480-9b44-4988-9d66-c85fdae34f3a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:56.086081 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0abd5480-9b44-4988-9d66-c85fdae34f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:56.173365 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:56.203605 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1059/2127] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:56.204431 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623ff4f-e54c-492e-aae1-c4c8fa0cfcf3 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:56.205903 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c623ff4f-e54c-492e-aae1-c4c8fa0cfcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:56.221448 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623ff4f-e54c-492e-aae1-c4c8fa0cfcf3 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:56.230032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd5480-9b44-4988-9d66-c85fdae34f3a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:56.238629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137b891-dc43-4f0a-9246-2d4f34e997ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abf9ab5fafe94afdb3ebe98536b5cc3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:56.239426 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137b891-dc43-4f0a-9246-2d4f34e997ab service placement] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:56.239867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137b891-dc43-4f0a-9246-2d4f34e997ab service placement] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:56.240234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137b891-dc43-4f0a-9246-2d4f34e997ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:56.242613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7137b891-dc43-4f0a-9246-2d4f34e997ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:56.257963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137b891-dc43-4f0a-9246-2d4f34e997ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:56.259574 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137b891-dc43-4f0a-9246-2d4f34e997ab service placement] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:56.270158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1069/2128] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:56.270774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137b891-dc43-4f0a-9246-2d4f34e997ab service placement] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:56.272093 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7137b891-dc43-4f0a-9246-2d4f34e997ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:56.292395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0114941-fc89-4788-81ca-57b0f1765da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:56.293215 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0114941-fc89-4788-81ca-57b0f1765da0 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:56.293577 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0114941-fc89-4788-81ca-57b0f1765da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:56.293979 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0114941-fc89-4788-81ca-57b0f1765da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:56.294752 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0114941-fc89-4788-81ca-57b0f1765da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:56.296980 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0114941-fc89-4788-81ca-57b0f1765da0 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:56.316445 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1060/2129] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:56.317511 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0114941-fc89-4788-81ca-57b0f1765da0 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:56.329951 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0114941-fc89-4788-81ca-57b0f1765da0 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:56.337566 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e94e68-cb77-4653-a283-4f85f64189e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:56.338549 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e94e68-cb77-4653-a283-4f85f64189e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:56.339119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e94e68-cb77-4653-a283-4f85f64189e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:56.339785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e94e68-cb77-4653-a283-4f85f64189e2 admin admin] PATH_INFO: `/v3/projects/477fd6ac3c654dac848b194298dea0b1/users/426e54068f884adb9174e1c4f3a8c747/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:56.348011 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137b891-dc43-4f0a-9246-2d4f34e997ab service placement] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:56.355012 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6edddec-8d3e-4361-a833-f69c7c640e61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:56.355628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edddec-8d3e-4361-a833-f69c7c640e61 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:56.355902 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edddec-8d3e-4361-a833-f69c7c640e61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:56.356172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edddec-8d3e-4361-a833-f69c7c640e61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:56.357619 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e94e68-cb77-4653-a283-4f85f64189e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=477fd6ac3c654dac848b194298dea0b1, user_id=426e54068f884adb9174e1c4f3a8c747, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:56.361728 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e94e68-cb77-4653-a283-4f85f64189e2 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:56.377969 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1061/2130] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:56 2022] PUT /identity/v3/projects/477fd6ac3c654dac848b194298dea0b1/users/426e54068f884adb9174e1c4f3a8c747/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:56.383387 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e94e68-cb77-4653-a283-4f85f64189e2 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:56.387509 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e0e94e68-cb77-4653-a283-4f85f64189e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:56.429059 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6edddec-8d3e-4361-a833-f69c7c640e61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:56.430649 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6edddec-8d3e-4361-a833-f69c7c640e61 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:56.441327 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1070/2131] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:56.442638 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b8fef-6a3b-4514-9dac-1f4e8a66fee7 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:56.443067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b8fef-6a3b-4514-9dac-1f4e8a66fee7 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:56.443320 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b8fef-6a3b-4514-9dac-1f4e8a66fee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:56.469112 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e94e68-cb77-4653-a283-4f85f64189e2 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:56.476064 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-077b8fef-6a3b-4514-9dac-1f4e8a66fee7 None None] MFA Rules not processed for user `426e54068f884adb9174e1c4f3a8c747`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:56.477105 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf911c6-b5ca-4b4b-b1eb-9dff34ed2820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:56.477467 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-077b8fef-6a3b-4514-9dac-1f4e8a66fee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:56.477927 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf911c6-b5ca-4b4b-b1eb-9dff34ed2820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:56.478327 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf911c6-b5ca-4b4b-b1eb-9dff34ed2820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:56.478800 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf911c6-b5ca-4b4b-b1eb-9dff34ed2820 admin admin] PATH_INFO: `/v3/projects/432ef291111b4c1fba8630190dff0c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:56.480121 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf911c6-b5ca-4b4b-b1eb-9dff34ed2820 admin admin] RBAC: Authorizing `identity:delete_project(project_id=432ef291111b4c1fba8630190dff0c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:56.483712 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf911c6-b5ca-4b4b-b1eb-9dff34ed2820 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:56.493672 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:56.550915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3cf911c6-b5ca-4b4b-b1eb-9dff34ed2820 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '432ef291111b4c1fba8630190dff0c53', 'request_id': 'req-3cf911c6-b5ca-4b4b-b1eb-9dff34ed2820'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:56.556331 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:56.563660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3cf911c6-b5ca-4b4b-b1eb-9dff34ed2820 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '432ef291111b4c1fba8630190dff0c53', 'request_id': 'req-3cf911c6-b5ca-4b4b-b1eb-9dff34ed2820'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:56.577252 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3cf911c6-b5ca-4b4b-b1eb-9dff34ed2820 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '432ef291111b4c1fba8630190dff0c53', 'request_id': 'req-3cf911c6-b5ca-4b4b-b1eb-9dff34ed2820'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:56.600356 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3cf911c6-b5ca-4b4b-b1eb-9dff34ed2820 admin admin] The token cache is being invalidate because project 432ef291111b4c1fba8630190dff0c53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:56.602136 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3cf911c6-b5ca-4b4b-b1eb-9dff34ed2820 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:56.603282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3cf911c6-b5ca-4b4b-b1eb-9dff34ed2820 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:56.606162 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1071/2133] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:56.606359 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1062/2133] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:56 2022] DELETE /identity/v3/projects/432ef291111b4c1fba8630190dff0c53 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:56.611039 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b8fef-6a3b-4514-9dac-1f4e8a66fee7 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:56.617155 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa575e-0e7b-4630-a7c3-f32c0ef2ce62 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:56.617600 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa575e-0e7b-4630-a7c3-f32c0ef2ce62 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:56.618196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa575e-0e7b-4630-a7c3-f32c0ef2ce62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:56.632808 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b8fef-6a3b-4514-9dac-1f4e8a66fee7 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:56.651503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-f2fa575e-0e7b-4630-a7c3-f32c0ef2ce62 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:56.653195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f2fa575e-0e7b-4630-a7c3-f32c0ef2ce62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:56.747202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069aa675-1930-4dc2-b44d-e168a3c85169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:56.747837 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069aa675-1930-4dc2-b44d-e168a3c85169 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:56.748230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069aa675-1930-4dc2-b44d-e168a3c85169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:56.748515 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069aa675-1930-4dc2-b44d-e168a3c85169 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:56.749221 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069aa675-1930-4dc2-b44d-e168a3c85169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:56.753112 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1063/2134] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:56.761334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6a1d4-20a3-434f-b632-f0eb5edee0ea None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:56.761648 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6a1d4-20a3-434f-b632-f0eb5edee0ea None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:56.761973 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6a1d4-20a3-434f-b632-f0eb5edee0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:56.763023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069aa675-1930-4dc2-b44d-e168a3c85169 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:56.801084 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-c9a6a1d4-20a3-434f-b632-f0eb5edee0ea None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:56.804986 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c9a6a1d4-20a3-434f-b632-f0eb5edee0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:56.836051 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1072/2135] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:56 2022] POST /identity/v3/projects => generated 377 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:56.839894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069aa675-1930-4dc2-b44d-e168a3c85169 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:56.844113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1064/2136] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:56.845949 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6a1d4-20a3-434f-b632-f0eb5edee0ea None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:56.849437 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-069aa675-1930-4dc2-b44d-e168a3c85169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:56.884926 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6a1d4-20a3-434f-b632-f0eb5edee0ea None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:56.978223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bcbe1-b8ec-4a9e-b8f5-265b79e34d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:56.978828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bcbe1-b8ec-4a9e-b8f5-265b79e34d76 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:56.979108 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bcbe1-b8ec-4a9e-b8f5-265b79e34d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:56.979375 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bcbe1-b8ec-4a9e-b8f5-265b79e34d76 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:56.980020 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64bcbe1-b8ec-4a9e-b8f5-265b79e34d76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:05:56.980321 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64bcbe1-b8ec-4a9e-b8f5-265b79e34d76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:56.985076 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64bcbe1-b8ec-4a9e-b8f5-265b79e34d76 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:56.985223 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069aa675-1930-4dc2-b44d-e168a3c85169 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:56.989277 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42423a5b-c237-4831-86dc-3270ac80dba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:56.990156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42423a5b-c237-4831-86dc-3270ac80dba2 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:56.990531 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42423a5b-c237-4831-86dc-3270ac80dba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:56.990872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42423a5b-c237-4831-86dc-3270ac80dba2 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:56.991579 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42423a5b-c237-4831-86dc-3270ac80dba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:56.993588 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42423a5b-c237-4831-86dc-3270ac80dba2 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:57.011117 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1065/2137] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:05:57.016225 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bcbe1-b8ec-4a9e-b8f5-265b79e34d76 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:57.018874 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1073/2138] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:56 2022] POST /identity/v3/users => generated 295 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:57.022562 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42423a5b-c237-4831-86dc-3270ac80dba2 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:57.031991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bcbe1-b8ec-4a9e-b8f5-265b79e34d76 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:57.036175 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42423a5b-c237-4831-86dc-3270ac80dba2 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:57.037123 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873560f-cff9-4056-880d-35303b1a0b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:57.037963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873560f-cff9-4056-880d-35303b1a0b81 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:57.038229 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873560f-cff9-4056-880d-35303b1a0b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:57.038433 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873560f-cff9-4056-880d-35303b1a0b81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:57.039079 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873560f-cff9-4056-880d-35303b1a0b81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:57.041441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873560f-cff9-4056-880d-35303b1a0b81 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:57.041853 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e73da4-6e38-4241-af18-dfce1fad5a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:57.042556 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e73da4-6e38-4241-af18-dfce1fad5a36 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:57.042933 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e73da4-6e38-4241-af18-dfce1fad5a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:57.043157 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e73da4-6e38-4241-af18-dfce1fad5a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:57.043801 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e73da4-6e38-4241-af18-dfce1fad5a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:57.045467 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e73da4-6e38-4241-af18-dfce1fad5a36 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:57.056433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1074/2139] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 01:05:57.060592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e73da4-6e38-4241-af18-dfce1fad5a36 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:57.071385 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e73da4-6e38-4241-af18-dfce1fad5a36 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:57.076281 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50020a72-027a-47b6-82af-422cd78372e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:57.076973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50020a72-027a-47b6-82af-422cd78372e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:57.077261 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50020a72-027a-47b6-82af-422cd78372e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:57.077534 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50020a72-027a-47b6-82af-422cd78372e2 admin admin] PATH_INFO: `/v3/projects/ebc560cced3a423593a9a941fc4872bd/users/2d410984f7b24c6e8241476c3e29eb94/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:57.081837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1066/2140] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:57 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:05:57.085212 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873560f-cff9-4056-880d-35303b1a0b81 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:57.091058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:57.096111 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50020a72-027a-47b6-82af-422cd78372e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc560cced3a423593a9a941fc4872bd, user_id=2d410984f7b24c6e8241476c3e29eb94, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:57.099819 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50020a72-027a-47b6-82af-422cd78372e2 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:57.125109 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1075/2141] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:57 2022] PUT /identity/v3/projects/ebc560cced3a423593a9a941fc4872bd/users/2d410984f7b24c6e8241476c3e29eb94/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:05:57.127302 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50020a72-027a-47b6-82af-422cd78372e2 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:57.155276 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:57.177105 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873560f-cff9-4056-880d-35303b1a0b81 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:57.210706 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50020a72-027a-47b6-82af-422cd78372e2 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:57.218473 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d06377-3a6f-4c37-a2c0-117bfd3e4580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:57.219348 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d06377-3a6f-4c37-a2c0-117bfd3e4580 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:57.219702 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d06377-3a6f-4c37-a2c0-117bfd3e4580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:57.220069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d06377-3a6f-4c37-a2c0-117bfd3e4580 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:57.220939 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d06377-3a6f-4c37-a2c0-117bfd3e4580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:57.223208 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d06377-3a6f-4c37-a2c0-117bfd3e4580 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:57.242274 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1076/2142] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:57.243763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d06377-3a6f-4c37-a2c0-117bfd3e4580 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:57.247839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f7c7c-f9b9-494a-9725-cdc78c054fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:57.248446 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f7c7c-f9b9-494a-9725-cdc78c054fef admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:57.248726 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f7c7c-f9b9-494a-9725-cdc78c054fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:57.249004 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f7c7c-f9b9-494a-9725-cdc78c054fef admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:57.250149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f7c7c-f9b9-494a-9725-cdc78c054fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:57.252112 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f7c7c-f9b9-494a-9725-cdc78c054fef admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:57.257636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d06377-3a6f-4c37-a2c0-117bfd3e4580 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:57.262731 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af3365-bb43-49e7-b199-5fda9c6fb7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:57.263467 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af3365-bb43-49e7-b199-5fda9c6fb7b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:57.263820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af3365-bb43-49e7-b199-5fda9c6fb7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:57.264261 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af3365-bb43-49e7-b199-5fda9c6fb7b3 admin admin] PATH_INFO: `/v3/projects/ebc560cced3a423593a9a941fc4872bd/users/2d410984f7b24c6e8241476c3e29eb94/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:57.266780 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af3365-bb43-49e7-b199-5fda9c6fb7b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc560cced3a423593a9a941fc4872bd, user_id=2d410984f7b24c6e8241476c3e29eb94, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:57.270488 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af3365-bb43-49e7-b199-5fda9c6fb7b3 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:57.277010 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1067/2143] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:57 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:57.283384 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f7c7c-f9b9-494a-9725-cdc78c054fef admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:57.289686 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1077/2144] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:57 2022] PUT /identity/v3/projects/ebc560cced3a423593a9a941fc4872bd/users/2d410984f7b24c6e8241476c3e29eb94/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:57.294339 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f7c7c-f9b9-494a-9725-cdc78c054fef admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:57.301391 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1e5b1-1034-439d-a8f4-feaf0c947db0 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:57.301681 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1e5b1-1034-439d-a8f4-feaf0c947db0 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:57.301992 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1e5b1-1034-439d-a8f4-feaf0c947db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:57.334210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-fcb1e5b1-1034-439d-a8f4-feaf0c947db0 None None] MFA Rules not processed for user `2d410984f7b24c6e8241476c3e29eb94`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:57.335561 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-fcb1e5b1-1034-439d-a8f4-feaf0c947db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:57.368747 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505ed81-d352-4ca2-97b4-ea7d833871a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:57.369343 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505ed81-d352-4ca2-97b4-ea7d833871a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:57.369670 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505ed81-d352-4ca2-97b4-ea7d833871a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:57.369981 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505ed81-d352-4ca2-97b4-ea7d833871a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:57.370589 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505ed81-d352-4ca2-97b4-ea7d833871a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:57.372176 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505ed81-d352-4ca2-97b4-ea7d833871a7 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:57.385112 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1068/2145] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:57.385112 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505ed81-d352-4ca2-97b4-ea7d833871a7 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:57.385112 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9505ed81-d352-4ca2-97b4-ea7d833871a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:57.397647 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505ed81-d352-4ca2-97b4-ea7d833871a7 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:57.402739 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f229276-4ea9-4a0e-8a08-65a194ad1065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:57.403342 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f229276-4ea9-4a0e-8a08-65a194ad1065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:57.403623 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f229276-4ea9-4a0e-8a08-65a194ad1065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:57.403894 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f229276-4ea9-4a0e-8a08-65a194ad1065 admin admin] PATH_INFO: `/v3/users/f15bb355d55e45d6bf501c7bb93314d0` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:57.405019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f229276-4ea9-4a0e-8a08-65a194ad1065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f15bb355d55e45d6bf501c7bb93314d0)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:57.407487 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f229276-4ea9-4a0e-8a08-65a194ad1065 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:57.411264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1078/2146] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:05:57.412197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1e5b1-1034-439d-a8f4-feaf0c947db0 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:57.414550 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-fcb1e5b1-1034-439d-a8f4-feaf0c947db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:57.458063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9f229276-4ea9-4a0e-8a08-65a194ad1065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f15bb355d55e45d6bf501c7bb93314d0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:57.458733 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9f229276-4ea9-4a0e-8a08-65a194ad1065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f15bb355d55e45d6bf501c7bb93314d0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:57.465832 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9f229276-4ea9-4a0e-8a08-65a194ad1065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f15bb355d55e45d6bf501c7bb93314d0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:57.476558 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1e5b1-1034-439d-a8f4-feaf0c947db0 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:57.478335 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9f229276-4ea9-4a0e-8a08-65a194ad1065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f15bb355d55e45d6bf501c7bb93314d0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:57.478989 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9f229276-4ea9-4a0e-8a08-65a194ad1065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f15bb355d55e45d6bf501c7bb93314d0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:57.480281 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbeac3-862a-4c1d-b239-36fb9f973f16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:57.480983 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbeac3-862a-4c1d-b239-36fb9f973f16 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:57.481262 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbeac3-862a-4c1d-b239-36fb9f973f16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:57.481539 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbeac3-862a-4c1d-b239-36fb9f973f16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:57.481778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:57.483308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f9bbeac3-862a-4c1d-b239-36fb9f973f16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:57.494683 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1069/2147] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:57 2022] DELETE /identity/v3/users/f15bb355d55e45d6bf501c7bb93314d0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:57.495172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:57.495819 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f229276-4ea9-4a0e-8a08-65a194ad1065 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:57.497495 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9f229276-4ea9-4a0e-8a08-65a194ad1065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:57.548927 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbeac3-862a-4c1d-b239-36fb9f973f16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:57.550315 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbeac3-862a-4c1d-b239-36fb9f973f16 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:57.559806 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1079/2148] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:57.560632 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbeac3-862a-4c1d-b239-36fb9f973f16 service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:57.562026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f9bbeac3-862a-4c1d-b239-36fb9f973f16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:57.562181 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f229276-4ea9-4a0e-8a08-65a194ad1065 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:57.567062 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01dfec-53b6-46b8-b81b-15358276a8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:57.567726 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01dfec-53b6-46b8-b81b-15358276a8fa admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:57.568007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01dfec-53b6-46b8-b81b-15358276a8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:57.568274 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01dfec-53b6-46b8-b81b-15358276a8fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:57.569005 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01dfec-53b6-46b8-b81b-15358276a8fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:57.570521 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01dfec-53b6-46b8-b81b-15358276a8fa admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:57.573148 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbeac3-862a-4c1d-b239-36fb9f973f16 service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:57.587309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1070/2149] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:57.587309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e6626-e7c5-480d-9054-93f08c1d1d96 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:57.587309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e6626-e7c5-480d-9054-93f08c1d1d96 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:57.587309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e6626-e7c5-480d-9054-93f08c1d1d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:57.610146 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-a24e6626-e7c5-480d-9054-93f08c1d1d96 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:57.611667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a24e6626-e7c5-480d-9054-93f08c1d1d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:57.621286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1071/2150] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:57.622375 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e6626-e7c5-480d-9054-93f08c1d1d96 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:57.626187 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b516c-1126-4e7e-b47c-57183a3769ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:57.626976 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b516c-1126-4e7e-b47c-57183a3769ee service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:57.627281 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b516c-1126-4e7e-b47c-57183a3769ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:57.627563 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b516c-1126-4e7e-b47c-57183a3769ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:57.629583 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-dc9b516c-1126-4e7e-b47c-57183a3769ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:57.632793 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e6626-e7c5-480d-9054-93f08c1d1d96 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:57.637447 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99029b59-018b-431a-81c2-4b1a65bcb95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:57.638167 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99029b59-018b-431a-81c2-4b1a65bcb95e admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:57.638394 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99029b59-018b-431a-81c2-4b1a65bcb95e admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:57.638664 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99029b59-018b-431a-81c2-4b1a65bcb95e admin admin] PATH_INFO: `/v3/projects/53b985f9ddf54726baaa887b3355af55/users/56a8c0900cb8453f9385f29644c4fa40/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:57.657517 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99029b59-018b-431a-81c2-4b1a65bcb95e admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b985f9ddf54726baaa887b3355af55, user_id=56a8c0900cb8453f9385f29644c4fa40, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:57.660815 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99029b59-018b-431a-81c2-4b1a65bcb95e admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:57.675342 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1072/2151] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:57 2022] PUT /identity/v3/projects/53b985f9ddf54726baaa887b3355af55/users/56a8c0900cb8453f9385f29644c4fa40/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:57.678908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99029b59-018b-431a-81c2-4b1a65bcb95e admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:57.682919 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-99029b59-018b-431a-81c2-4b1a65bcb95e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:57.701232 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b516c-1126-4e7e-b47c-57183a3769ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:57.703249 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b516c-1126-4e7e-b47c-57183a3769ee service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:57.713909 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1080/2152] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:57.715025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ab1ca-25fc-4b58-84b5-3b0013ebb9c4 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:57.715364 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ab1ca-25fc-4b58-84b5-3b0013ebb9c4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:57.715695 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ab1ca-25fc-4b58-84b5-3b0013ebb9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:57.756188 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-297ab1ca-25fc-4b58-84b5-3b0013ebb9c4 None None] MFA Rules not processed for user `56a8c0900cb8453f9385f29644c4fa40`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:57.757550 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-297ab1ca-25fc-4b58-84b5-3b0013ebb9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:57.763285 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99029b59-018b-431a-81c2-4b1a65bcb95e admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:57.769840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2fae2-b4fd-4afd-8b1d-181aa6d16b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:57.770632 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2fae2-b4fd-4afd-8b1d-181aa6d16b42 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:57.771029 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2fae2-b4fd-4afd-8b1d-181aa6d16b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:57.771589 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2fae2-b4fd-4afd-8b1d-181aa6d16b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:57.818202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:57.854065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2fae2-b4fd-4afd-8b1d-181aa6d16b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:57.855735 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2fae2-b4fd-4afd-8b1d-181aa6d16b42 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:57.855847 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1081/2153] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:05:57.856722 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ab1ca-25fc-4b58-84b5-3b0013ebb9c4 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:57.865776 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1073/2154] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:57.873737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2fae2-b4fd-4afd-8b1d-181aa6d16b42 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:57.895739 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2fae2-b4fd-4afd-8b1d-181aa6d16b42 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:57.902614 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f836e-51e5-49f1-9b11-8fdc117dff00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:57.903432 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f836e-51e5-49f1-9b11-8fdc117dff00 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:57.903575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f836e-51e5-49f1-9b11-8fdc117dff00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:57.903807 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f836e-51e5-49f1-9b11-8fdc117dff00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:57.904823 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f836e-51e5-49f1-9b11-8fdc117dff00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:57.907157 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f836e-51e5-49f1-9b11-8fdc117dff00 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:57.914237 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:57.922397 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ab1ca-25fc-4b58-84b5-3b0013ebb9c4 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:57.927285 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317d5ce-18da-42b3-9fb7-2328ab131bee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:57.928114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317d5ce-18da-42b3-9fb7-2328ab131bee service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:57.929171 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317d5ce-18da-42b3-9fb7-2328ab131bee service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:57.929171 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317d5ce-18da-42b3-9fb7-2328ab131bee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:57.930909 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a317d5ce-18da-42b3-9fb7-2328ab131bee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:57.958045 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1074/2155] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:05:57 2022] POST /identity/v3/projects => generated 383 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:57.962609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f836e-51e5-49f1-9b11-8fdc117dff00 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:58.031927 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317d5ce-18da-42b3-9fb7-2328ab131bee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:58.033407 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317d5ce-18da-42b3-9fb7-2328ab131bee service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:58.049253 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1082/2156] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:58.090598 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f836e-51e5-49f1-9b11-8fdc117dff00 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:58.104542 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e1a14-dc78-4bd3-ad0f-e33ab919e4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:58.105165 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e1a14-dc78-4bd3-ad0f-e33ab919e4dc admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:58.107847 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e1a14-dc78-4bd3-ad0f-e33ab919e4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:58.108184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e1a14-dc78-4bd3-ad0f-e33ab919e4dc admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:58.109099 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e1a14-dc78-4bd3-ad0f-e33ab919e4dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:58.111296 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e1a14-dc78-4bd3-ad0f-e33ab919e4dc admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:58.140917 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757017f-d556-4a37-b70a-72ca35162c4d None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:58.141274 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757017f-d556-4a37-b70a-72ca35162c4d None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:58.141573 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757017f-d556-4a37-b70a-72ca35162c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:58.150680 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1075/2157] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:05:57 2022] POST /identity/v3/users => generated 298 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:05:58.175512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e1a14-dc78-4bd3-ad0f-e33ab919e4dc admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:58.188825 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-d757017f-d556-4a37-b70a-72ca35162c4d None None] MFA Rules not processed for user `f7368f2c6d934517b4b71206473795f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:58.191938 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d757017f-d556-4a37-b70a-72ca35162c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:58.207394 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e1a14-dc78-4bd3-ad0f-e33ab919e4dc admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:58.235651 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd65d0b-a64a-467f-bea3-5e8290d69d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:58.236438 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd65d0b-a64a-467f-bea3-5e8290d69d94 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:58.236845 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd65d0b-a64a-467f-bea3-5e8290d69d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:58.237186 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd65d0b-a64a-467f-bea3-5e8290d69d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:58.237970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd65d0b-a64a-467f-bea3-5e8290d69d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:58.241037 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd65d0b-a64a-467f-bea3-5e8290d69d94 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:58.258003 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1076/2158] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:58.258003 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd65d0b-a64a-467f-bea3-5e8290d69d94 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:58.258003 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4cd65d0b-a64a-467f-bea3-5e8290d69d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:58.273375 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd65d0b-a64a-467f-bea3-5e8290d69d94 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:58.279118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827605c-52ec-4865-977b-42b43370c31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:58.281472 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827605c-52ec-4865-977b-42b43370c31a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:58.281885 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827605c-52ec-4865-977b-42b43370c31a admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:58.282169 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827605c-52ec-4865-977b-42b43370c31a admin admin] PATH_INFO: `/v3/projects/62a993571cdb4fcc9f7bd368ee96540e` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:58.283346 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827605c-52ec-4865-977b-42b43370c31a admin admin] RBAC: Authorizing `identity:delete_project(project_id=62a993571cdb4fcc9f7bd368ee96540e)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:58.285269 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827605c-52ec-4865-977b-42b43370c31a admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:58.334791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1083/2159] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:05:58.335868 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757017f-d556-4a37-b70a-72ca35162c4d None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:58.364008 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3827605c-52ec-4865-977b-42b43370c31a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62a993571cdb4fcc9f7bd368ee96540e', 'request_id': 'req-3827605c-52ec-4865-977b-42b43370c31a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:58.365267 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757017f-d556-4a37-b70a-72ca35162c4d None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:58.385484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3827605c-52ec-4865-977b-42b43370c31a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62a993571cdb4fcc9f7bd368ee96540e', 'request_id': 'req-3827605c-52ec-4865-977b-42b43370c31a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:58.396531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3827605c-52ec-4865-977b-42b43370c31a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62a993571cdb4fcc9f7bd368ee96540e', 'request_id': 'req-3827605c-52ec-4865-977b-42b43370c31a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:58.437829 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:58.450497 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3827605c-52ec-4865-977b-42b43370c31a admin admin] The token cache is being invalidate because project 62a993571cdb4fcc9f7bd368ee96540e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:58.450901 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3827605c-52ec-4865-977b-42b43370c31a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:58.462326 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3827605c-52ec-4865-977b-42b43370c31a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:58.471390 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1077/2160] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:58 2022] DELETE /identity/v3/projects/62a993571cdb4fcc9f7bd368ee96540e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:58.472225 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6954ea9-fa39-4017-b845-43375e9c3e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:58.473160 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827605c-52ec-4865-977b-42b43370c31a admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:58.474086 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6954ea9-fa39-4017-b845-43375e9c3e15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:58.475233 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6954ea9-fa39-4017-b845-43375e9c3e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:58.475355 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3827605c-52ec-4865-977b-42b43370c31a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:58.475772 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6954ea9-fa39-4017-b845-43375e9c3e15 admin admin] PATH_INFO: `/v3/projects/17e66d6390ee407e9631afe33cc61a59/users/7e92cf76583f474188a94d14703e6efb/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:58.497776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6954ea9-fa39-4017-b845-43375e9c3e15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17e66d6390ee407e9631afe33cc61a59, user_id=7e92cf76583f474188a94d14703e6efb, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:58.502169 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6954ea9-fa39-4017-b845-43375e9c3e15 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:58.532480 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1084/2161] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:58 2022] PUT /identity/v3/projects/17e66d6390ee407e9631afe33cc61a59/users/7e92cf76583f474188a94d14703e6efb/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:58.534018 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6954ea9-fa39-4017-b845-43375e9c3e15 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:58.539307 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a6954ea9-fa39-4017-b845-43375e9c3e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:58.547026 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:58.565621 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827605c-52ec-4865-977b-42b43370c31a admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:58.641544 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6954ea9-fa39-4017-b845-43375e9c3e15 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:58.648775 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40cab2-2be9-490a-a7f2-8ef373e1ce77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:58.649440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40cab2-2be9-490a-a7f2-8ef373e1ce77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:58.649848 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40cab2-2be9-490a-a7f2-8ef373e1ce77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:58.650114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40cab2-2be9-490a-a7f2-8ef373e1ce77 admin admin] PATH_INFO: `/v3/users/878394577e874958b9ab304df1e9de82` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:58.651588 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40cab2-2be9-490a-a7f2-8ef373e1ce77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=878394577e874958b9ab304df1e9de82)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:58.653622 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40cab2-2be9-490a-a7f2-8ef373e1ce77 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:58.659556 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d448f-e0a2-4b4c-b3dd-b7e5ae75878a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:58.661191 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d448f-e0a2-4b4c-b3dd-b7e5ae75878a service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:58.661875 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d448f-e0a2-4b4c-b3dd-b7e5ae75878a service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:58.662301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d448f-e0a2-4b4c-b3dd-b7e5ae75878a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:58.665256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f54d448f-e0a2-4b4c-b3dd-b7e5ae75878a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:58.728568 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-9a40cab2-2be9-490a-a7f2-8ef373e1ce77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '878394577e874958b9ab304df1e9de82'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:58.737693 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-9a40cab2-2be9-490a-a7f2-8ef373e1ce77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '878394577e874958b9ab304df1e9de82'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:58.754323 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d448f-e0a2-4b4c-b3dd-b7e5ae75878a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:58.757818 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d448f-e0a2-4b4c-b3dd-b7e5ae75878a service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:58.758856 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-9a40cab2-2be9-490a-a7f2-8ef373e1ce77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '878394577e874958b9ab304df1e9de82'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:58.759670 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-9a40cab2-2be9-490a-a7f2-8ef373e1ce77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '878394577e874958b9ab304df1e9de82'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:58.760368 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-9a40cab2-2be9-490a-a7f2-8ef373e1ce77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '878394577e874958b9ab304df1e9de82'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:58.772076 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1078/2162] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:05:58.772829 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d448f-e0a2-4b4c-b3dd-b7e5ae75878a service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:58.774494 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f54d448f-e0a2-4b4c-b3dd-b7e5ae75878a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:58.777216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1085/2163] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:58 2022] DELETE /identity/v3/users/878394577e874958b9ab304df1e9de82 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:58.789981 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d448f-e0a2-4b4c-b3dd-b7e5ae75878a service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:58.867029 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1abebd-5e08-494b-88d2-6b3b12d25d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:58.867991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1abebd-5e08-494b-88d2-6b3b12d25d0b admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:58.868298 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1abebd-5e08-494b-88d2-6b3b12d25d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:58.868573 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1abebd-5e08-494b-88d2-6b3b12d25d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:58.869280 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1abebd-5e08-494b-88d2-6b3b12d25d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:58.872096 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1abebd-5e08-494b-88d2-6b3b12d25d0b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:58.886468 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1079/2164] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:05:58.890820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40cab2-2be9-490a-a7f2-8ef373e1ce77 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:58.893939 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-9a40cab2-2be9-490a-a7f2-8ef373e1ce77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:58.922499 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40cab2-2be9-490a-a7f2-8ef373e1ce77 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:58.927643 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c132bb3-7a9b-476c-8616-7526cdc55b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:58.928535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c132bb3-7a9b-476c-8616-7526cdc55b4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:58.928987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c132bb3-7a9b-476c-8616-7526cdc55b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:58.929527 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c132bb3-7a9b-476c-8616-7526cdc55b4f admin admin] PATH_INFO: `/v3/projects/17e66d6390ee407e9631afe33cc61a59/users/7e92cf76583f474188a94d14703e6efb/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:58.931866 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c132bb3-7a9b-476c-8616-7526cdc55b4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=17e66d6390ee407e9631afe33cc61a59, user_id=7e92cf76583f474188a94d14703e6efb, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:58.934800 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c132bb3-7a9b-476c-8616-7526cdc55b4f admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:58.954415 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1086/2165] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:05:58 2022] PUT /identity/v3/projects/17e66d6390ee407e9631afe33cc61a59/users/7e92cf76583f474188a94d14703e6efb/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:58.960578 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fd041-2724-4946-85db-8f2d7f00045e None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:58.960927 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fd041-2724-4946-85db-8f2d7f00045e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:58.961384 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fd041-2724-4946-85db-8f2d7f00045e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:58.993786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-be0fd041-2724-4946-85db-8f2d7f00045e None None] MFA Rules not processed for user `7e92cf76583f474188a94d14703e6efb`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:05:58.995054 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-be0fd041-2724-4946-85db-8f2d7f00045e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:59.051660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:59.092256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1080/2166] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:05:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:05:59.109286 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c132bb3-7a9b-476c-8616-7526cdc55b4f admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:59.111581 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-9c132bb3-7a9b-476c-8616-7526cdc55b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:59.175716 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:59.195555 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c132bb3-7a9b-476c-8616-7526cdc55b4f admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:59.202154 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af037def-d984-4163-ba80-84c0262c7ddc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:59.203202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af037def-d984-4163-ba80-84c0262c7ddc service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:59.203360 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fd041-2724-4946-85db-8f2d7f00045e None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:59.203516 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af037def-d984-4163-ba80-84c0262c7ddc service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:59.203879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af037def-d984-4163-ba80-84c0262c7ddc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:59.205110 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-be0fd041-2724-4946-85db-8f2d7f00045e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:59.214914 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af037def-d984-4163-ba80-84c0262c7ddc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:59.216427 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af037def-d984-4163-ba80-84c0262c7ddc service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:59.230588 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1087/2167] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 01:05:59.284749 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fd041-2724-4946-85db-8f2d7f00045e None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:59.290542 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb2c0d-9a4b-4e3c-b58a-b355fc5c4326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:59.291320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb2c0d-9a4b-4e3c-b58a-b355fc5c4326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:59.291608 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb2c0d-9a4b-4e3c-b58a-b355fc5c4326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:59.291950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb2c0d-9a4b-4e3c-b58a-b355fc5c4326 admin admin] PATH_INFO: `/v3/projects/8a40ff9e215d41c496ceace4d9aacf5a` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:59.293687 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb2c0d-9a4b-4e3c-b58a-b355fc5c4326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a40ff9e215d41c496ceace4d9aacf5a)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:59.295864 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb2c0d-9a4b-4e3c-b58a-b355fc5c4326 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:59.335145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af037def-d984-4163-ba80-84c0262c7ddc service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:59.344375 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af037def-d984-4163-ba80-84c0262c7ddc service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:59.358310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-60bb2c0d-9a4b-4e3c-b58a-b355fc5c4326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a40ff9e215d41c496ceace4d9aacf5a', 'request_id': 'req-60bb2c0d-9a4b-4e3c-b58a-b355fc5c4326'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:59.368180 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-60bb2c0d-9a4b-4e3c-b58a-b355fc5c4326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a40ff9e215d41c496ceace4d9aacf5a', 'request_id': 'req-60bb2c0d-9a4b-4e3c-b58a-b355fc5c4326'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:59.376172 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-60bb2c0d-9a4b-4e3c-b58a-b355fc5c4326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a40ff9e215d41c496ceace4d9aacf5a', 'request_id': 'req-60bb2c0d-9a4b-4e3c-b58a-b355fc5c4326'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:59.394390 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-60bb2c0d-9a4b-4e3c-b58a-b355fc5c4326 admin admin] The token cache is being invalidate because project 8a40ff9e215d41c496ceace4d9aacf5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:05:59.394674 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-60bb2c0d-9a4b-4e3c-b58a-b355fc5c4326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:59.395320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-60bb2c0d-9a4b-4e3c-b58a-b355fc5c4326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:59.396791 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1081/2168] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:05:59 2022] DELETE /identity/v3/projects/8a40ff9e215d41c496ceace4d9aacf5a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:05:59.400978 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb2c0d-9a4b-4e3c-b58a-b355fc5c4326 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:59.403714 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-60bb2c0d-9a4b-4e3c-b58a-b355fc5c4326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:59.409492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04e2bc-205c-4854-bf26-d6dce6cca182 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:59.410147 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04e2bc-205c-4854-bf26-d6dce6cca182 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:59.410497 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04e2bc-205c-4854-bf26-d6dce6cca182 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:59.411315 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04e2bc-205c-4854-bf26-d6dce6cca182 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:59.413371 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-dd04e2bc-205c-4854-bf26-d6dce6cca182 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:59.479866 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04e2bc-205c-4854-bf26-d6dce6cca182 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:59.481401 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04e2bc-205c-4854-bf26-d6dce6cca182 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:59.492636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1088/2169] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:05:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 01:05:59.501537 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb2c0d-9a4b-4e3c-b58a-b355fc5c4326 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:05:59.507369 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70c14f-3d33-46f0-89e2-b751313a0ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:05:59.508074 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70c14f-3d33-46f0-89e2-b751313a0ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:05:59.508412 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70c14f-3d33-46f0-89e2-b751313a0ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:05:59.508743 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70c14f-3d33-46f0-89e2-b751313a0ce1 admin admin] PATH_INFO: `/v3/users/0d9a13425c48487e85fa7c0113a3d8b8` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:05:59.510083 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70c14f-3d33-46f0-89e2-b751313a0ce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d9a13425c48487e85fa7c0113a3d8b8)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:05:59.512729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70c14f-3d33-46f0-89e2-b751313a0ce1 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:05:59.524353 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:59.590492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-5d70c14f-3d33-46f0-89e2-b751313a0ce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d9a13425c48487e85fa7c0113a3d8b8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:59.591479 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-5d70c14f-3d33-46f0-89e2-b751313a0ce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d9a13425c48487e85fa7c0113a3d8b8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:59.600506 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-5d70c14f-3d33-46f0-89e2-b751313a0ce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d9a13425c48487e85fa7c0113a3d8b8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:59.636567 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-5d70c14f-3d33-46f0-89e2-b751313a0ce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d9a13425c48487e85fa7c0113a3d8b8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:59.637653 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-5d70c14f-3d33-46f0-89e2-b751313a0ce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d9a13425c48487e85fa7c0113a3d8b8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:05:59.669731 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1082/2170] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:59 2022] DELETE /identity/v3/users/0d9a13425c48487e85fa7c0113a3d8b8 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:05:59.931126 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04e2bc-205c-4854-bf26-d6dce6cca182 service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:05:59.932766 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-dd04e2bc-205c-4854-bf26-d6dce6cca182 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:05:59.949624 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04e2bc-205c-4854-bf26-d6dce6cca182 service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:00.030145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba7576-95db-4db7-98bb-3f37de88aec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:00.031745 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba7576-95db-4db7-98bb-3f37de88aec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:00.032026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba7576-95db-4db7-98bb-3f37de88aec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:00.032296 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba7576-95db-4db7-98bb-3f37de88aec8 admin admin] PATH_INFO: `/v3/users/56a8c0900cb8453f9385f29644c4fa40` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:00.033687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba7576-95db-4db7-98bb-3f37de88aec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56a8c0900cb8453f9385f29644c4fa40)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:00.036566 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba7576-95db-4db7-98bb-3f37de88aec8 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:00.115535 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70c14f-3d33-46f0-89e2-b751313a0ce1 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:00.117875 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5d70c14f-3d33-46f0-89e2-b751313a0ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:00.128178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:00.143809 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70c14f-3d33-46f0-89e2-b751313a0ce1 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:00.150826 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b5ba7576-95db-4db7-98bb-3f37de88aec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56a8c0900cb8453f9385f29644c4fa40'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:00.161362 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8536426-b694-4797-b6e4-a52c8a90fde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:00.162047 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8536426-b694-4797-b6e4-a52c8a90fde7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:00.164915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8536426-b694-4797-b6e4-a52c8a90fde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:00.165151 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8536426-b694-4797-b6e4-a52c8a90fde7 admin admin] PATH_INFO: `/v3/projects/7d1c149d58f14ab0b5deb8e0e5e2ceac` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:00.165957 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b5ba7576-95db-4db7-98bb-3f37de88aec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56a8c0900cb8453f9385f29644c4fa40'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:00.172237 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8536426-b694-4797-b6e4-a52c8a90fde7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d1c149d58f14ab0b5deb8e0e5e2ceac)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:00.177045 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8536426-b694-4797-b6e4-a52c8a90fde7 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:00.200284 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b5ba7576-95db-4db7-98bb-3f37de88aec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56a8c0900cb8453f9385f29644c4fa40'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:00.204496 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b5ba7576-95db-4db7-98bb-3f37de88aec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56a8c0900cb8453f9385f29644c4fa40'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:00.206232 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b5ba7576-95db-4db7-98bb-3f37de88aec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56a8c0900cb8453f9385f29644c4fa40'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:00.230440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1089/2171] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:05:59 2022] DELETE /identity/v3/users/56a8c0900cb8453f9385f29644c4fa40 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:00.236053 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912febb-8dc0-4137-9786-832fc6e99ae4 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:00.236348 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912febb-8dc0-4137-9786-832fc6e99ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:00.236628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912febb-8dc0-4137-9786-832fc6e99ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:00.253561 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d8536426-b694-4797-b6e4-a52c8a90fde7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d1c149d58f14ab0b5deb8e0e5e2ceac', 'request_id': 'req-d8536426-b694-4797-b6e4-a52c8a90fde7'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:00.264639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d8536426-b694-4797-b6e4-a52c8a90fde7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d1c149d58f14ab0b5deb8e0e5e2ceac', 'request_id': 'req-d8536426-b694-4797-b6e4-a52c8a90fde7'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:00.274978 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d8536426-b694-4797-b6e4-a52c8a90fde7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d1c149d58f14ab0b5deb8e0e5e2ceac', 'request_id': 'req-d8536426-b694-4797-b6e4-a52c8a90fde7'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:00.275880 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-0912febb-8dc0-4137-9786-832fc6e99ae4 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:00.277397 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0912febb-8dc0-4137-9786-832fc6e99ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:00.290539 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d8536426-b694-4797-b6e4-a52c8a90fde7 admin admin] The token cache is being invalidate because project 7d1c149d58f14ab0b5deb8e0e5e2ceac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:06:00.291470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d8536426-b694-4797-b6e4-a52c8a90fde7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:00.292386 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d8536426-b694-4797-b6e4-a52c8a90fde7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:00.294462 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1083/2172] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:06:00 2022] DELETE /identity/v3/projects/7d1c149d58f14ab0b5deb8e0e5e2ceac => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:00.425668 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1090/2173] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:00.433266 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8536426-b694-4797-b6e4-a52c8a90fde7 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:00.434885 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d8536426-b694-4797-b6e4-a52c8a90fde7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:00.513399 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8536426-b694-4797-b6e4-a52c8a90fde7 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:00.517158 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3663299-b29f-4b98-8c76-e1f966fedc58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:00.517971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3663299-b29f-4b98-8c76-e1f966fedc58 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:00.518250 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3663299-b29f-4b98-8c76-e1f966fedc58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:00.518548 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3663299-b29f-4b98-8c76-e1f966fedc58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:00.528221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3663299-b29f-4b98-8c76-e1f966fedc58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:00.529632 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3663299-b29f-4b98-8c76-e1f966fedc58 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:00.538895 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1084/2174] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:06:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:06:00.878509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912febb-8dc0-4137-9786-832fc6e99ae4 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:00.880058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0912febb-8dc0-4137-9786-832fc6e99ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:00.908022 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912febb-8dc0-4137-9786-832fc6e99ae4 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:00.924875 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead90ad1-8d20-4fcc-8de8-a29616a65ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:00.927942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead90ad1-8d20-4fcc-8de8-a29616a65ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:00.928465 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead90ad1-8d20-4fcc-8de8-a29616a65ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:00.928811 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead90ad1-8d20-4fcc-8de8-a29616a65ce6 admin admin] PATH_INFO: `/v3/projects/53b985f9ddf54726baaa887b3355af55` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:00.930215 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead90ad1-8d20-4fcc-8de8-a29616a65ce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b985f9ddf54726baaa887b3355af55)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:00.932218 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead90ad1-8d20-4fcc-8de8-a29616a65ce6 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:01.001862 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-ead90ad1-8d20-4fcc-8de8-a29616a65ce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b985f9ddf54726baaa887b3355af55', 'request_id': 'req-ead90ad1-8d20-4fcc-8de8-a29616a65ce6'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:01.010087 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-ead90ad1-8d20-4fcc-8de8-a29616a65ce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b985f9ddf54726baaa887b3355af55', 'request_id': 'req-ead90ad1-8d20-4fcc-8de8-a29616a65ce6'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:01.017374 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-ead90ad1-8d20-4fcc-8de8-a29616a65ce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b985f9ddf54726baaa887b3355af55', 'request_id': 'req-ead90ad1-8d20-4fcc-8de8-a29616a65ce6'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:01.028426 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-ead90ad1-8d20-4fcc-8de8-a29616a65ce6 admin admin] The token cache is being invalidate because project 53b985f9ddf54726baaa887b3355af55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:06:01.028714 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-ead90ad1-8d20-4fcc-8de8-a29616a65ce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:01.029366 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-ead90ad1-8d20-4fcc-8de8-a29616a65ce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:01.030927 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1091/2175] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:06:00 2022] DELETE /identity/v3/projects/53b985f9ddf54726baaa887b3355af55 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:01.034977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3663299-b29f-4b98-8c76-e1f966fedc58 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:01.044846 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3663299-b29f-4b98-8c76-e1f966fedc58 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:01.053162 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:01.107001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be3233-e3f7-45ae-8ddd-2e4ced0cf254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:01.107638 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be3233-e3f7-45ae-8ddd-2e4ced0cf254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:01.107912 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be3233-e3f7-45ae-8ddd-2e4ced0cf254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:01.108182 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be3233-e3f7-45ae-8ddd-2e4ced0cf254 admin admin] PATH_INFO: `/v3/users/7e92cf76583f474188a94d14703e6efb` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:01.109353 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be3233-e3f7-45ae-8ddd-2e4ced0cf254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e92cf76583f474188a94d14703e6efb)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:01.111329 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be3233-e3f7-45ae-8ddd-2e4ced0cf254 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:01.162522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-08be3233-e3f7-45ae-8ddd-2e4ced0cf254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e92cf76583f474188a94d14703e6efb'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:01.163186 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-08be3233-e3f7-45ae-8ddd-2e4ced0cf254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e92cf76583f474188a94d14703e6efb'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:01.170762 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-08be3233-e3f7-45ae-8ddd-2e4ced0cf254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e92cf76583f474188a94d14703e6efb'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:01.184149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-08be3233-e3f7-45ae-8ddd-2e4ced0cf254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e92cf76583f474188a94d14703e6efb'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:01.184875 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-08be3233-e3f7-45ae-8ddd-2e4ced0cf254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e92cf76583f474188a94d14703e6efb'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:01.198820 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1085/2176] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:06:01 2022] DELETE /identity/v3/users/7e92cf76583f474188a94d14703e6efb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:01.395333 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead90ad1-8d20-4fcc-8de8-a29616a65ce6 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:01.397333 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ead90ad1-8d20-4fcc-8de8-a29616a65ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:01.413261 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead90ad1-8d20-4fcc-8de8-a29616a65ce6 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:01.476199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:01.527260 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c495519-fe75-473f-aec7-ef440627eecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:01.528052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c495519-fe75-473f-aec7-ef440627eecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:01.528433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c495519-fe75-473f-aec7-ef440627eecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:01.528988 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c495519-fe75-473f-aec7-ef440627eecd admin admin] PATH_INFO: `/v3/users/f0ec4cf74d7b4c708c2fcbda3a4657da` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:01.531015 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c495519-fe75-473f-aec7-ef440627eecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0ec4cf74d7b4c708c2fcbda3a4657da)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:01.534176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c495519-fe75-473f-aec7-ef440627eecd admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:01.580606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be3233-e3f7-45ae-8ddd-2e4ced0cf254 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:01.582741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-08be3233-e3f7-45ae-8ddd-2e4ced0cf254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:01.603582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be3233-e3f7-45ae-8ddd-2e4ced0cf254 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:01.612667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6df21-31f3-49b3-9865-c32c34473bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:01.613407 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6df21-31f3-49b3-9865-c32c34473bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:01.613904 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6df21-31f3-49b3-9865-c32c34473bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:01.614838 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6df21-31f3-49b3-9865-c32c34473bd0 admin admin] PATH_INFO: `/v3/projects/17e66d6390ee407e9631afe33cc61a59` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:01.616356 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6df21-31f3-49b3-9865-c32c34473bd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17e66d6390ee407e9631afe33cc61a59)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:01.619127 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6df21-31f3-49b3-9865-c32c34473bd0 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:01.645653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5c495519-fe75-473f-aec7-ef440627eecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0ec4cf74d7b4c708c2fcbda3a4657da'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:01.657981 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5c495519-fe75-473f-aec7-ef440627eecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0ec4cf74d7b4c708c2fcbda3a4657da'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:01.675633 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5c495519-fe75-473f-aec7-ef440627eecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0ec4cf74d7b4c708c2fcbda3a4657da'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:01.676337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5c495519-fe75-473f-aec7-ef440627eecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0ec4cf74d7b4c708c2fcbda3a4657da'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:01.676944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5c495519-fe75-473f-aec7-ef440627eecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0ec4cf74d7b4c708c2fcbda3a4657da'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:01.689103 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b1e6df21-31f3-49b3-9865-c32c34473bd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17e66d6390ee407e9631afe33cc61a59', 'request_id': 'req-b1e6df21-31f3-49b3-9865-c32c34473bd0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:01.699160 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b1e6df21-31f3-49b3-9865-c32c34473bd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17e66d6390ee407e9631afe33cc61a59', 'request_id': 'req-b1e6df21-31f3-49b3-9865-c32c34473bd0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:01.701225 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1092/2177] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:06:01 2022] DELETE /identity/v3/users/f0ec4cf74d7b4c708c2fcbda3a4657da => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:01.705567 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829dfa9-a414-4f7e-b75f-715f8add5fad None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:01.706100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829dfa9-a414-4f7e-b75f-715f8add5fad None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:01.706381 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829dfa9-a414-4f7e-b75f-715f8add5fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:01.707430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b1e6df21-31f3-49b3-9865-c32c34473bd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17e66d6390ee407e9631afe33cc61a59', 'request_id': 'req-b1e6df21-31f3-49b3-9865-c32c34473bd0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:01.721136 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b1e6df21-31f3-49b3-9865-c32c34473bd0 admin admin] The token cache is being invalidate because project 17e66d6390ee407e9631afe33cc61a59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:06:01.721438 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b1e6df21-31f3-49b3-9865-c32c34473bd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:01.722320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b1e6df21-31f3-49b3-9865-c32c34473bd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:01.724091 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1086/2178] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:06:01 2022] DELETE /identity/v3/projects/17e66d6390ee407e9631afe33cc61a59 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:01.729160 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502df097-0ca1-49ba-8526-e467e1379e5e None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:01.729446 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502df097-0ca1-49ba-8526-e467e1379e5e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:01.729722 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502df097-0ca1-49ba-8526-e467e1379e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:01.740548 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-5829dfa9-a414-4f7e-b75f-715f8add5fad None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:01.744178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5829dfa9-a414-4f7e-b75f-715f8add5fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:01.766071 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-502df097-0ca1-49ba-8526-e467e1379e5e None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:01.778004 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-502df097-0ca1-49ba-8526-e467e1379e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:01.802254 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:01.828557 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1093/2179] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:06:01.842134 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829dfa9-a414-4f7e-b75f-715f8add5fad None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:01.845090 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5829dfa9-a414-4f7e-b75f-715f8add5fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:01.902373 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1087/2180] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:06:01.922683 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829dfa9-a414-4f7e-b75f-715f8add5fad None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:01.922683 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb0962-bc9f-4fe4-9127-5876da6d5487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:01.923135 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb0962-bc9f-4fe4-9127-5876da6d5487 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:01.923473 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb0962-bc9f-4fe4-9127-5876da6d5487 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:01.923806 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb0962-bc9f-4fe4-9127-5876da6d5487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:01.925285 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f4bb8-f695-4bb3-ab95-4862099f6ae7 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:01.925719 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f4bb8-f695-4bb3-ab95-4862099f6ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:01.928244 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f4bb8-f695-4bb3-ab95-4862099f6ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:01.934230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb0962-bc9f-4fe4-9127-5876da6d5487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:01.935730 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb0962-bc9f-4fe4-9127-5876da6d5487 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:01.946979 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1094/2181] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:06:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:06:01.953452 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-d11f4bb8-f695-4bb3-ab95-4862099f6ae7 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:01.955527 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d11f4bb8-f695-4bb3-ab95-4862099f6ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:01.965096 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1088/2182] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:01.970889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb0962-bc9f-4fe4-9127-5876da6d5487 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:01.977087 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:01.990214 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb0962-bc9f-4fe4-9127-5876da6d5487 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:02.005527 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8401bc-89a2-4f60-bd1c-24dd71c52fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:02.006741 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8401bc-89a2-4f60-bd1c-24dd71c52fee admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:02.007138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8401bc-89a2-4f60-bd1c-24dd71c52fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:02.007530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8401bc-89a2-4f60-bd1c-24dd71c52fee admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:02.008817 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8401bc-89a2-4f60-bd1c-24dd71c52fee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:06:02.009250 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8401bc-89a2-4f60-bd1c-24dd71c52fee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:02.011127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8401bc-89a2-4f60-bd1c-24dd71c52fee admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:02.029851 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1095/2183] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:06:02.035245 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f4bb8-f695-4bb3-ab95-4862099f6ae7 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:02.048294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f4bb8-f695-4bb3-ab95-4862099f6ae7 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:02.053719 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb34b7c-5869-444a-a85e-1b9c43c27c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:02.054396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb34b7c-5869-444a-a85e-1b9c43c27c78 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:02.054682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb34b7c-5869-444a-a85e-1b9c43c27c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:02.055016 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb34b7c-5869-444a-a85e-1b9c43c27c78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:02.055650 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb34b7c-5869-444a-a85e-1b9c43c27c78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:02.057886 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb34b7c-5869-444a-a85e-1b9c43c27c78 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:02.090999 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1089/2184] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:06:02 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:06:02.096514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8401bc-89a2-4f60-bd1c-24dd71c52fee admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:02.110397 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8401bc-89a2-4f60-bd1c-24dd71c52fee admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:02.191698 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c83c30-a1a1-4987-b302-fea5e331782d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:02.193014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c83c30-a1a1-4987-b302-fea5e331782d admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:02.193480 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c83c30-a1a1-4987-b302-fea5e331782d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:02.194003 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c83c30-a1a1-4987-b302-fea5e331782d admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:02.194961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c83c30-a1a1-4987-b302-fea5e331782d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:02.196900 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c83c30-a1a1-4987-b302-fea5e331782d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:02.248285 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1096/2185] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:06:02 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:06:02.252315 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb34b7c-5869-444a-a85e-1b9c43c27c78 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:02.263023 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb34b7c-5869-444a-a85e-1b9c43c27c78 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:02.269974 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482454d-cbba-4823-8fb4-37e399a7e91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:02.270718 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482454d-cbba-4823-8fb4-37e399a7e91e admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:02.271100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482454d-cbba-4823-8fb4-37e399a7e91e admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:02.271680 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482454d-cbba-4823-8fb4-37e399a7e91e admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:02.273035 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482454d-cbba-4823-8fb4-37e399a7e91e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:02.274995 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482454d-cbba-4823-8fb4-37e399a7e91e admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:02.288119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1090/2186] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:06:02.292147 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c83c30-a1a1-4987-b302-fea5e331782d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:02.302821 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c83c30-a1a1-4987-b302-fea5e331782d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:02.310390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d336774-9fae-46d5-8323-5735b05d52af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:02.311342 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d336774-9fae-46d5-8323-5735b05d52af admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:02.311632 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d336774-9fae-46d5-8323-5735b05d52af admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:02.312427 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d336774-9fae-46d5-8323-5735b05d52af admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:02.313499 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d336774-9fae-46d5-8323-5735b05d52af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:02.315624 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d336774-9fae-46d5-8323-5735b05d52af admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:02.331269 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1097/2187] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:06:02.336031 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482454d-cbba-4823-8fb4-37e399a7e91e admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:02.348099 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482454d-cbba-4823-8fb4-37e399a7e91e admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:02.353117 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3ebc2-37b6-4cef-943b-c48d7e35546f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:02.353961 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3ebc2-37b6-4cef-943b-c48d7e35546f admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:02.354558 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3ebc2-37b6-4cef-943b-c48d7e35546f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:02.355196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3ebc2-37b6-4cef-943b-c48d7e35546f admin admin] PATH_INFO: `/v3/projects/c2be682a8ce64775b747edfa92a0043a/users/aec708289304422285e8a89244b23431/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:02.358864 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d336774-9fae-46d5-8323-5735b05d52af admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:02.362602 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5d336774-9fae-46d5-8323-5735b05d52af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:02.380828 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d336774-9fae-46d5-8323-5735b05d52af admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:02.385216 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3ebc2-37b6-4cef-943b-c48d7e35546f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2be682a8ce64775b747edfa92a0043a, user_id=aec708289304422285e8a89244b23431, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:02.385981 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85705d49-d699-4c1d-b398-8c9a7399e3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:02.386677 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85705d49-d699-4c1d-b398-8c9a7399e3ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:02.386961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85705d49-d699-4c1d-b398-8c9a7399e3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:02.387232 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85705d49-d699-4c1d-b398-8c9a7399e3ac admin admin] PATH_INFO: `/v3/projects/9f2006bb38e44dc3a5d7f609e758acce` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:02.388502 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85705d49-d699-4c1d-b398-8c9a7399e3ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f2006bb38e44dc3a5d7f609e758acce)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:02.388612 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3ebc2-37b6-4cef-943b-c48d7e35546f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:02.391115 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85705d49-d699-4c1d-b398-8c9a7399e3ac admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:02.406334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1091/2188] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:06:02 2022] PUT /identity/v3/projects/c2be682a8ce64775b747edfa92a0043a/users/aec708289304422285e8a89244b23431/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:06:02.416494 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b533d0-e0db-462a-9ce2-ee09975c1696 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:02.416698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b533d0-e0db-462a-9ce2-ee09975c1696 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:02.416879 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b533d0-e0db-462a-9ce2-ee09975c1696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:02.447211 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-b5b533d0-e0db-462a-9ce2-ee09975c1696 None None] MFA Rules not processed for user `aec708289304422285e8a89244b23431`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:02.448523 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b5b533d0-e0db-462a-9ce2-ee09975c1696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:02.455224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-85705d49-d699-4c1d-b398-8c9a7399e3ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f2006bb38e44dc3a5d7f609e758acce', 'request_id': 'req-85705d49-d699-4c1d-b398-8c9a7399e3ac'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:02.464153 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-85705d49-d699-4c1d-b398-8c9a7399e3ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f2006bb38e44dc3a5d7f609e758acce', 'request_id': 'req-85705d49-d699-4c1d-b398-8c9a7399e3ac'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:02.472216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-85705d49-d699-4c1d-b398-8c9a7399e3ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f2006bb38e44dc3a5d7f609e758acce', 'request_id': 'req-85705d49-d699-4c1d-b398-8c9a7399e3ac'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:02.484819 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-85705d49-d699-4c1d-b398-8c9a7399e3ac admin admin] The token cache is being invalidate because project 9f2006bb38e44dc3a5d7f609e758acce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:06:02.485418 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-85705d49-d699-4c1d-b398-8c9a7399e3ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:02.486898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-85705d49-d699-4c1d-b398-8c9a7399e3ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:02.489081 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1098/2189] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:06:02 2022] DELETE /identity/v3/projects/9f2006bb38e44dc3a5d7f609e758acce => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:06:02.495936 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85705d49-d699-4c1d-b398-8c9a7399e3ac admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:02.497593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-85705d49-d699-4c1d-b398-8c9a7399e3ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:02.538558 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1092/2190] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:02.550614 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b533d0-e0db-462a-9ce2-ee09975c1696 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:02.553396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b5b533d0-e0db-462a-9ce2-ee09975c1696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:02.613454 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:02.632108 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b533d0-e0db-462a-9ce2-ee09975c1696 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:02.636123 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1695d4-e5a0-4cc4-b2c9-ba31ecde3f4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:02.636738 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1695d4-e5a0-4cc4-b2c9-ba31ecde3f4b service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:02.637011 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1695d4-e5a0-4cc4-b2c9-ba31ecde3f4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:02.637271 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1695d4-e5a0-4cc4-b2c9-ba31ecde3f4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:02.651875 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1695d4-e5a0-4cc4-b2c9-ba31ecde3f4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:02.653395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1695d4-e5a0-4cc4-b2c9-ba31ecde3f4b service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:02.664874 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1093/2191] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:06:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 01:06:02.686070 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1695d4-e5a0-4cc4-b2c9-ba31ecde3f4b service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:02.688118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-0a1695d4-e5a0-4cc4-b2c9-ba31ecde3f4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:02.736209 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:02.752004 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85705d49-d699-4c1d-b398-8c9a7399e3ac admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:02.757025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381c5cf-d19b-445a-8239-fc3ed35f239e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:02.758329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381c5cf-d19b-445a-8239-fc3ed35f239e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:02.758518 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381c5cf-d19b-445a-8239-fc3ed35f239e admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:02.758799 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381c5cf-d19b-445a-8239-fc3ed35f239e admin admin] PATH_INFO: `/v3/users/426e54068f884adb9174e1c4f3a8c747` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:02.759932 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381c5cf-d19b-445a-8239-fc3ed35f239e admin admin] RBAC: Authorizing `identity:delete_user(user_id=426e54068f884adb9174e1c4f3a8c747)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:02.761876 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381c5cf-d19b-445a-8239-fc3ed35f239e admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:02.783582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1695d4-e5a0-4cc4-b2c9-ba31ecde3f4b service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:02.788955 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2e28d-939a-44e4-9eac-62ac538d5542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:02.789644 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2e28d-939a-44e4-9eac-62ac538d5542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:02.789951 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2e28d-939a-44e4-9eac-62ac538d5542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:02.790375 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2e28d-939a-44e4-9eac-62ac538d5542 admin admin] PATH_INFO: `/v3/users/aec708289304422285e8a89244b23431` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:02.791523 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2e28d-939a-44e4-9eac-62ac538d5542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aec708289304422285e8a89244b23431)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:02.793566 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2e28d-939a-44e4-9eac-62ac538d5542 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:02.833085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4381c5cf-d19b-445a-8239-fc3ed35f239e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '426e54068f884adb9174e1c4f3a8c747'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:02.841394 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4381c5cf-d19b-445a-8239-fc3ed35f239e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '426e54068f884adb9174e1c4f3a8c747'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:02.853289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-01a2e28d-939a-44e4-9eac-62ac538d5542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aec708289304422285e8a89244b23431'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:02.854625 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-01a2e28d-939a-44e4-9eac-62ac538d5542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aec708289304422285e8a89244b23431'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:02.855032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4381c5cf-d19b-445a-8239-fc3ed35f239e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '426e54068f884adb9174e1c4f3a8c747'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:02.856098 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4381c5cf-d19b-445a-8239-fc3ed35f239e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '426e54068f884adb9174e1c4f3a8c747'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:02.857371 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4381c5cf-d19b-445a-8239-fc3ed35f239e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '426e54068f884adb9174e1c4f3a8c747'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:02.863547 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-01a2e28d-939a-44e4-9eac-62ac538d5542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aec708289304422285e8a89244b23431'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:02.875390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1099/2192] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:06:02 2022] DELETE /identity/v3/users/426e54068f884adb9174e1c4f3a8c747 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:02.880283 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-01a2e28d-939a-44e4-9eac-62ac538d5542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aec708289304422285e8a89244b23431'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:02.881102 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-01a2e28d-939a-44e4-9eac-62ac538d5542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aec708289304422285e8a89244b23431'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:02.895383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1094/2193] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:06:02 2022] DELETE /identity/v3/users/aec708289304422285e8a89244b23431 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:06:02.899828 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d1a79-c40e-4d04-b209-d15fb3f60042 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:02.900627 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d1a79-c40e-4d04-b209-d15fb3f60042 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:02.901075 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d1a79-c40e-4d04-b209-d15fb3f60042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:02.923493 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-b66d1a79-c40e-4d04-b209-d15fb3f60042 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:02.924985 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b66d1a79-c40e-4d04-b209-d15fb3f60042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:03.005868 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1100/2194] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:06:03.014691 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2e28d-939a-44e4-9eac-62ac538d5542 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:03.016235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-01a2e28d-939a-44e4-9eac-62ac538d5542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:03.020347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d1a79-c40e-4d04-b209-d15fb3f60042 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:03.023250 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b66d1a79-c40e-4d04-b209-d15fb3f60042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:03.039414 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d1a79-c40e-4d04-b209-d15fb3f60042 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:03.046494 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7e346-a5d8-4049-b119-40f2197c8081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:03.047194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7e346-a5d8-4049-b119-40f2197c8081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:03.047549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7e346-a5d8-4049-b119-40f2197c8081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:03.048409 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7e346-a5d8-4049-b119-40f2197c8081 admin admin] PATH_INFO: `/v3/users/eb5424c4976f4d55b8213ae7b003d26a` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:03.050263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7e346-a5d8-4049-b119-40f2197c8081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb5424c4976f4d55b8213ae7b003d26a)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:03.052477 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7e346-a5d8-4049-b119-40f2197c8081 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:03.112837 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-daf7e346-a5d8-4049-b119-40f2197c8081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb5424c4976f4d55b8213ae7b003d26a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:03.115174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2e28d-939a-44e4-9eac-62ac538d5542 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:03.119571 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75190602-b1f8-46c5-ae75-5b53fc8749a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:03.120772 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75190602-b1f8-46c5-ae75-5b53fc8749a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:03.121068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75190602-b1f8-46c5-ae75-5b53fc8749a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:03.121341 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75190602-b1f8-46c5-ae75-5b53fc8749a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:03.122984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-daf7e346-a5d8-4049-b119-40f2197c8081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb5424c4976f4d55b8213ae7b003d26a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:03.132308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:03.137102 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75190602-b1f8-46c5-ae75-5b53fc8749a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:03.138508 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75190602-b1f8-46c5-ae75-5b53fc8749a8 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:03.142268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-daf7e346-a5d8-4049-b119-40f2197c8081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb5424c4976f4d55b8213ae7b003d26a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:03.143722 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-daf7e346-a5d8-4049-b119-40f2197c8081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb5424c4976f4d55b8213ae7b003d26a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:03.144831 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-daf7e346-a5d8-4049-b119-40f2197c8081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb5424c4976f4d55b8213ae7b003d26a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:03.149824 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1095/2195] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:06:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:06:03.162830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1101/2196] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:06:03 2022] DELETE /identity/v3/users/eb5424c4976f4d55b8213ae7b003d26a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:03.167817 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f5ce4-5aaf-4429-94b8-846402861522 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:03.168380 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f5ce4-5aaf-4429-94b8-846402861522 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:03.168380 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f5ce4-5aaf-4429-94b8-846402861522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:03.178570 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:03.190780 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-687f5ce4-5aaf-4429-94b8-846402861522 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:03.191684 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-687f5ce4-5aaf-4429-94b8-846402861522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:03.229519 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7e346-a5d8-4049-b119-40f2197c8081 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:03.231050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-daf7e346-a5d8-4049-b119-40f2197c8081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:03.280076 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1096/2197] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:03.290698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f5ce4-5aaf-4429-94b8-846402861522 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:03.292382 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-687f5ce4-5aaf-4429-94b8-846402861522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:03.327085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7e346-a5d8-4049-b119-40f2197c8081 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:03.334210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037166c-bfa2-4b23-96d0-67522cfc1124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:03.335190 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037166c-bfa2-4b23-96d0-67522cfc1124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:03.335650 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037166c-bfa2-4b23-96d0-67522cfc1124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:03.335879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037166c-bfa2-4b23-96d0-67522cfc1124 admin admin] PATH_INFO: `/v3/projects/477fd6ac3c654dac848b194298dea0b1` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:03.337146 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037166c-bfa2-4b23-96d0-67522cfc1124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=477fd6ac3c654dac848b194298dea0b1)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:03.339650 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037166c-bfa2-4b23-96d0-67522cfc1124 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:03.376038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f5ce4-5aaf-4429-94b8-846402861522 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:03.379920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7690346-5789-4247-9d30-d1f8f7e08efd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:03.380661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7690346-5789-4247-9d30-d1f8f7e08efd service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:03.380999 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7690346-5789-4247-9d30-d1f8f7e08efd service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:03.381327 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7690346-5789-4247-9d30-d1f8f7e08efd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:03.393180 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7690346-5789-4247-9d30-d1f8f7e08efd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:03.394923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7690346-5789-4247-9d30-d1f8f7e08efd service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:03.410228 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-8037166c-bfa2-4b23-96d0-67522cfc1124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '477fd6ac3c654dac848b194298dea0b1', 'request_id': 'req-8037166c-bfa2-4b23-96d0-67522cfc1124'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:03.414241 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1097/2198] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:06:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 01:06:03.419937 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-8037166c-bfa2-4b23-96d0-67522cfc1124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '477fd6ac3c654dac848b194298dea0b1', 'request_id': 'req-8037166c-bfa2-4b23-96d0-67522cfc1124'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:03.429273 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-8037166c-bfa2-4b23-96d0-67522cfc1124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '477fd6ac3c654dac848b194298dea0b1', 'request_id': 'req-8037166c-bfa2-4b23-96d0-67522cfc1124'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:03.441092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-8037166c-bfa2-4b23-96d0-67522cfc1124 admin admin] The token cache is being invalidate because project 477fd6ac3c654dac848b194298dea0b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:06:03.441620 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-8037166c-bfa2-4b23-96d0-67522cfc1124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:03.442548 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-8037166c-bfa2-4b23-96d0-67522cfc1124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:03.444395 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1102/2199] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:06:03 2022] DELETE /identity/v3/projects/477fd6ac3c654dac848b194298dea0b1 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:06:03.448198 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7690346-5789-4247-9d30-d1f8f7e08efd service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:03.462038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7690346-5789-4247-9d30-d1f8f7e08efd service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:03.529443 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0792707-a04b-4bb2-bb81-a3e90d47235b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:03.530312 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0792707-a04b-4bb2-bb81-a3e90d47235b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:03.530774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0792707-a04b-4bb2-bb81-a3e90d47235b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:03.531150 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0792707-a04b-4bb2-bb81-a3e90d47235b admin admin] PATH_INFO: `/v3/users/2d410984f7b24c6e8241476c3e29eb94` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:03.532317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0792707-a04b-4bb2-bb81-a3e90d47235b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d410984f7b24c6e8241476c3e29eb94)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:03.534434 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0792707-a04b-4bb2-bb81-a3e90d47235b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:03.575168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037166c-bfa2-4b23-96d0-67522cfc1124 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:03.576795 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8037166c-bfa2-4b23-96d0-67522cfc1124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:03.591507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037166c-bfa2-4b23-96d0-67522cfc1124 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:03.592994 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e0792707-a04b-4bb2-bb81-a3e90d47235b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d410984f7b24c6e8241476c3e29eb94'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:03.594305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e0792707-a04b-4bb2-bb81-a3e90d47235b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d410984f7b24c6e8241476c3e29eb94'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:03.597456 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:03.607304 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b1be5-16e4-42c2-9637-a149695fc3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:03.607512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e0792707-a04b-4bb2-bb81-a3e90d47235b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d410984f7b24c6e8241476c3e29eb94'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:03.607825 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b1be5-16e4-42c2-9637-a149695fc3cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:03.608130 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b1be5-16e4-42c2-9637-a149695fc3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:03.608364 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b1be5-16e4-42c2-9637-a149695fc3cf admin admin] PATH_INFO: `/v3/projects/c2be682a8ce64775b747edfa92a0043a` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:03.609666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b1be5-16e4-42c2-9637-a149695fc3cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2be682a8ce64775b747edfa92a0043a)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:03.612456 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b1be5-16e4-42c2-9637-a149695fc3cf admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:03.628842 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e0792707-a04b-4bb2-bb81-a3e90d47235b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d410984f7b24c6e8241476c3e29eb94'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:03.631569 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e0792707-a04b-4bb2-bb81-a3e90d47235b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d410984f7b24c6e8241476c3e29eb94'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:03.649891 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1098/2200] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:06:03 2022] DELETE /identity/v3/users/2d410984f7b24c6e8241476c3e29eb94 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:03.672231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e49b1be5-16e4-42c2-9637-a149695fc3cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2be682a8ce64775b747edfa92a0043a', 'request_id': 'req-e49b1be5-16e4-42c2-9637-a149695fc3cf'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:03.681144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e49b1be5-16e4-42c2-9637-a149695fc3cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2be682a8ce64775b747edfa92a0043a', 'request_id': 'req-e49b1be5-16e4-42c2-9637-a149695fc3cf'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:03.689965 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e49b1be5-16e4-42c2-9637-a149695fc3cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2be682a8ce64775b747edfa92a0043a', 'request_id': 'req-e49b1be5-16e4-42c2-9637-a149695fc3cf'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:03.701124 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:03.711185 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e49b1be5-16e4-42c2-9637-a149695fc3cf admin admin] The token cache is being invalidate because project c2be682a8ce64775b747edfa92a0043a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:06:03.711592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e49b1be5-16e4-42c2-9637-a149695fc3cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:03.713407 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e49b1be5-16e4-42c2-9637-a149695fc3cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:03.715056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1103/2201] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:06:03 2022] DELETE /identity/v3/projects/c2be682a8ce64775b747edfa92a0043a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:03.720135 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc2879-2420-4141-9cf2-dd263da88584 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:03.720440 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc2879-2420-4141-9cf2-dd263da88584 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:03.720748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc2879-2420-4141-9cf2-dd263da88584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:03.741790 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-8fcc2879-2420-4141-9cf2-dd263da88584 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:03.743747 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8fcc2879-2420-4141-9cf2-dd263da88584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:03.802178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b1be5-16e4-42c2-9637-a149695fc3cf admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:03.803651 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e49b1be5-16e4-42c2-9637-a149695fc3cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:03.850201 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1099/2202] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:03.851636 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e93b37-d689-4560-ac8e-2e86052b131e None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:03.851983 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e93b37-d689-4560-ac8e-2e86052b131e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:03.852257 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e93b37-d689-4560-ac8e-2e86052b131e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:03.876133 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-13e93b37-d689-4560-ac8e-2e86052b131e None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:03.877345 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-13e93b37-d689-4560-ac8e-2e86052b131e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:03.890515 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1100/2203] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:03.891465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e93b37-d689-4560-ac8e-2e86052b131e None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:03.894450 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b1be5-16e4-42c2-9637-a149695fc3cf admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:03.900177 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922c46e-c2ab-47e6-90a8-bd44e39e4990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:03.900831 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e93b37-d689-4560-ac8e-2e86052b131e None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:03.901031 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922c46e-c2ab-47e6-90a8-bd44e39e4990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:03.901316 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922c46e-c2ab-47e6-90a8-bd44e39e4990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:03.901686 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922c46e-c2ab-47e6-90a8-bd44e39e4990 admin admin] PATH_INFO: `/v3/projects/c7aef744a723418381ef606c86daa4bd` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:03.902948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922c46e-c2ab-47e6-90a8-bd44e39e4990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7aef744a723418381ef606c86daa4bd)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:03.905814 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922c46e-c2ab-47e6-90a8-bd44e39e4990 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:03.905944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf04fd-dbbe-446e-a601-d75bee1722fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:03.906407 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf04fd-dbbe-446e-a601-d75bee1722fe admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:03.906683 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf04fd-dbbe-446e-a601-d75bee1722fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:03.906953 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf04fd-dbbe-446e-a601-d75bee1722fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:03.907590 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbf04fd-dbbe-446e-a601-d75bee1722fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:06:03.907888 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbf04fd-dbbe-446e-a601-d75bee1722fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:03.909479 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbf04fd-dbbe-446e-a601-d75bee1722fe admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:03.924297 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1101/2204] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:06:03.928552 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf04fd-dbbe-446e-a601-d75bee1722fe admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:03.940620 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf04fd-dbbe-446e-a601-d75bee1722fe admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:03.948319 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93c8c0-2eac-43fe-850e-1ae633e1e2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:03.949935 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93c8c0-2eac-43fe-850e-1ae633e1e2ea admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:03.950451 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93c8c0-2eac-43fe-850e-1ae633e1e2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:03.951162 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93c8c0-2eac-43fe-850e-1ae633e1e2ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:03.952740 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d93c8c0-2eac-43fe-850e-1ae633e1e2ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:03.955872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d93c8c0-2eac-43fe-850e-1ae633e1e2ea admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:03.973034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-c922c46e-c2ab-47e6-90a8-bd44e39e4990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7aef744a723418381ef606c86daa4bd', 'request_id': 'req-c922c46e-c2ab-47e6-90a8-bd44e39e4990'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:03.986567 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-c922c46e-c2ab-47e6-90a8-bd44e39e4990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7aef744a723418381ef606c86daa4bd', 'request_id': 'req-c922c46e-c2ab-47e6-90a8-bd44e39e4990'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:04.002028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-c922c46e-c2ab-47e6-90a8-bd44e39e4990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7aef744a723418381ef606c86daa4bd', 'request_id': 'req-c922c46e-c2ab-47e6-90a8-bd44e39e4990'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:04.019147 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1102/2205] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:06:03 2022] POST /identity/v3/projects => generated 371 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:06:04.020108 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93c8c0-2eac-43fe-850e-1ae633e1e2ea admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:04.027553 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-c922c46e-c2ab-47e6-90a8-bd44e39e4990 admin admin] The token cache is being invalidate because project c7aef744a723418381ef606c86daa4bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:06:04.028399 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-c922c46e-c2ab-47e6-90a8-bd44e39e4990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:04.029910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-c922c46e-c2ab-47e6-90a8-bd44e39e4990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:04.033321 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1104/2206] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:06:03 2022] DELETE /identity/v3/projects/c7aef744a723418381ef606c86daa4bd => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:06:04.036860 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922c46e-c2ab-47e6-90a8-bd44e39e4990 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:04.038520 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c922c46e-c2ab-47e6-90a8-bd44e39e4990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:04.093141 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93c8c0-2eac-43fe-850e-1ae633e1e2ea admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:04.099085 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db199c-7f5b-4e54-abbd-5b4c03f9ac0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:04.099693 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db199c-7f5b-4e54-abbd-5b4c03f9ac0e admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:04.099989 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db199c-7f5b-4e54-abbd-5b4c03f9ac0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:04.100248 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db199c-7f5b-4e54-abbd-5b4c03f9ac0e admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:04.100880 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db199c-7f5b-4e54-abbd-5b4c03f9ac0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:04.102853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db199c-7f5b-4e54-abbd-5b4c03f9ac0e admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:04.111202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922c46e-c2ab-47e6-90a8-bd44e39e4990 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:04.116158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8357124-397a-4c4f-bbcf-f9174c3ca66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:04.116855 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8357124-397a-4c4f-bbcf-f9174c3ca66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:04.117343 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8357124-397a-4c4f-bbcf-f9174c3ca66b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:04.117690 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8357124-397a-4c4f-bbcf-f9174c3ca66b admin admin] PATH_INFO: `/v3/users/9e96d398768246d7ae1511de9257e053` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:04.119525 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8357124-397a-4c4f-bbcf-f9174c3ca66b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e96d398768246d7ae1511de9257e053)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:04.121426 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8357124-397a-4c4f-bbcf-f9174c3ca66b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:04.135950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1103/2207] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:06:04 2022] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:06:04.138077 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db199c-7f5b-4e54-abbd-5b4c03f9ac0e admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:04.138893 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-10db199c-7f5b-4e54-abbd-5b4c03f9ac0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:04.157026 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db199c-7f5b-4e54-abbd-5b4c03f9ac0e admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:04.164276 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05865564-2a2b-47ea-843b-b08047fe9a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:04.165049 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05865564-2a2b-47ea-843b-b08047fe9a10 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:04.165411 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05865564-2a2b-47ea-843b-b08047fe9a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:04.165692 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05865564-2a2b-47ea-843b-b08047fe9a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:04.166513 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05865564-2a2b-47ea-843b-b08047fe9a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:04.170351 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05865564-2a2b-47ea-843b-b08047fe9a10 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:04.171006 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:04.183212 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1104/2208] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:06:04.183986 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05865564-2a2b-47ea-843b-b08047fe9a10 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:04.185671 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-05865564-2a2b-47ea-843b-b08047fe9a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:04.197012 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f8357124-397a-4c4f-bbcf-f9174c3ca66b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e96d398768246d7ae1511de9257e053'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:04.200987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:04.207258 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f8357124-397a-4c4f-bbcf-f9174c3ca66b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e96d398768246d7ae1511de9257e053'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:04.208903 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05865564-2a2b-47ea-843b-b08047fe9a10 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:04.216909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2272c31-18d1-4791-83dd-36dab50b21b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:04.217536 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2272c31-18d1-4791-83dd-36dab50b21b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:04.217831 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2272c31-18d1-4791-83dd-36dab50b21b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:04.218954 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2272c31-18d1-4791-83dd-36dab50b21b8 admin admin] PATH_INFO: `/v3/projects/ebc560cced3a423593a9a941fc4872bd` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:04.220395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2272c31-18d1-4791-83dd-36dab50b21b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebc560cced3a423593a9a941fc4872bd)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:04.221829 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f8357124-397a-4c4f-bbcf-f9174c3ca66b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e96d398768246d7ae1511de9257e053'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:04.222766 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f8357124-397a-4c4f-bbcf-f9174c3ca66b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e96d398768246d7ae1511de9257e053'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:04.223506 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f8357124-397a-4c4f-bbcf-f9174c3ca66b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e96d398768246d7ae1511de9257e053'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:04.223615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2272c31-18d1-4791-83dd-36dab50b21b8 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:04.238882 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1105/2209] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:06:04 2022] DELETE /identity/v3/users/9e96d398768246d7ae1511de9257e053 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:06:04.239618 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8357124-397a-4c4f-bbcf-f9174c3ca66b admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:04.240941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f8357124-397a-4c4f-bbcf-f9174c3ca66b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:04.292265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e2272c31-18d1-4791-83dd-36dab50b21b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebc560cced3a423593a9a941fc4872bd', 'request_id': 'req-e2272c31-18d1-4791-83dd-36dab50b21b8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:04.304915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e2272c31-18d1-4791-83dd-36dab50b21b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebc560cced3a423593a9a941fc4872bd', 'request_id': 'req-e2272c31-18d1-4791-83dd-36dab50b21b8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:04.313596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e2272c31-18d1-4791-83dd-36dab50b21b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebc560cced3a423593a9a941fc4872bd', 'request_id': 'req-e2272c31-18d1-4791-83dd-36dab50b21b8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:04.327018 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8357124-397a-4c4f-bbcf-f9174c3ca66b admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:04.328141 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e2272c31-18d1-4791-83dd-36dab50b21b8 admin admin] The token cache is being invalidate because project ebc560cced3a423593a9a941fc4872bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:06:04.328439 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e2272c31-18d1-4791-83dd-36dab50b21b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:04.329595 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e2272c31-18d1-4791-83dd-36dab50b21b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:04.335755 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1105/2210] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:06:04 2022] DELETE /identity/v3/projects/ebc560cced3a423593a9a941fc4872bd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:04.337910 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f6b3e-fdb3-4344-bea6-e5201213526d None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:04.338193 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f6b3e-fdb3-4344-bea6-e5201213526d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:04.338464 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f6b3e-fdb3-4344-bea6-e5201213526d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:04.362782 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-bc2f6b3e-fdb3-4344-bea6-e5201213526d None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:04.364113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-bc2f6b3e-fdb3-4344-bea6-e5201213526d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:04.395898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5e417-03e9-42f1-a0b7-f4ab4a76ee18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:04.396511 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5e417-03e9-42f1-a0b7-f4ab4a76ee18 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:04.396788 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5e417-03e9-42f1-a0b7-f4ab4a76ee18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:04.397237 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5e417-03e9-42f1-a0b7-f4ab4a76ee18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:04.398021 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5e417-03e9-42f1-a0b7-f4ab4a76ee18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:04.400139 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5e417-03e9-42f1-a0b7-f4ab4a76ee18 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:04.419661 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1106/2211] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:06:04.421998 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5e417-03e9-42f1-a0b7-f4ab4a76ee18 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:04.424106 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-60c5e417-03e9-42f1-a0b7-f4ab4a76ee18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:04.439283 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5e417-03e9-42f1-a0b7-f4ab4a76ee18 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:04.441847 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1106/2212] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:04.449985 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d1b63-4cf3-44da-9cc1-4f6d5cf4383d None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:04.450377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d1b63-4cf3-44da-9cc1-4f6d5cf4383d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:04.450736 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d1b63-4cf3-44da-9cc1-4f6d5cf4383d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:04.463461 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c73819-1bc8-4489-b12c-0a770a92c81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:04.464328 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c73819-1bc8-4489-b12c-0a770a92c81a admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:04.464721 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c73819-1bc8-4489-b12c-0a770a92c81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:04.465049 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c73819-1bc8-4489-b12c-0a770a92c81a admin admin] PATH_INFO: `/v3/projects/65774682387b4a3c910e4598e36a8871/users/64ce96b5b0d54dc38e5fa1328faf9ae0/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:04.485266 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-a99d1b63-4cf3-44da-9cc1-4f6d5cf4383d None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:04.487010 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a99d1b63-4cf3-44da-9cc1-4f6d5cf4383d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:04.496408 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1107/2213] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:04.500582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d1b63-4cf3-44da-9cc1-4f6d5cf4383d None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:04.502490 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c73819-1bc8-4489-b12c-0a770a92c81a admin admin] RBAC: Authorizing `identity:create_grant(project_id=65774682387b4a3c910e4598e36a8871, user_id=64ce96b5b0d54dc38e5fa1328faf9ae0, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:04.509881 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c73819-1bc8-4489-b12c-0a770a92c81a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:04.516144 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d1b63-4cf3-44da-9cc1-4f6d5cf4383d None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:04.522503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727e602-b11d-4706-804b-e559735eadef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:04.523292 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727e602-b11d-4706-804b-e559735eadef admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:04.523684 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727e602-b11d-4706-804b-e559735eadef admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:04.524111 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727e602-b11d-4706-804b-e559735eadef admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:04.524768 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727e602-b11d-4706-804b-e559735eadef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:06:04.525075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727e602-b11d-4706-804b-e559735eadef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:04.527455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727e602-b11d-4706-804b-e559735eadef admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:04.528626 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1107/2214] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:06:04 2022] PUT /identity/v3/projects/65774682387b4a3c910e4598e36a8871/users/64ce96b5b0d54dc38e5fa1328faf9ae0/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:04.541584 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad5538-01c2-46ee-bb20-82dc24cf7f2f None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:04.542110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad5538-01c2-46ee-bb20-82dc24cf7f2f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:04.542491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad5538-01c2-46ee-bb20-82dc24cf7f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:04.561837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1108/2215] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:06:04.564555 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727e602-b11d-4706-804b-e559735eadef admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:04.578941 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727e602-b11d-4706-804b-e559735eadef admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:04.580324 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-b6ad5538-01c2-46ee-bb20-82dc24cf7f2f None None] MFA Rules not processed for user `64ce96b5b0d54dc38e5fa1328faf9ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:04.581553 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b6ad5538-01c2-46ee-bb20-82dc24cf7f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:04.595130 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:04.667216 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e38a9f-2e10-4798-a5b5-9ae44b0cf612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:04.667216 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e38a9f-2e10-4798-a5b5-9ae44b0cf612 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:04.667216 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e38a9f-2e10-4798-a5b5-9ae44b0cf612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:04.667216 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e38a9f-2e10-4798-a5b5-9ae44b0cf612 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:04.667695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e38a9f-2e10-4798-a5b5-9ae44b0cf612 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:04.668185 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e38a9f-2e10-4798-a5b5-9ae44b0cf612 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:04.696920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:04.704509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1108/2216] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:04.710687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad5538-01c2-46ee-bb20-82dc24cf7f2f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:04.711955 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b6ad5538-01c2-46ee-bb20-82dc24cf7f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:04.717251 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1109/2217] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:06:04 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:06:04.730106 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e38a9f-2e10-4798-a5b5-9ae44b0cf612 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:04.730106 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e1e38a9f-2e10-4798-a5b5-9ae44b0cf612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:04.736963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad5538-01c2-46ee-bb20-82dc24cf7f2f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:04.786525 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e38a9f-2e10-4798-a5b5-9ae44b0cf612 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:04.790131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bcf25-a33f-473e-a1aa-9ab0b4ea3abe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:04.790720 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bcf25-a33f-473e-a1aa-9ab0b4ea3abe service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:04.790992 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bcf25-a33f-473e-a1aa-9ab0b4ea3abe service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:04.791259 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bcf25-a33f-473e-a1aa-9ab0b4ea3abe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:04.794154 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168741c-1b2a-4ace-ac08-b57b92c174cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:04.794722 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168741c-1b2a-4ace-ac08-b57b92c174cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:04.794996 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168741c-1b2a-4ace-ac08-b57b92c174cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:04.795382 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168741c-1b2a-4ace-ac08-b57b92c174cf admin admin] PATH_INFO: `/v3/projects/aa0629d68b584c998687826f8139833a` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:04.796994 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168741c-1b2a-4ace-ac08-b57b92c174cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa0629d68b584c998687826f8139833a)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:04.798909 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168741c-1b2a-4ace-ac08-b57b92c174cf admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:04.848971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86bcf25-a33f-473e-a1aa-9ab0b4ea3abe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:04.849939 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0168741c-1b2a-4ace-ac08-b57b92c174cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa0629d68b584c998687826f8139833a', 'request_id': 'req-0168741c-1b2a-4ace-ac08-b57b92c174cf'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:04.850439 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86bcf25-a33f-473e-a1aa-9ab0b4ea3abe service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:04.857832 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0168741c-1b2a-4ace-ac08-b57b92c174cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa0629d68b584c998687826f8139833a', 'request_id': 'req-0168741c-1b2a-4ace-ac08-b57b92c174cf'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:04.860875 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1110/2218] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:06:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:06:04.861645 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bcf25-a33f-473e-a1aa-9ab0b4ea3abe service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:04.865336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0168741c-1b2a-4ace-ac08-b57b92c174cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa0629d68b584c998687826f8139833a', 'request_id': 'req-0168741c-1b2a-4ace-ac08-b57b92c174cf'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:04.876153 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bcf25-a33f-473e-a1aa-9ab0b4ea3abe service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:04.877014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0168741c-1b2a-4ace-ac08-b57b92c174cf admin admin] The token cache is being invalidate because project aa0629d68b584c998687826f8139833a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:06:04.877303 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0168741c-1b2a-4ace-ac08-b57b92c174cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:04.877977 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0168741c-1b2a-4ace-ac08-b57b92c174cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:04.879621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1109/2219] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:06:04 2022] DELETE /identity/v3/projects/aa0629d68b584c998687826f8139833a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:04.883349 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168741c-1b2a-4ace-ac08-b57b92c174cf admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:04.885570 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0168741c-1b2a-4ace-ac08-b57b92c174cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:04.932617 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:04.933355 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea76b6-e3d3-4a9a-9105-08889464ecc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:04.933992 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea76b6-e3d3-4a9a-9105-08889464ecc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:04.934321 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea76b6-e3d3-4a9a-9105-08889464ecc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:04.934610 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea76b6-e3d3-4a9a-9105-08889464ecc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:04.935240 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea76b6-e3d3-4a9a-9105-08889464ecc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:04.937949 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea76b6-e3d3-4a9a-9105-08889464ecc4 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:04.952822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168741c-1b2a-4ace-ac08-b57b92c174cf admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:04.957469 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ba47d-6547-4265-9a3e-dc6fbe603239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:04.958120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ba47d-6547-4265-9a3e-dc6fbe603239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:04.958399 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ba47d-6547-4265-9a3e-dc6fbe603239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:04.958669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ba47d-6547-4265-9a3e-dc6fbe603239 admin admin] PATH_INFO: `/v3/users/d43f621256a14610b7f94d904dbd13cc` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:04.962236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1111/2220] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:06:04 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:06:04.962372 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ba47d-6547-4265-9a3e-dc6fbe603239 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d43f621256a14610b7f94d904dbd13cc)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:04.962463 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea76b6-e3d3-4a9a-9105-08889464ecc4 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:04.962463 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-28ea76b6-e3d3-4a9a-9105-08889464ecc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:04.962620 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ba47d-6547-4265-9a3e-dc6fbe603239 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:04.973841 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea76b6-e3d3-4a9a-9105-08889464ecc4 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:04.979447 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf2be7-8c91-47a3-90c2-2ffddba39680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:04.980078 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf2be7-8c91-47a3-90c2-2ffddba39680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:04.980353 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf2be7-8c91-47a3-90c2-2ffddba39680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:04.980624 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf2be7-8c91-47a3-90c2-2ffddba39680 admin admin] PATH_INFO: `/v3/users/64ce96b5b0d54dc38e5fa1328faf9ae0` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:04.981793 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf2be7-8c91-47a3-90c2-2ffddba39680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64ce96b5b0d54dc38e5fa1328faf9ae0)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:04.984354 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf2be7-8c91-47a3-90c2-2ffddba39680 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:05.013171 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b40ba47d-6547-4265-9a3e-dc6fbe603239 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd43f621256a14610b7f94d904dbd13cc'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:05.022674 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b40ba47d-6547-4265-9a3e-dc6fbe603239 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd43f621256a14610b7f94d904dbd13cc'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:05.026272 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:INSERT=4,keystone:SELECT=91,keystone:DELETE=5 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:05.037475 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b40ba47d-6547-4265-9a3e-dc6fbe603239 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd43f621256a14610b7f94d904dbd13cc'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:05.037475 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b40ba47d-6547-4265-9a3e-dc6fbe603239 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd43f621256a14610b7f94d904dbd13cc'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:05.038046 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b40ba47d-6547-4265-9a3e-dc6fbe603239 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd43f621256a14610b7f94d904dbd13cc'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:05.051769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1110/2221] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:06:04 2022] DELETE /identity/v3/users/d43f621256a14610b7f94d904dbd13cc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:05.058568 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ba47d-6547-4265-9a3e-dc6fbe603239 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:05.059969 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b40ba47d-6547-4265-9a3e-dc6fbe603239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:05.063197 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-0edf2be7-8c91-47a3-90c2-2ffddba39680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64ce96b5b0d54dc38e5fa1328faf9ae0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:05.063971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-0edf2be7-8c91-47a3-90c2-2ffddba39680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64ce96b5b0d54dc38e5fa1328faf9ae0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:05.082619 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-0edf2be7-8c91-47a3-90c2-2ffddba39680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64ce96b5b0d54dc38e5fa1328faf9ae0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:05.101843 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-0edf2be7-8c91-47a3-90c2-2ffddba39680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64ce96b5b0d54dc38e5fa1328faf9ae0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:05.103424 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-0edf2be7-8c91-47a3-90c2-2ffddba39680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64ce96b5b0d54dc38e5fa1328faf9ae0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:05.124518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1112/2222] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:06:04 2022] DELETE /identity/v3/users/64ce96b5b0d54dc38e5fa1328faf9ae0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:05.130614 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d52c20-4ddc-41b4-adc0-9bb83f4a6ba7 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:05.130929 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d52c20-4ddc-41b4-adc0-9bb83f4a6ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:05.131355 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d52c20-4ddc-41b4-adc0-9bb83f4a6ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:05.161167 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-d5d52c20-4ddc-41b4-adc0-9bb83f4a6ba7 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:05.162451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ba47d-6547-4265-9a3e-dc6fbe603239 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:05.162958 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d5d52c20-4ddc-41b4-adc0-9bb83f4a6ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:05.255956 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1113/2223] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:05.256671 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b807aa5-0705-418a-8881-02092a71e7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:05.257376 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b807aa5-0705-418a-8881-02092a71e7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:05.257725 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b807aa5-0705-418a-8881-02092a71e7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:05.258106 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b807aa5-0705-418a-8881-02092a71e7b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:05.258823 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b807aa5-0705-418a-8881-02092a71e7b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:05.260544 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b807aa5-0705-418a-8881-02092a71e7b8 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:05.266638 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d52c20-4ddc-41b4-adc0-9bb83f4a6ba7 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:05.268561 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d5d52c20-4ddc-41b4-adc0-9bb83f4a6ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:05.275555 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1111/2224] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:06:05.276623 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b807aa5-0705-418a-8881-02092a71e7b8 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:05.278427 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5b807aa5-0705-418a-8881-02092a71e7b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:05.294469 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b807aa5-0705-418a-8881-02092a71e7b8 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:05.300781 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d851ab-56cf-4262-a8b1-8c3e3cc244c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:05.301345 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d851ab-56cf-4262-a8b1-8c3e3cc244c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:05.301689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d851ab-56cf-4262-a8b1-8c3e3cc244c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:05.302085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d851ab-56cf-4262-a8b1-8c3e3cc244c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:05.302800 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d851ab-56cf-4262-a8b1-8c3e3cc244c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:05.304613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d851ab-56cf-4262-a8b1-8c3e3cc244c0 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:05.306478 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:05.318823 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1112/2225] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:06:05.322755 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d851ab-56cf-4262-a8b1-8c3e3cc244c0 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:05.333440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d851ab-56cf-4262-a8b1-8c3e3cc244c0 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:05.338219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ca97c-ed97-4f15-9480-47cc13a832f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:05.338859 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ca97c-ed97-4f15-9480-47cc13a832f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:05.339133 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ca97c-ed97-4f15-9480-47cc13a832f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:05.339406 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ca97c-ed97-4f15-9480-47cc13a832f0 admin admin] PATH_INFO: `/v3/projects/68e0337b30434aa3bac753cbb2ee685c/users/b366bd92a62d4353be8b9d0121aebf31/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:05.339588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d52c20-4ddc-41b4-adc0-9bb83f4a6ba7 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:05.344917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd13851-c815-46b4-9c0f-5391e9b4d821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:05.345708 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd13851-c815-46b4-9c0f-5391e9b4d821 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:05.346017 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd13851-c815-46b4-9c0f-5391e9b4d821 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:05.346288 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd13851-c815-46b4-9c0f-5391e9b4d821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:05.355514 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd13851-c815-46b4-9c0f-5391e9b4d821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:05.355656 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ca97c-ed97-4f15-9480-47cc13a832f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68e0337b30434aa3bac753cbb2ee685c, user_id=b366bd92a62d4353be8b9d0121aebf31, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:05.357770 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd13851-c815-46b4-9c0f-5391e9b4d821 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:05.359399 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ca97c-ed97-4f15-9480-47cc13a832f0 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:05.370216 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1114/2226] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:06:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 01:06:05.371046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd13851-c815-46b4-9c0f-5391e9b4d821 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:05.372396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9bd13851-c815-46b4-9c0f-5391e9b4d821 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:05.386845 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1113/2227] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:06:05 2022] PUT /identity/v3/projects/68e0337b30434aa3bac753cbb2ee685c/users/b366bd92a62d4353be8b9d0121aebf31/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:05.387332 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd13851-c815-46b4-9c0f-5391e9b4d821 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:05.388510 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352fb34-93d4-423b-b452-f23ba8ab87a1 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:05.388974 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352fb34-93d4-423b-b452-f23ba8ab87a1 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:05.389252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352fb34-93d4-423b-b452-f23ba8ab87a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:05.440111 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e352fb34-93d4-423b-b452-f23ba8ab87a1 None None] MFA Rules not processed for user `b366bd92a62d4353be8b9d0121aebf31`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:05.441674 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e352fb34-93d4-423b-b452-f23ba8ab87a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:05.456219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:05.467393 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36ec8e-94f4-42a8-9ed4-59ae58c45cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:05.468811 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36ec8e-94f4-42a8-9ed4-59ae58c45cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:05.469382 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36ec8e-94f4-42a8-9ed4-59ae58c45cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:05.469839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36ec8e-94f4-42a8-9ed4-59ae58c45cdb admin admin] PATH_INFO: `/v3/projects/c77d4d2bc259424c9a0ff6f99e92195d` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:05.471363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36ec8e-94f4-42a8-9ed4-59ae58c45cdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c77d4d2bc259424c9a0ff6f99e92195d)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:05.474111 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36ec8e-94f4-42a8-9ed4-59ae58c45cdb admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:05.516010 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1114/2228] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:05.520823 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352fb34-93d4-423b-b452-f23ba8ab87a1 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:05.529459 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-cb36ec8e-94f4-42a8-9ed4-59ae58c45cdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c77d4d2bc259424c9a0ff6f99e92195d', 'request_id': 'req-cb36ec8e-94f4-42a8-9ed4-59ae58c45cdb'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:05.533573 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352fb34-93d4-423b-b452-f23ba8ab87a1 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:05.540741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-cb36ec8e-94f4-42a8-9ed4-59ae58c45cdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c77d4d2bc259424c9a0ff6f99e92195d', 'request_id': 'req-cb36ec8e-94f4-42a8-9ed4-59ae58c45cdb'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:05.549058 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-cb36ec8e-94f4-42a8-9ed4-59ae58c45cdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c77d4d2bc259424c9a0ff6f99e92195d', 'request_id': 'req-cb36ec8e-94f4-42a8-9ed4-59ae58c45cdb'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:05.561404 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-cb36ec8e-94f4-42a8-9ed4-59ae58c45cdb admin admin] The token cache is being invalidate because project c77d4d2bc259424c9a0ff6f99e92195d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:06:05.562017 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-cb36ec8e-94f4-42a8-9ed4-59ae58c45cdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:05.562739 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-cb36ec8e-94f4-42a8-9ed4-59ae58c45cdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:05.564598 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1115/2229] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:06:05 2022] DELETE /identity/v3/projects/c77d4d2bc259424c9a0ff6f99e92195d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:05.568944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3076f1-baf0-44b8-9520-76b08b377ce1 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:05.569292 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3076f1-baf0-44b8-9520-76b08b377ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:05.569634 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3076f1-baf0-44b8-9520-76b08b377ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:05.592194 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-4e3076f1-baf0-44b8-9520-76b08b377ce1 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:05.594417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4e3076f1-baf0-44b8-9520-76b08b377ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:05.601913 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733815c-f77a-4e0c-83e6-e501089e13d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:05.602646 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733815c-f77a-4e0c-83e6-e501089e13d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:05.602924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733815c-f77a-4e0c-83e6-e501089e13d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:05.603196 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733815c-f77a-4e0c-83e6-e501089e13d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:05.603824 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733815c-f77a-4e0c-83e6-e501089e13d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:05.605707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733815c-f77a-4e0c-83e6-e501089e13d1 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:05.640919 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1115/2230] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:06:05 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:06:05.646117 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733815c-f77a-4e0c-83e6-e501089e13d1 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:05.648033 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f733815c-f77a-4e0c-83e6-e501089e13d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:05.667810 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1116/2231] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:06:05.668695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3076f1-baf0-44b8-9520-76b08b377ce1 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:05.670008 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4e3076f1-baf0-44b8-9520-76b08b377ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:05.685138 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3076f1-baf0-44b8-9520-76b08b377ce1 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:05.705027 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:05.722543 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733815c-f77a-4e0c-83e6-e501089e13d1 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:05.727833 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d84e8-2f5d-4d64-a184-245295adf95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:05.728430 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d84e8-2f5d-4d64-a184-245295adf95f admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:05.728709 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d84e8-2f5d-4d64-a184-245295adf95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:05.729166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d84e8-2f5d-4d64-a184-245295adf95f admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:05.729614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d84e8-2f5d-4d64-a184-245295adf95f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:05.731766 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d84e8-2f5d-4d64-a184-245295adf95f admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:05.745452 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f69686-1adc-4b26-b76d-f4cd1d529cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:05.746165 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f69686-1adc-4b26-b76d-f4cd1d529cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:05.746431 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f69686-1adc-4b26-b76d-f4cd1d529cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:05.746770 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f69686-1adc-4b26-b76d-f4cd1d529cc6 admin admin] PATH_INFO: `/v3/projects/65774682387b4a3c910e4598e36a8871` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:05.748685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f69686-1adc-4b26-b76d-f4cd1d529cc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65774682387b4a3c910e4598e36a8871)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:05.751927 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f69686-1adc-4b26-b76d-f4cd1d529cc6 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:05.755874 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1116/2232] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:06:05 2022] POST /identity/v3/users => generated 300 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:06:05.760225 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d5c0e-92ba-4872-b84b-b7f0f8681a8e None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:05.760514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d5c0e-92ba-4872-b84b-b7f0f8681a8e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:05.760791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d5c0e-92ba-4872-b84b-b7f0f8681a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:05.783107 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-7c6d5c0e-92ba-4872-b84b-b7f0f8681a8e None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:05.784303 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7c6d5c0e-92ba-4872-b84b-b7f0f8681a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:05.787937 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:05.793457 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1117/2233] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:05.794318 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d5c0e-92ba-4872-b84b-b7f0f8681a8e None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:05.806474 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d5c0e-92ba-4872-b84b-b7f0f8681a8e None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:05.809495 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b1f69686-1adc-4b26-b76d-f4cd1d529cc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65774682387b4a3c910e4598e36a8871', 'request_id': 'req-b1f69686-1adc-4b26-b76d-f4cd1d529cc6'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:05.817900 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b1f69686-1adc-4b26-b76d-f4cd1d529cc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65774682387b4a3c910e4598e36a8871', 'request_id': 'req-b1f69686-1adc-4b26-b76d-f4cd1d529cc6'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:05.825362 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b1f69686-1adc-4b26-b76d-f4cd1d529cc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65774682387b4a3c910e4598e36a8871', 'request_id': 'req-b1f69686-1adc-4b26-b76d-f4cd1d529cc6'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:05.838061 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b1f69686-1adc-4b26-b76d-f4cd1d529cc6 admin admin] The token cache is being invalidate because project 65774682387b4a3c910e4598e36a8871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:06:05.838396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b1f69686-1adc-4b26-b76d-f4cd1d529cc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:05.839140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b1f69686-1adc-4b26-b76d-f4cd1d529cc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:05.840905 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1117/2234] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:06:05 2022] DELETE /identity/v3/projects/65774682387b4a3c910e4598e36a8871 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:05.841450 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f69686-1adc-4b26-b76d-f4cd1d529cc6 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:05.842938 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b1f69686-1adc-4b26-b76d-f4cd1d529cc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:05.869208 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae919c02-8a1a-4cd7-88cc-167e6c98ed5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:05.870328 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae919c02-8a1a-4cd7-88cc-167e6c98ed5d admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:05.870637 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae919c02-8a1a-4cd7-88cc-167e6c98ed5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:05.870875 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae919c02-8a1a-4cd7-88cc-167e6c98ed5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:05.871513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae919c02-8a1a-4cd7-88cc-167e6c98ed5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:05.873680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae919c02-8a1a-4cd7-88cc-167e6c98ed5d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:05.884919 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1118/2235] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:06:05.886170 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872be82-5b78-4cee-b9a8-810d8c14b631 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:05.886458 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872be82-5b78-4cee-b9a8-810d8c14b631 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:05.886727 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872be82-5b78-4cee-b9a8-810d8c14b631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:05.909364 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f69686-1adc-4b26-b76d-f4cd1d529cc6 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:05.911657 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-b872be82-5b78-4cee-b9a8-810d8c14b631 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:05.913055 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b872be82-5b78-4cee-b9a8-810d8c14b631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:05.914125 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6b924-f27c-457e-87e2-48a99adc46fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:05.915143 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6b924-f27c-457e-87e2-48a99adc46fd admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:05.915143 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6b924-f27c-457e-87e2-48a99adc46fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:05.915349 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6b924-f27c-457e-87e2-48a99adc46fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:05.915870 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6b924-f27c-457e-87e2-48a99adc46fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:06:05.916167 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6b924-f27c-457e-87e2-48a99adc46fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:05.917749 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6b924-f27c-457e-87e2-48a99adc46fd admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:05.923970 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1119/2236] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:05.924820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872be82-5b78-4cee-b9a8-810d8c14b631 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:05.926953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b872be82-5b78-4cee-b9a8-810d8c14b631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:05.938674 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1118/2237] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:06:05.939307 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2558a-07a8-40df-9718-db3307332f70 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:05.939613 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2558a-07a8-40df-9718-db3307332f70 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:05.939885 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2558a-07a8-40df-9718-db3307332f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:05.940057 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872be82-5b78-4cee-b9a8-810d8c14b631 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:05.944639 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c963da3-519b-4da3-83a3-1caaf4cd8ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:05.945281 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c963da3-519b-4da3-83a3-1caaf4cd8ff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:05.945560 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c963da3-519b-4da3-83a3-1caaf4cd8ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:05.945864 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c963da3-519b-4da3-83a3-1caaf4cd8ff0 admin admin] PATH_INFO: `/v3/projects/4e8e2a0025544c028e49d6c24bc85f3d/users/5c036bf09a3148f0b048e9b1918343e1/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:05.959189 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-f2b2558a-07a8-40df-9718-db3307332f70 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:05.960270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c963da3-519b-4da3-83a3-1caaf4cd8ff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e8e2a0025544c028e49d6c24bc85f3d, user_id=5c036bf09a3148f0b048e9b1918343e1, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:05.960401 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f2b2558a-07a8-40df-9718-db3307332f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:05.963021 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c963da3-519b-4da3-83a3-1caaf4cd8ff0 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:05.969320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1119/2238] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:05.972940 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2558a-07a8-40df-9718-db3307332f70 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:05.978241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1120/2239] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:06:05 2022] PUT /identity/v3/projects/4e8e2a0025544c028e49d6c24bc85f3d/users/5c036bf09a3148f0b048e9b1918343e1/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:05.979211 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c963da3-519b-4da3-83a3-1caaf4cd8ff0 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:05.982249 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2558a-07a8-40df-9718-db3307332f70 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:06.040169 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef00760-467e-4787-8ea8-c225ea25b9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:06.040770 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef00760-467e-4787-8ea8-c225ea25b9ae admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:06.041045 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef00760-467e-4787-8ea8-c225ea25b9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:06.041313 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef00760-467e-4787-8ea8-c225ea25b9ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:06.041966 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef00760-467e-4787-8ea8-c225ea25b9ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:06.042939 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c963da3-519b-4da3-83a3-1caaf4cd8ff0 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:06.043858 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef00760-467e-4787-8ea8-c225ea25b9ae admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:06.049113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a50169-17a0-4d86-9574-70662d835b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:06.049718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a50169-17a0-4d86-9574-70662d835b88 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:06.050026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a50169-17a0-4d86-9574-70662d835b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:06.050300 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a50169-17a0-4d86-9574-70662d835b88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:06.050948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a50169-17a0-4d86-9574-70662d835b88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:06:06.051255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a50169-17a0-4d86-9574-70662d835b88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:06.052829 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a50169-17a0-4d86-9574-70662d835b88 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:06.065891 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1121/2240] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:06:06.066673 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a50169-17a0-4d86-9574-70662d835b88 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:06.077569 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a50169-17a0-4d86-9574-70662d835b88 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:06.082759 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1120/2241] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:06:05 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:06:06.082759 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef00760-467e-4787-8ea8-c225ea25b9ae admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:06.110640 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:06.117735 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:06.146604 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6408b33-a42b-4ba6-99e9-98336c43ee9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:06.147479 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6408b33-a42b-4ba6-99e9-98336c43ee9a admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:06.147590 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6408b33-a42b-4ba6-99e9-98336c43ee9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:06.147844 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6408b33-a42b-4ba6-99e9-98336c43ee9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:06.148499 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6408b33-a42b-4ba6-99e9-98336c43ee9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:06.150194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6408b33-a42b-4ba6-99e9-98336c43ee9a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:06.159316 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef00760-467e-4787-8ea8-c225ea25b9ae admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:06.161764 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1122/2242] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:06:06.162813 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6408b33-a42b-4ba6-99e9-98336c43ee9a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:06.168268 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e1367-a38d-4ac2-9df4-4dcad74311bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:06.169016 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e1367-a38d-4ac2-9df4-4dcad74311bc admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:06.169387 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e1367-a38d-4ac2-9df4-4dcad74311bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:06.169867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e1367-a38d-4ac2-9df4-4dcad74311bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:06.170657 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e1367-a38d-4ac2-9df4-4dcad74311bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:06.173010 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e1367-a38d-4ac2-9df4-4dcad74311bc admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:06.174384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6408b33-a42b-4ba6-99e9-98336c43ee9a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:06.179534 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2cd89-bea2-4350-a21e-719dc491bb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:06.180249 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2cd89-bea2-4350-a21e-719dc491bb4a admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:06.180607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2cd89-bea2-4350-a21e-719dc491bb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:06.180949 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2cd89-bea2-4350-a21e-719dc491bb4a admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:06.181765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2cd89-bea2-4350-a21e-719dc491bb4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:06.183780 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2cd89-bea2-4350-a21e-719dc491bb4a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:06.204656 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1121/2243] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:06:06 2022] POST /identity/v3/projects => generated 361 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:06:06.205469 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e1367-a38d-4ac2-9df4-4dcad74311bc admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:06.211577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1123/2244] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:06:06 2022] POST /identity/v3/users => generated 293 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:06:06.212456 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2cd89-bea2-4350-a21e-719dc491bb4a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:06.223657 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2cd89-bea2-4350-a21e-719dc491bb4a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:06.285478 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e1367-a38d-4ac2-9df4-4dcad74311bc admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:06.291544 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee8468-d75a-4731-8a33-628394e463ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:06.292560 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee8468-d75a-4731-8a33-628394e463ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:06.293019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee8468-d75a-4731-8a33-628394e463ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:06.293430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee8468-d75a-4731-8a33-628394e463ef admin admin] PATH_INFO: `/v3/projects/4e8e2a0025544c028e49d6c24bc85f3d/users/5c036bf09a3148f0b048e9b1918343e1/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:06.295747 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee8468-d75a-4731-8a33-628394e463ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e8e2a0025544c028e49d6c24bc85f3d, user_id=5c036bf09a3148f0b048e9b1918343e1, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:06.299116 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee8468-d75a-4731-8a33-628394e463ef admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:06.299977 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7288abd-b3d4-43d6-84ce-d5738494f203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:06.300707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7288abd-b3d4-43d6-84ce-d5738494f203 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:06.301042 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7288abd-b3d4-43d6-84ce-d5738494f203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:06.301412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7288abd-b3d4-43d6-84ce-d5738494f203 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:06.302135 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7288abd-b3d4-43d6-84ce-d5738494f203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:06.304260 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7288abd-b3d4-43d6-84ce-d5738494f203 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:06.324027 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1122/2245] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:06:06 2022] PUT /identity/v3/projects/4e8e2a0025544c028e49d6c24bc85f3d/users/5c036bf09a3148f0b048e9b1918343e1/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:06.326678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee8468-d75a-4731-8a33-628394e463ef admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:06.345258 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1124/2246] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:06:06 2022] POST /identity/v3/users => generated 281 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:06:06.347598 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5360b35-4203-4b55-9f10-7d30b923d956 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:06.347880 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5360b35-4203-4b55-9f10-7d30b923d956 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:06.348300 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5360b35-4203-4b55-9f10-7d30b923d956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:06.378656 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-d5360b35-4203-4b55-9f10-7d30b923d956 None None] MFA Rules not processed for user `5c036bf09a3148f0b048e9b1918343e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:06.380064 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d5360b35-4203-4b55-9f10-7d30b923d956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:06.407030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee8468-d75a-4731-8a33-628394e463ef admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:06.411700 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17a4f3-d7db-40af-8125-a0c126422c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:06.412292 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17a4f3-d7db-40af-8125-a0c126422c01 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:06.412569 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17a4f3-d7db-40af-8125-a0c126422c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:06.412835 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17a4f3-d7db-40af-8125-a0c126422c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:06.413469 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17a4f3-d7db-40af-8125-a0c126422c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:06.415154 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17a4f3-d7db-40af-8125-a0c126422c01 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:06.428040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1123/2247] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:06:06.428040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17a4f3-d7db-40af-8125-a0c126422c01 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:06.437018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17a4f3-d7db-40af-8125-a0c126422c01 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:06.441810 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233d476-c202-4049-82bc-54ee3f93b40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:06.442401 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233d476-c202-4049-82bc-54ee3f93b40f admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:06.442679 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233d476-c202-4049-82bc-54ee3f93b40f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:06.442942 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233d476-c202-4049-82bc-54ee3f93b40f admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:06.443570 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233d476-c202-4049-82bc-54ee3f93b40f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:06.445306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233d476-c202-4049-82bc-54ee3f93b40f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:06.456232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1124/2248] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:06:06.459893 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233d476-c202-4049-82bc-54ee3f93b40f admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:06.469919 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233d476-c202-4049-82bc-54ee3f93b40f admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:06.472078 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1125/2249] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:06 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:06.472956 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5360b35-4203-4b55-9f10-7d30b923d956 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:06.474467 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee8200-4a89-4e18-b2be-35eb88377d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:06.475096 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee8200-4a89-4e18-b2be-35eb88377d3d admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:06.475357 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee8200-4a89-4e18-b2be-35eb88377d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:06.475626 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee8200-4a89-4e18-b2be-35eb88377d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:06.476325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee8200-4a89-4e18-b2be-35eb88377d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:06.477856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee8200-4a89-4e18-b2be-35eb88377d3d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:06.485666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5360b35-4203-4b55-9f10-7d30b923d956 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:06.489662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1125/2250] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:06:06.490645 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee8200-4a89-4e18-b2be-35eb88377d3d admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:06.493476 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b2e85-737a-4615-9a01-4226a17e8aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:06.494118 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b2e85-737a-4615-9a01-4226a17e8aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:06.494400 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b2e85-737a-4615-9a01-4226a17e8aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:06.494492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5eee8200-4a89-4e18-b2be-35eb88377d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:06.494671 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b2e85-737a-4615-9a01-4226a17e8aa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:06.495315 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b2e85-737a-4615-9a01-4226a17e8aa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:06.496907 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b2e85-737a-4615-9a01-4226a17e8aa3 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:06.508522 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1126/2251] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:06:06.509172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b2e85-737a-4615-9a01-4226a17e8aa3 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:06.518274 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:06.519186 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b2e85-737a-4615-9a01-4226a17e8aa3 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:06.524220 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7e98d-4503-429e-a651-71c062130969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:06.524879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7e98d-4503-429e-a651-71c062130969 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:06.525235 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7e98d-4503-429e-a651-71c062130969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:06.525793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7e98d-4503-429e-a651-71c062130969 admin admin] PATH_INFO: `/v3/projects/a2f0a75c3f5c47458a7e74fab544b0fa/users/b08213dd62bd44d2b9228b9368d01b35/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:06.536747 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:06.543792 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7e98d-4503-429e-a651-71c062130969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f0a75c3f5c47458a7e74fab544b0fa, user_id=b08213dd62bd44d2b9228b9368d01b35, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:06.547498 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7e98d-4503-429e-a651-71c062130969 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:06.556552 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee8200-4a89-4e18-b2be-35eb88377d3d admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:06.560367 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1127/2252] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:06:06 2022] PUT /identity/v3/projects/a2f0a75c3f5c47458a7e74fab544b0fa/users/b08213dd62bd44d2b9228b9368d01b35/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:06.570882 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7e98d-4503-429e-a651-71c062130969 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:06.620076 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527349e-f054-4ed5-9a47-f3d35adcf6dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:06.620938 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527349e-f054-4ed5-9a47-f3d35adcf6dd service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:06.622152 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527349e-f054-4ed5-9a47-f3d35adcf6dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:06.622434 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527349e-f054-4ed5-9a47-f3d35adcf6dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:06.628506 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7e98d-4503-429e-a651-71c062130969 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:06.635211 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b5c3e-60cc-484c-aa87-2ecc6b9f9c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:06.635545 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b5c3e-60cc-484c-aa87-2ecc6b9f9c1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:06.635818 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b5c3e-60cc-484c-aa87-2ecc6b9f9c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:06.636079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b5c3e-60cc-484c-aa87-2ecc6b9f9c1d admin admin] PATH_INFO: `/v3/projects/f2bdbf9fb78547d8910df7dd3917323f/users/22119eb0787247d38276ef28411657af/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:06.663326 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b5c3e-60cc-484c-aa87-2ecc6b9f9c1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2bdbf9fb78547d8910df7dd3917323f, user_id=22119eb0787247d38276ef28411657af, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:06.666038 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b5c3e-60cc-484c-aa87-2ecc6b9f9c1d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:06.684475 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1128/2253] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:06:06 2022] PUT /identity/v3/projects/f2bdbf9fb78547d8910df7dd3917323f/users/22119eb0787247d38276ef28411657af/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:06.685720 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bdd70-d396-4d53-8430-611b75488878 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:06.686031 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bdd70-d396-4d53-8430-611b75488878 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:06.686299 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bdd70-d396-4d53-8430-611b75488878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:06.710161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527349e-f054-4ed5-9a47-f3d35adcf6dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:06.712191 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527349e-f054-4ed5-9a47-f3d35adcf6dd service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:06.715398 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-376bdd70-d396-4d53-8430-611b75488878 None None] MFA Rules not processed for user `b08213dd62bd44d2b9228b9368d01b35`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:06.716915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-376bdd70-d396-4d53-8430-611b75488878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:06.723539 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1126/2254] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:06:06 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:06:06.724786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a62d18-3193-44db-95e0-487a86902511 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:06.725085 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a62d18-3193-44db-95e0-487a86902511 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:06.725345 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a62d18-3193-44db-95e0-487a86902511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:06.766590 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-a9a62d18-3193-44db-95e0-487a86902511 None None] MFA Rules not processed for user `22119eb0787247d38276ef28411657af`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:06.766590 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a9a62d18-3193-44db-95e0-487a86902511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:06.796902 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1129/2255] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:06.807876 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bdd70-d396-4d53-8430-611b75488878 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:06.849007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1127/2256] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:06.874528 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bdd70-d396-4d53-8430-611b75488878 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:06.879596 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8428e42-8d99-499d-8be2-089b52e214b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:06.880204 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8428e42-8d99-499d-8be2-089b52e214b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:06.880487 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8428e42-8d99-499d-8be2-089b52e214b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:06.880761 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8428e42-8d99-499d-8be2-089b52e214b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:06.889200 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8428e42-8d99-499d-8be2-089b52e214b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:06.891178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8428e42-8d99-499d-8be2-089b52e214b8 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:06.900750 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1130/2257] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:06:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:06:06.934493 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a62d18-3193-44db-95e0-487a86902511 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:06.936091 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a9a62d18-3193-44db-95e0-487a86902511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:06.948133 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a62d18-3193-44db-95e0-487a86902511 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:06.951884 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3cea4-7b9d-46df-b90e-156f34def23f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:06.953097 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3cea4-7b9d-46df-b90e-156f34def23f service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:06.953331 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3cea4-7b9d-46df-b90e-156f34def23f service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:06.953620 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3cea4-7b9d-46df-b90e-156f34def23f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:06.964286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3cea4-7b9d-46df-b90e-156f34def23f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:06.966115 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3cea4-7b9d-46df-b90e-156f34def23f service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:06.977134 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1128/2258] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:06:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:06:06.992203 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8428e42-8d99-499d-8be2-089b52e214b8 service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:07.002041 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:07.125976 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8428e42-8d99-499d-8be2-089b52e214b8 service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:07.140868 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95e49e-289d-4fd5-8349-33225cc8deb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:07.141547 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95e49e-289d-4fd5-8349-33225cc8deb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:07.141875 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95e49e-289d-4fd5-8349-33225cc8deb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:07.142221 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95e49e-289d-4fd5-8349-33225cc8deb1 admin admin] PATH_INFO: `/v3/users/22119eb0787247d38276ef28411657af` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:07.144946 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95e49e-289d-4fd5-8349-33225cc8deb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22119eb0787247d38276ef28411657af)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:07.146896 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95e49e-289d-4fd5-8349-33225cc8deb1 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:07.226598 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-cd95e49e-289d-4fd5-8349-33225cc8deb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22119eb0787247d38276ef28411657af'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:07.244151 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-cd95e49e-289d-4fd5-8349-33225cc8deb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22119eb0787247d38276ef28411657af'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:07.270814 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-cd95e49e-289d-4fd5-8349-33225cc8deb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22119eb0787247d38276ef28411657af'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:07.271724 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-cd95e49e-289d-4fd5-8349-33225cc8deb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22119eb0787247d38276ef28411657af'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:07.272432 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-cd95e49e-289d-4fd5-8349-33225cc8deb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22119eb0787247d38276ef28411657af'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:07.295162 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1131/2259] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:06:06 2022] DELETE /identity/v3/users/22119eb0787247d38276ef28411657af => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:07.298167 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f29ccc-789c-4fad-adb7-a310054405a5 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:07.298167 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f29ccc-789c-4fad-adb7-a310054405a5 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:07.298167 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f29ccc-789c-4fad-adb7-a310054405a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:07.305267 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:07.321217 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-c5f29ccc-789c-4fad-adb7-a310054405a5 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:07.322703 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c5f29ccc-789c-4fad-adb7-a310054405a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:07.387511 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1129/2260] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:06:07.398138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95e49e-289d-4fd5-8349-33225cc8deb1 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:07.399549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-cd95e49e-289d-4fd5-8349-33225cc8deb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:07.461739 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95e49e-289d-4fd5-8349-33225cc8deb1 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:07.463579 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f29ccc-789c-4fad-adb7-a310054405a5 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:07.464959 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c5f29ccc-789c-4fad-adb7-a310054405a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:07.466107 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4829108-b8b6-45c2-b7de-3e0cda104935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:07.466770 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4829108-b8b6-45c2-b7de-3e0cda104935 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:07.467102 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4829108-b8b6-45c2-b7de-3e0cda104935 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:07.467563 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4829108-b8b6-45c2-b7de-3e0cda104935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:07.478722 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4829108-b8b6-45c2-b7de-3e0cda104935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:07.480169 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4829108-b8b6-45c2-b7de-3e0cda104935 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:07.480278 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f29ccc-789c-4fad-adb7-a310054405a5 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:07.485897 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db06a2-f86e-4565-a190-5ed3fcc4fb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:07.486533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db06a2-f86e-4565-a190-5ed3fcc4fb96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:07.487098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db06a2-f86e-4565-a190-5ed3fcc4fb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:07.487386 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db06a2-f86e-4565-a190-5ed3fcc4fb96 admin admin] PATH_INFO: `/v3/users/b366bd92a62d4353be8b9d0121aebf31` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:07.488540 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db06a2-f86e-4565-a190-5ed3fcc4fb96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b366bd92a62d4353be8b9d0121aebf31)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:07.490296 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1132/2261] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:06:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:06:07.490511 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db06a2-f86e-4565-a190-5ed3fcc4fb96 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:07.547992 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-f3db06a2-f86e-4565-a190-5ed3fcc4fb96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b366bd92a62d4353be8b9d0121aebf31'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:07.548683 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-f3db06a2-f86e-4565-a190-5ed3fcc4fb96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b366bd92a62d4353be8b9d0121aebf31'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:07.557054 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-f3db06a2-f86e-4565-a190-5ed3fcc4fb96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b366bd92a62d4353be8b9d0121aebf31'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:07.574933 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-f3db06a2-f86e-4565-a190-5ed3fcc4fb96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b366bd92a62d4353be8b9d0121aebf31'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:07.575719 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-f3db06a2-f86e-4565-a190-5ed3fcc4fb96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b366bd92a62d4353be8b9d0121aebf31'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:07.591061 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1130/2262] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:06:07 2022] DELETE /identity/v3/users/b366bd92a62d4353be8b9d0121aebf31 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:06:07.595551 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b52651-aebf-47f5-a378-c12431561799 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:07.595962 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b52651-aebf-47f5-a378-c12431561799 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:07.596335 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b52651-aebf-47f5-a378-c12431561799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:07.619410 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-d2b52651-aebf-47f5-a378-c12431561799 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:07.620732 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d2b52651-aebf-47f5-a378-c12431561799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:07.647331 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:07.695527 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1133/2263] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:07.705613 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db06a2-f86e-4565-a190-5ed3fcc4fb96 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:07.707235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f3db06a2-f86e-4565-a190-5ed3fcc4fb96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:07.766479 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db06a2-f86e-4565-a190-5ed3fcc4fb96 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:07.770493 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e667acc-02dd-44ea-a89f-8cddbdee4ee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:07.771270 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e667acc-02dd-44ea-a89f-8cddbdee4ee3 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:07.771512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e667acc-02dd-44ea-a89f-8cddbdee4ee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:07.771785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e667acc-02dd-44ea-a89f-8cddbdee4ee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:07.782316 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e667acc-02dd-44ea-a89f-8cddbdee4ee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:07.783744 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e667acc-02dd-44ea-a89f-8cddbdee4ee3 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:07.793544 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1131/2264] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:06:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:06:07.800160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b52651-aebf-47f5-a378-c12431561799 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:07.801850 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d2b52651-aebf-47f5-a378-c12431561799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:07.814729 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b52651-aebf-47f5-a378-c12431561799 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:07.819704 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f0aad-b84d-422d-bfad-4ce68e37fbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:07.820434 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f0aad-b84d-422d-bfad-4ce68e37fbc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:07.820806 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f0aad-b84d-422d-bfad-4ce68e37fbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:07.821359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f0aad-b84d-422d-bfad-4ce68e37fbc3 admin admin] PATH_INFO: `/v3/projects/f2bdbf9fb78547d8910df7dd3917323f` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:07.822911 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f0aad-b84d-422d-bfad-4ce68e37fbc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2bdbf9fb78547d8910df7dd3917323f)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:07.825920 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f0aad-b84d-422d-bfad-4ce68e37fbc3 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:07.876784 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7a1f0aad-b84d-422d-bfad-4ce68e37fbc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2bdbf9fb78547d8910df7dd3917323f', 'request_id': 'req-7a1f0aad-b84d-422d-bfad-4ce68e37fbc3'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:07.885674 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7a1f0aad-b84d-422d-bfad-4ce68e37fbc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2bdbf9fb78547d8910df7dd3917323f', 'request_id': 'req-7a1f0aad-b84d-422d-bfad-4ce68e37fbc3'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:07.892405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7a1f0aad-b84d-422d-bfad-4ce68e37fbc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2bdbf9fb78547d8910df7dd3917323f', 'request_id': 'req-7a1f0aad-b84d-422d-bfad-4ce68e37fbc3'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:07.903374 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7a1f0aad-b84d-422d-bfad-4ce68e37fbc3 admin admin] The token cache is being invalidate because project f2bdbf9fb78547d8910df7dd3917323f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:06:07.903501 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7a1f0aad-b84d-422d-bfad-4ce68e37fbc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:07.904156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7a1f0aad-b84d-422d-bfad-4ce68e37fbc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:07.905981 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1134/2265] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:06:07 2022] DELETE /identity/v3/projects/f2bdbf9fb78547d8910df7dd3917323f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:07.910698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bad51-ee35-4206-97fa-4eb3c29e9cf6 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:07.911052 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bad51-ee35-4206-97fa-4eb3c29e9cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:07.911413 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bad51-ee35-4206-97fa-4eb3c29e9cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:07.931239 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-894bad51-ee35-4206-97fa-4eb3c29e9cf6 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:07.932518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-894bad51-ee35-4206-97fa-4eb3c29e9cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:07.945352 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:08.003760 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1132/2266] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:08.011307 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6776a-ecbb-43e4-bd87-a20d4802650a None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:08.011589 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6776a-ecbb-43e4-bd87-a20d4802650a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:08.011858 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6776a-ecbb-43e4-bd87-a20d4802650a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:08.031968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-a5c6776a-ecbb-43e4-bd87-a20d4802650a None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:08.033170 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a5c6776a-ecbb-43e4-bd87-a20d4802650a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:08.040916 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1135/2267] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:08.045430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bad51-ee35-4206-97fa-4eb3c29e9cf6 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:08.056070 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bad51-ee35-4206-97fa-4eb3c29e9cf6 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:08.061064 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915236d1-6b20-4796-bb22-c0a468c506b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:08.061689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915236d1-6b20-4796-bb22-c0a468c506b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:08.061989 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915236d1-6b20-4796-bb22-c0a468c506b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:08.062258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915236d1-6b20-4796-bb22-c0a468c506b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:08.062902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915236d1-6b20-4796-bb22-c0a468c506b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:06:08.063239 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915236d1-6b20-4796-bb22-c0a468c506b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:08.064799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915236d1-6b20-4796-bb22-c0a468c506b7 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:08.078406 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1133/2268] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:06:08.082749 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6776a-ecbb-43e4-bd87-a20d4802650a None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:08.088134 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915236d1-6b20-4796-bb22-c0a468c506b7 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:08.091506 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-915236d1-6b20-4796-bb22-c0a468c506b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:08.097145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6776a-ecbb-43e4-bd87-a20d4802650a None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:08.102684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c5972-f690-4da9-9bea-ad8df1ccf951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:08.103394 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c5972-f690-4da9-9bea-ad8df1ccf951 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:08.103875 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c5972-f690-4da9-9bea-ad8df1ccf951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:08.104216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c5972-f690-4da9-9bea-ad8df1ccf951 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:08.105468 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c5972-f690-4da9-9bea-ad8df1ccf951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:08.106980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c5972-f690-4da9-9bea-ad8df1ccf951 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:08.110186 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915236d1-6b20-4796-bb22-c0a468c506b7 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:08.117001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573bd57-986f-4bfe-81cc-35d0980636b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:08.117657 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573bd57-986f-4bfe-81cc-35d0980636b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:08.117988 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573bd57-986f-4bfe-81cc-35d0980636b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:08.118952 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573bd57-986f-4bfe-81cc-35d0980636b0 admin admin] PATH_INFO: `/v3/projects/68e0337b30434aa3bac753cbb2ee685c` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:08.122846 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573bd57-986f-4bfe-81cc-35d0980636b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68e0337b30434aa3bac753cbb2ee685c)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:08.125927 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573bd57-986f-4bfe-81cc-35d0980636b0 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:08.145846 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1136/2269] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:06:08 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:06:08.147992 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c5972-f690-4da9-9bea-ad8df1ccf951 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:08.199259 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d573bd57-986f-4bfe-81cc-35d0980636b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68e0337b30434aa3bac753cbb2ee685c', 'request_id': 'req-d573bd57-986f-4bfe-81cc-35d0980636b0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:08.210527 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d573bd57-986f-4bfe-81cc-35d0980636b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68e0337b30434aa3bac753cbb2ee685c', 'request_id': 'req-d573bd57-986f-4bfe-81cc-35d0980636b0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:08.222257 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d573bd57-986f-4bfe-81cc-35d0980636b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68e0337b30434aa3bac753cbb2ee685c', 'request_id': 'req-d573bd57-986f-4bfe-81cc-35d0980636b0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:08.241373 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c5972-f690-4da9-9bea-ad8df1ccf951 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:08.243037 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d573bd57-986f-4bfe-81cc-35d0980636b0 admin admin] The token cache is being invalidate because project 68e0337b30434aa3bac753cbb2ee685c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:06:08.243446 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d573bd57-986f-4bfe-81cc-35d0980636b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:08.244394 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d573bd57-986f-4bfe-81cc-35d0980636b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:08.249591 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1134/2270] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:06:08 2022] DELETE /identity/v3/projects/68e0337b30434aa3bac753cbb2ee685c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:06:08.250832 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573bd57-986f-4bfe-81cc-35d0980636b0 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:08.253301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d573bd57-986f-4bfe-81cc-35d0980636b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:08.272233 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:08.351949 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6afe33-41a3-458c-9943-b77e3de5c097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:08.353309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6afe33-41a3-458c-9943-b77e3de5c097 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:08.353867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6afe33-41a3-458c-9943-b77e3de5c097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:08.354239 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6afe33-41a3-458c-9943-b77e3de5c097 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:08.355216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6afe33-41a3-458c-9943-b77e3de5c097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:08.357854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6afe33-41a3-458c-9943-b77e3de5c097 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:08.362005 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573bd57-986f-4bfe-81cc-35d0980636b0 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:08.367524 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a888e-f68d-4638-9934-52a0ddb840b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:08.368159 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a888e-f68d-4638-9934-52a0ddb840b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:08.368471 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a888e-f68d-4638-9934-52a0ddb840b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:08.369003 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a888e-f68d-4638-9934-52a0ddb840b7 admin admin] PATH_INFO: `/v3/users/5c036bf09a3148f0b048e9b1918343e1` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:08.370127 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a888e-f68d-4638-9934-52a0ddb840b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c036bf09a3148f0b048e9b1918343e1)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:08.372711 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a888e-f68d-4638-9934-52a0ddb840b7 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:08.406712 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1137/2271] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:06:08 2022] POST /identity/v3/users => generated 289 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:06:08.407876 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6afe33-41a3-458c-9943-b77e3de5c097 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:08.410008 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3d6afe33-41a3-458c-9943-b77e3de5c097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:08.429727 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:08.445843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6afe33-41a3-458c-9943-b77e3de5c097 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:08.450941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5e1f4-40ee-45bc-8f55-15ab042653ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:08.451721 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5e1f4-40ee-45bc-8f55-15ab042653ec admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:08.452000 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5e1f4-40ee-45bc-8f55-15ab042653ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:08.452807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5e1f4-40ee-45bc-8f55-15ab042653ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:08.454658 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b67a888e-f68d-4638-9934-52a0ddb840b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c036bf09a3148f0b048e9b1918343e1'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:08.454887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5e1f4-40ee-45bc-8f55-15ab042653ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:08.456545 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5e1f4-40ee-45bc-8f55-15ab042653ec admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:08.462384 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b67a888e-f68d-4638-9934-52a0ddb840b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c036bf09a3148f0b048e9b1918343e1'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:08.471449 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1138/2272] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:06:08.471792 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b67a888e-f68d-4638-9934-52a0ddb840b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c036bf09a3148f0b048e9b1918343e1'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:08.472953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5e1f4-40ee-45bc-8f55-15ab042653ec admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:08.475663 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-34b5e1f4-40ee-45bc-8f55-15ab042653ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:08.486343 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b67a888e-f68d-4638-9934-52a0ddb840b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c036bf09a3148f0b048e9b1918343e1'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:08.487432 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b67a888e-f68d-4638-9934-52a0ddb840b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c036bf09a3148f0b048e9b1918343e1'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:08.492789 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5e1f4-40ee-45bc-8f55-15ab042653ec admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:08.502421 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2310a-e9d3-4861-95ac-e5b39f759a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:08.503045 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2310a-e9d3-4861-95ac-e5b39f759a56 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:08.503329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2310a-e9d3-4861-95ac-e5b39f759a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:08.503605 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2310a-e9d3-4861-95ac-e5b39f759a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:08.504251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2310a-e9d3-4861-95ac-e5b39f759a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:08.507380 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2310a-e9d3-4861-95ac-e5b39f759a56 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:08.519266 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1135/2273] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:06:08 2022] DELETE /identity/v3/users/5c036bf09a3148f0b048e9b1918343e1 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:06:08.523642 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1139/2274] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:06:08.528229 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a888e-f68d-4638-9934-52a0ddb840b7 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:08.623343 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a888e-f68d-4638-9934-52a0ddb840b7 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:08.629656 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28dd445-967c-44af-8d00-1d2aa4dcf715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:08.630453 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28dd445-967c-44af-8d00-1d2aa4dcf715 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:08.630620 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28dd445-967c-44af-8d00-1d2aa4dcf715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:08.630890 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28dd445-967c-44af-8d00-1d2aa4dcf715 admin admin] PATH_INFO: `/v3/projects/b1e874898e634ac9add6518846c8ae2b/users/484fb69a2d534838a6df2fe1c3750df8/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:08.651064 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28dd445-967c-44af-8d00-1d2aa4dcf715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1e874898e634ac9add6518846c8ae2b, user_id=484fb69a2d534838a6df2fe1c3750df8, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:08.654957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28dd445-967c-44af-8d00-1d2aa4dcf715 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:08.680700 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1136/2275] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:06:08 2022] PUT /identity/v3/projects/b1e874898e634ac9add6518846c8ae2b/users/484fb69a2d534838a6df2fe1c3750df8/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:06:08.691393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98228a41-59e0-4a80-979f-59ca748fbb85 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:08.691810 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98228a41-59e0-4a80-979f-59ca748fbb85 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:08.692192 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98228a41-59e0-4a80-979f-59ca748fbb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:08.730340 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-98228a41-59e0-4a80-979f-59ca748fbb85 None None] MFA Rules not processed for user `484fb69a2d534838a6df2fe1c3750df8`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:08.731580 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-98228a41-59e0-4a80-979f-59ca748fbb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:08.821352 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1140/2276] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:08.826428 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28dd445-967c-44af-8d00-1d2aa4dcf715 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:08.911842 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28dd445-967c-44af-8d00-1d2aa4dcf715 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:08.914015 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98228a41-59e0-4a80-979f-59ca748fbb85 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:08.915430 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-98228a41-59e0-4a80-979f-59ca748fbb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:08.917198 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa9132-0223-485a-b66b-aa8c8afd91cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:08.918088 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa9132-0223-485a-b66b-aa8c8afd91cb admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:08.918364 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa9132-0223-485a-b66b-aa8c8afd91cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:08.918738 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa9132-0223-485a-b66b-aa8c8afd91cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:08.919243 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa9132-0223-485a-b66b-aa8c8afd91cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:08.921986 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa9132-0223-485a-b66b-aa8c8afd91cb admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:08.931294 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98228a41-59e0-4a80-979f-59ca748fbb85 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:08.936010 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bde876-167a-4e4e-a365-f3a91afad763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:08.937322 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bde876-167a-4e4e-a365-f3a91afad763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:08.937605 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bde876-167a-4e4e-a365-f3a91afad763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:08.938043 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bde876-167a-4e4e-a365-f3a91afad763 admin admin] PATH_INFO: `/v3/projects/4e8e2a0025544c028e49d6c24bc85f3d` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:08.939207 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bde876-167a-4e4e-a365-f3a91afad763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e8e2a0025544c028e49d6c24bc85f3d)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:08.941518 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bde876-167a-4e4e-a365-f3a91afad763 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:08.958246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1137/2277] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:06:08 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:06:08.959254 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa9132-0223-485a-b66b-aa8c8afd91cb admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:08.978478 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:08.994676 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-62bde876-167a-4e4e-a365-f3a91afad763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e8e2a0025544c028e49d6c24bc85f3d', 'request_id': 'req-62bde876-167a-4e4e-a365-f3a91afad763'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:09.005621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-62bde876-167a-4e4e-a365-f3a91afad763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e8e2a0025544c028e49d6c24bc85f3d', 'request_id': 'req-62bde876-167a-4e4e-a365-f3a91afad763'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:09.013426 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-62bde876-167a-4e4e-a365-f3a91afad763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e8e2a0025544c028e49d6c24bc85f3d', 'request_id': 'req-62bde876-167a-4e4e-a365-f3a91afad763'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:09.024678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-62bde876-167a-4e4e-a365-f3a91afad763 admin admin] The token cache is being invalidate because project 4e8e2a0025544c028e49d6c24bc85f3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:06:09.024971 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-62bde876-167a-4e4e-a365-f3a91afad763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:09.025922 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-62bde876-167a-4e4e-a365-f3a91afad763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:09.028240 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1141/2278] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:06:08 2022] DELETE /identity/v3/projects/4e8e2a0025544c028e49d6c24bc85f3d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:06:09.034413 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf238e-ae06-447b-9749-e9f806e17ed6 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:09.034691 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf238e-ae06-447b-9749-e9f806e17ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:09.034982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf238e-ae06-447b-9749-e9f806e17ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:09.049924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:09.054985 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa9132-0223-485a-b66b-aa8c8afd91cb admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:09.055719 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-a5bf238e-ae06-447b-9749-e9f806e17ed6 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:09.057618 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a5bf238e-ae06-447b-9749-e9f806e17ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:09.126389 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1142/2279] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:06:09.134277 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc32dc-2b77-4ff4-98f0-8360b65a6cba None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:09.134561 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc32dc-2b77-4ff4-98f0-8360b65a6cba None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:09.134830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc32dc-2b77-4ff4-98f0-8360b65a6cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:09.136808 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef259cb-17bd-4e4c-93b9-694eb183eae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:09.137419 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef259cb-17bd-4e4c-93b9-694eb183eae9 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:09.137696 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef259cb-17bd-4e4c-93b9-694eb183eae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:09.137994 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef259cb-17bd-4e4c-93b9-694eb183eae9 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:09.138621 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef259cb-17bd-4e4c-93b9-694eb183eae9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:09.141045 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef259cb-17bd-4e4c-93b9-694eb183eae9 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:09.158531 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-21bc32dc-2b77-4ff4-98f0-8360b65a6cba None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:09.159984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-21bc32dc-2b77-4ff4-98f0-8360b65a6cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:09.166175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1138/2280] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:06:08 2022] POST /identity/v3/users => generated 288 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:06:09.167152 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef259cb-17bd-4e4c-93b9-694eb183eae9 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:09.168782 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fef259cb-17bd-4e4c-93b9-694eb183eae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:09.170587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1143/2281] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:06:09.174743 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc32dc-2b77-4ff4-98f0-8360b65a6cba None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:09.180519 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef259cb-17bd-4e4c-93b9-694eb183eae9 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:09.184570 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc32dc-2b77-4ff4-98f0-8360b65a6cba None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:09.185141 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97c753-609e-4963-942a-56daecc2adc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:09.185726 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97c753-609e-4963-942a-56daecc2adc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:09.186034 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97c753-609e-4963-942a-56daecc2adc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:09.186310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97c753-609e-4963-942a-56daecc2adc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:09.187037 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97c753-609e-4963-942a-56daecc2adc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:09.188567 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97c753-609e-4963-942a-56daecc2adc4 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:09.189417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ff0f4-4012-4d20-ba4a-b5b9278d2dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:09.190055 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ff0f4-4012-4d20-ba4a-b5b9278d2dad admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:09.190331 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ff0f4-4012-4d20-ba4a-b5b9278d2dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:09.190597 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ff0f4-4012-4d20-ba4a-b5b9278d2dad admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:09.191244 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ff0f4-4012-4d20-ba4a-b5b9278d2dad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:06:09.191541 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ff0f4-4012-4d20-ba4a-b5b9278d2dad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:09.193092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ff0f4-4012-4d20-ba4a-b5b9278d2dad admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:09.201287 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1139/2282] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:06:09.203248 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97c753-609e-4963-942a-56daecc2adc4 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:09.208784 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1144/2283] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:06:09.209652 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ff0f4-4012-4d20-ba4a-b5b9278d2dad admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:09.213296 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97c753-609e-4963-942a-56daecc2adc4 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:09.218906 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47daaa85-1840-4bb9-b981-78c050b6e4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:09.219520 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47daaa85-1840-4bb9-b981-78c050b6e4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:09.219683 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ff0f4-4012-4d20-ba4a-b5b9278d2dad admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:09.219790 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47daaa85-1840-4bb9-b981-78c050b6e4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:09.220081 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47daaa85-1840-4bb9-b981-78c050b6e4a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:09.220708 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47daaa85-1840-4bb9-b981-78c050b6e4a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:09.222397 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47daaa85-1840-4bb9-b981-78c050b6e4a8 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:09.224219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f595e1d-a364-4355-84b3-497d29d5bbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:09.224786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f595e1d-a364-4355-84b3-497d29d5bbcb admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:09.225066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f595e1d-a364-4355-84b3-497d29d5bbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:09.225336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f595e1d-a364-4355-84b3-497d29d5bbcb admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:09.225980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f595e1d-a364-4355-84b3-497d29d5bbcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:09.227949 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f595e1d-a364-4355-84b3-497d29d5bbcb admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:09.236836 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1140/2284] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:06:09.237887 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47daaa85-1840-4bb9-b981-78c050b6e4a8 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:09.249307 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47daaa85-1840-4bb9-b981-78c050b6e4a8 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:09.254010 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6a9b8-a5e0-4342-9b7a-876a349f5af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:09.254650 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6a9b8-a5e0-4342-9b7a-876a349f5af4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:09.254928 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6a9b8-a5e0-4342-9b7a-876a349f5af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:09.255199 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6a9b8-a5e0-4342-9b7a-876a349f5af4 admin admin] PATH_INFO: `/v3/projects/def10596b80f4958ba5f6e564c4aff63/users/ed20351ef1a04edc8f8211bca171f50e/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:09.258919 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1145/2285] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:06:09 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:06:09.259583 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f595e1d-a364-4355-84b3-497d29d5bbcb admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:09.272484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6a9b8-a5e0-4342-9b7a-876a349f5af4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=def10596b80f4958ba5f6e564c4aff63, user_id=ed20351ef1a04edc8f8211bca171f50e, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:09.275233 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6a9b8-a5e0-4342-9b7a-876a349f5af4 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:09.288838 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1141/2286] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:06:09 2022] PUT /identity/v3/projects/def10596b80f4958ba5f6e564c4aff63/users/ed20351ef1a04edc8f8211bca171f50e/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:09.300746 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98607b-4fdb-4f70-be0c-823674ee175f None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:09.301026 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98607b-4fdb-4f70-be0c-823674ee175f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:09.301294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98607b-4fdb-4f70-be0c-823674ee175f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:09.322715 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f595e1d-a364-4355-84b3-497d29d5bbcb admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:09.328545 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-3e98607b-4fdb-4f70-be0c-823674ee175f None None] MFA Rules not processed for user `ed20351ef1a04edc8f8211bca171f50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:09.329766 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3e98607b-4fdb-4f70-be0c-823674ee175f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:09.379704 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7c836-c98d-400b-9997-fbd36e6e4e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:09.380304 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7c836-c98d-400b-9997-fbd36e6e4e7f admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:09.380579 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7c836-c98d-400b-9997-fbd36e6e4e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:09.380848 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7c836-c98d-400b-9997-fbd36e6e4e7f admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:09.381467 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7c836-c98d-400b-9997-fbd36e6e4e7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:09.383374 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7c836-c98d-400b-9997-fbd36e6e4e7f admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:09.387347 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:09.399694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1142/2287] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:06:09.404627 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98607b-4fdb-4f70-be0c-823674ee175f None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:09.412553 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1146/2288] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:06:09 2022] POST /identity/v3/users => generated 287 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:06:09.415102 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7c836-c98d-400b-9997-fbd36e6e4e7f admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:09.420030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98607b-4fdb-4f70-be0c-823674ee175f None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:09.423322 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:09.427224 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2516ac-d5f2-4bc6-a507-1ca94028e216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:09.427908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2516ac-d5f2-4bc6-a507-1ca94028e216 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:09.428248 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2516ac-d5f2-4bc6-a507-1ca94028e216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:09.428424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7c836-c98d-400b-9997-fbd36e6e4e7f admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:09.430812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2516ac-d5f2-4bc6-a507-1ca94028e216 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:09.430812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2516ac-d5f2-4bc6-a507-1ca94028e216 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:09.432997 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2516ac-d5f2-4bc6-a507-1ca94028e216 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:09.439106 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da8b17-c3df-4dce-9d10-1d6eb9875061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:09.439849 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da8b17-c3df-4dce-9d10-1d6eb9875061 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:09.440448 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da8b17-c3df-4dce-9d10-1d6eb9875061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:09.441034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da8b17-c3df-4dce-9d10-1d6eb9875061 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:09.442480 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da8b17-c3df-4dce-9d10-1d6eb9875061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:09.445062 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da8b17-c3df-4dce-9d10-1d6eb9875061 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:09.457364 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1147/2289] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 01:06:09.461481 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da8b17-c3df-4dce-9d10-1d6eb9875061 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:09.472588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1143/2290] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:06:09 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:06:09.474681 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2516ac-d5f2-4bc6-a507-1ca94028e216 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:09.475882 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da8b17-c3df-4dce-9d10-1d6eb9875061 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:09.539445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d75af3-1a4e-49e5-8784-33ea8273dd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:09.540400 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d75af3-1a4e-49e5-8784-33ea8273dd94 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:09.540681 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d75af3-1a4e-49e5-8784-33ea8273dd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:09.540955 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d75af3-1a4e-49e5-8784-33ea8273dd94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:09.541595 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d75af3-1a4e-49e5-8784-33ea8273dd94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:09.543228 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d75af3-1a4e-49e5-8784-33ea8273dd94 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:09.550498 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2516ac-d5f2-4bc6-a507-1ca94028e216 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:09.554729 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1148/2291] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 01:06:09.555769 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49df401-ed6c-4634-b187-6e88b0247d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:09.556442 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49df401-ed6c-4634-b187-6e88b0247d28 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:09.556822 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49df401-ed6c-4634-b187-6e88b0247d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:09.557161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49df401-ed6c-4634-b187-6e88b0247d28 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:09.557899 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49df401-ed6c-4634-b187-6e88b0247d28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:09.558632 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d75af3-1a4e-49e5-8784-33ea8273dd94 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:09.559988 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49df401-ed6c-4634-b187-6e88b0247d28 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:09.569166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d75af3-1a4e-49e5-8784-33ea8273dd94 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:09.583909 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9b612-0a84-44aa-b985-da9b560d2c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:09.583909 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9b612-0a84-44aa-b985-da9b560d2c67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:09.583909 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9b612-0a84-44aa-b985-da9b560d2c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:09.583909 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9b612-0a84-44aa-b985-da9b560d2c67 admin admin] PATH_INFO: `/v3/projects/117105d5e9fb4309aad25e39e0f5e4df/users/873f4c5451bf4734bad957df7ecfee23/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:09.597833 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1144/2292] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:06:09 2022] POST /identity/v3/users => generated 295 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:06:09.598025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9b612-0a84-44aa-b985-da9b560d2c67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=117105d5e9fb4309aad25e39e0f5e4df, user_id=873f4c5451bf4734bad957df7ecfee23, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:09.599656 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9b612-0a84-44aa-b985-da9b560d2c67 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:09.600374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49df401-ed6c-4634-b187-6e88b0247d28 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:09.612840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49df401-ed6c-4634-b187-6e88b0247d28 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:09.613767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1149/2293] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:06:09 2022] PUT /identity/v3/projects/117105d5e9fb4309aad25e39e0f5e4df/users/873f4c5451bf4734bad957df7ecfee23/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:09.619016 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e0f96-b925-41c7-86ca-9ab21f6a1ac2 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:09.619374 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e0f96-b925-41c7-86ca-9ab21f6a1ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:09.619771 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e0f96-b925-41c7-86ca-9ab21f6a1ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:09.638840 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-a64e0f96-b925-41c7-86ca-9ab21f6a1ac2 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:09.640091 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a64e0f96-b925-41c7-86ca-9ab21f6a1ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:09.676968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bebdc5-ea09-47ab-8967-07e43b4537c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:09.677929 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bebdc5-ea09-47ab-8967-07e43b4537c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:09.678216 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bebdc5-ea09-47ab-8967-07e43b4537c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:09.678489 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bebdc5-ea09-47ab-8967-07e43b4537c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:09.679184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bebdc5-ea09-47ab-8967-07e43b4537c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:09.680735 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bebdc5-ea09-47ab-8967-07e43b4537c7 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:09.692584 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1145/2294] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:06:09.696527 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bebdc5-ea09-47ab-8967-07e43b4537c7 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:09.705309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1150/2295] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:09.706701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bebdc5-ea09-47ab-8967-07e43b4537c7 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:09.706894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e0f96-b925-41c7-86ca-9ab21f6a1ac2 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:09.708438 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a64e0f96-b925-41c7-86ca-9ab21f6a1ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:09.711712 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04768fb9-ac9b-4d1b-ac10-d3fdba4b8b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:09.712357 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04768fb9-ac9b-4d1b-ac10-d3fdba4b8b2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:09.712639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04768fb9-ac9b-4d1b-ac10-d3fdba4b8b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:09.712910 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04768fb9-ac9b-4d1b-ac10-d3fdba4b8b2e admin admin] PATH_INFO: `/v3/projects/f18c59aa7c4445c09f2e20818c8b976a/users/587b68728efa470b864c36302134abba/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:09.722092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e0f96-b925-41c7-86ca-9ab21f6a1ac2 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:09.726954 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822799a9-9c96-44ae-a8cc-6b2b0b54dd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:09.727575 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822799a9-9c96-44ae-a8cc-6b2b0b54dd16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:09.727852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822799a9-9c96-44ae-a8cc-6b2b0b54dd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:09.728120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822799a9-9c96-44ae-a8cc-6b2b0b54dd16 admin admin] PATH_INFO: `/v3/users/b08213dd62bd44d2b9228b9368d01b35` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:09.728382 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04768fb9-ac9b-4d1b-ac10-d3fdba4b8b2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f18c59aa7c4445c09f2e20818c8b976a, user_id=587b68728efa470b864c36302134abba, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:09.729237 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822799a9-9c96-44ae-a8cc-6b2b0b54dd16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b08213dd62bd44d2b9228b9368d01b35)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:09.731091 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04768fb9-ac9b-4d1b-ac10-d3fdba4b8b2e admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:09.731209 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822799a9-9c96-44ae-a8cc-6b2b0b54dd16 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:09.747665 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1146/2296] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:06:09 2022] PUT /identity/v3/projects/f18c59aa7c4445c09f2e20818c8b976a/users/587b68728efa470b864c36302134abba/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:06:09.748781 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04768fb9-ac9b-4d1b-ac10-d3fdba4b8b2e admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:09.751445 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-04768fb9-ac9b-4d1b-ac10-d3fdba4b8b2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:09.785119 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-822799a9-9c96-44ae-a8cc-6b2b0b54dd16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b08213dd62bd44d2b9228b9368d01b35'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:09.791968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-822799a9-9c96-44ae-a8cc-6b2b0b54dd16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b08213dd62bd44d2b9228b9368d01b35'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:09.793778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:09.800447 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:09.806435 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-822799a9-9c96-44ae-a8cc-6b2b0b54dd16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b08213dd62bd44d2b9228b9368d01b35'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:09.807313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-822799a9-9c96-44ae-a8cc-6b2b0b54dd16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b08213dd62bd44d2b9228b9368d01b35'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:09.807985 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-822799a9-9c96-44ae-a8cc-6b2b0b54dd16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b08213dd62bd44d2b9228b9368d01b35'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:09.819683 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04768fb9-ac9b-4d1b-ac10-d3fdba4b8b2e admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:09.820853 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1151/2297] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:06:09 2022] DELETE /identity/v3/users/b08213dd62bd44d2b9228b9368d01b35 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:09.824480 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822799a9-9c96-44ae-a8cc-6b2b0b54dd16 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:09.825921 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-822799a9-9c96-44ae-a8cc-6b2b0b54dd16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:09.872872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267197d9-4c3f-41a0-9642-495cecebe521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:09.873733 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267197d9-4c3f-41a0-9642-495cecebe521 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:09.874103 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267197d9-4c3f-41a0-9642-495cecebe521 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:09.874363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267197d9-4c3f-41a0-9642-495cecebe521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:09.876814 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-267197d9-4c3f-41a0-9642-495cecebe521 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:09.891522 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822799a9-9c96-44ae-a8cc-6b2b0b54dd16 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:09.896322 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496627a-bc5e-42d2-a011-4a2478c61322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:09.896916 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496627a-bc5e-42d2-a011-4a2478c61322 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:09.897191 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496627a-bc5e-42d2-a011-4a2478c61322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:09.897458 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496627a-bc5e-42d2-a011-4a2478c61322 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:09.898135 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496627a-bc5e-42d2-a011-4a2478c61322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:09.899735 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496627a-bc5e-42d2-a011-4a2478c61322 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:09.917438 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1152/2298] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:06:09.917438 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759549c-5ac3-4943-aee1-9c92ad78b15d None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:09.917438 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759549c-5ac3-4943-aee1-9c92ad78b15d None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:09.917438 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759549c-5ac3-4943-aee1-9c92ad78b15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:09.937276 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e759549c-5ac3-4943-aee1-9c92ad78b15d None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:09.938560 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e759549c-5ac3-4943-aee1-9c92ad78b15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:09.947980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1153/2299] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:09.949033 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759549c-5ac3-4943-aee1-9c92ad78b15d None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:09.949574 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267197d9-4c3f-41a0-9642-495cecebe521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:09.951259 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267197d9-4c3f-41a0-9642-495cecebe521 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:09.962300 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759549c-5ac3-4943-aee1-9c92ad78b15d None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:09.963328 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1147/2300] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:06:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:06:09.964043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267197d9-4c3f-41a0-9642-495cecebe521 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:09.965393 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-267197d9-4c3f-41a0-9642-495cecebe521 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:09.967549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95e7c9-8545-4edd-ab21-e13b90dd399f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:09.968914 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95e7c9-8545-4edd-ab21-e13b90dd399f admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:09.969333 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95e7c9-8545-4edd-ab21-e13b90dd399f admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:09.969658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95e7c9-8545-4edd-ab21-e13b90dd399f admin admin] PATH_INFO: `/v3/projects/f18c59aa7c4445c09f2e20818c8b976a/users/587b68728efa470b864c36302134abba/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:09.971769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95e7c9-8545-4edd-ab21-e13b90dd399f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f18c59aa7c4445c09f2e20818c8b976a, user_id=587b68728efa470b864c36302134abba, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:09.974865 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95e7c9-8545-4edd-ab21-e13b90dd399f admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:09.977079 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267197d9-4c3f-41a0-9642-495cecebe521 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:09.985867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa6a79-a276-4cb8-9fec-c817fd82f048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:09.985867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa6a79-a276-4cb8-9fec-c817fd82f048 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:09.985867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa6a79-a276-4cb8-9fec-c817fd82f048 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:09.985867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa6a79-a276-4cb8-9fec-c817fd82f048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:09.991648 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1154/2301] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:06:09 2022] PUT /identity/v3/projects/f18c59aa7c4445c09f2e20818c8b976a/users/587b68728efa470b864c36302134abba/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:09.995406 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa6a79-a276-4cb8-9fec-c817fd82f048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:10.000687 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa6a79-a276-4cb8-9fec-c817fd82f048 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:10.004008 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edf40e-7385-448d-a796-c7a17436db9d None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:10.004008 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edf40e-7385-448d-a796-c7a17436db9d None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:10.004248 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edf40e-7385-448d-a796-c7a17436db9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:10.009485 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1148/2302] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:06:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:06:10.040556 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-f9edf40e-7385-448d-a796-c7a17436db9d None None] MFA Rules not processed for user `587b68728efa470b864c36302134abba`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:10.043013 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f9edf40e-7385-448d-a796-c7a17436db9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:10.127140 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1155/2303] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:10.141107 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa6a79-a276-4cb8-9fec-c817fd82f048 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:10.144026 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-0efa6a79-a276-4cb8-9fec-c817fd82f048 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:10.226037 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa6a79-a276-4cb8-9fec-c817fd82f048 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:10.290482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:10.302888 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545983d6-808b-4599-ad4f-12a04a96517e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:10.303684 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545983d6-808b-4599-ad4f-12a04a96517e service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:10.304414 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545983d6-808b-4599-ad4f-12a04a96517e service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:10.304414 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545983d6-808b-4599-ad4f-12a04a96517e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:10.308305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-545983d6-808b-4599-ad4f-12a04a96517e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:10.346061 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edf40e-7385-448d-a796-c7a17436db9d None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:10.347603 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f9edf40e-7385-448d-a796-c7a17436db9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:10.385571 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545983d6-808b-4599-ad4f-12a04a96517e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:10.387111 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545983d6-808b-4599-ad4f-12a04a96517e service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:10.400777 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1149/2304] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:06:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:06:10.446739 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:10.491548 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edf40e-7385-448d-a796-c7a17436db9d None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:10.497187 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853a9cf-8ca9-4add-95a2-de10b1e31895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:10.497937 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853a9cf-8ca9-4add-95a2-de10b1e31895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:10.498222 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853a9cf-8ca9-4add-95a2-de10b1e31895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:10.499058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853a9cf-8ca9-4add-95a2-de10b1e31895 admin admin] PATH_INFO: `/v3/projects/a2f0a75c3f5c47458a7e74fab544b0fa` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:10.500969 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7853a9cf-8ca9-4add-95a2-de10b1e31895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2f0a75c3f5c47458a7e74fab544b0fa)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:10.503963 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7853a9cf-8ca9-4add-95a2-de10b1e31895 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:10.571577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7853a9cf-8ca9-4add-95a2-de10b1e31895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2f0a75c3f5c47458a7e74fab544b0fa', 'request_id': 'req-7853a9cf-8ca9-4add-95a2-de10b1e31895'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:10.580405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7853a9cf-8ca9-4add-95a2-de10b1e31895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2f0a75c3f5c47458a7e74fab544b0fa', 'request_id': 'req-7853a9cf-8ca9-4add-95a2-de10b1e31895'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:10.588905 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7853a9cf-8ca9-4add-95a2-de10b1e31895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2f0a75c3f5c47458a7e74fab544b0fa', 'request_id': 'req-7853a9cf-8ca9-4add-95a2-de10b1e31895'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:10.605570 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7853a9cf-8ca9-4add-95a2-de10b1e31895 admin admin] The token cache is being invalidate because project a2f0a75c3f5c47458a7e74fab544b0fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:06:10.605933 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7853a9cf-8ca9-4add-95a2-de10b1e31895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:10.606726 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7853a9cf-8ca9-4add-95a2-de10b1e31895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:10.608480 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1156/2305] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:06:10 2022] DELETE /identity/v3/projects/a2f0a75c3f5c47458a7e74fab544b0fa => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:06:10.614165 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d456e-37cd-44c1-8740-2b014fb71303 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:10.615045 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d456e-37cd-44c1-8740-2b014fb71303 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:10.615459 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d456e-37cd-44c1-8740-2b014fb71303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:10.650159 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-3c7d456e-37cd-44c1-8740-2b014fb71303 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:10.651751 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3c7d456e-37cd-44c1-8740-2b014fb71303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:10.750090 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e5594-1b3f-4127-8ccc-599dc7ff19cc None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:10.750267 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e5594-1b3f-4127-8ccc-599dc7ff19cc None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:10.750533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e5594-1b3f-4127-8ccc-599dc7ff19cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:10.753795 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1150/2306] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:06:10.789886 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-fb9e5594-1b3f-4127-8ccc-599dc7ff19cc None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:10.791485 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-fb9e5594-1b3f-4127-8ccc-599dc7ff19cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:10.815911 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1157/2307] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:06:10.820996 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d456e-37cd-44c1-8740-2b014fb71303 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:10.842282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d456e-37cd-44c1-8740-2b014fb71303 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:10.850089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1731ffe-f5c6-4a86-b703-6311eba8bb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:10.851226 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1731ffe-f5c6-4a86-b703-6311eba8bb72 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:10.851696 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1731ffe-f5c6-4a86-b703-6311eba8bb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:10.852151 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1731ffe-f5c6-4a86-b703-6311eba8bb72 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:10.853049 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1731ffe-f5c6-4a86-b703-6311eba8bb72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:06:10.853629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1731ffe-f5c6-4a86-b703-6311eba8bb72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:10.855458 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1731ffe-f5c6-4a86-b703-6311eba8bb72 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:10.870376 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1151/2308] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:06:10.874452 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e5594-1b3f-4127-8ccc-599dc7ff19cc None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:10.884447 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e5594-1b3f-4127-8ccc-599dc7ff19cc None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:10.890484 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656af43f-4037-4597-a4d7-762099058a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:10.891153 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656af43f-4037-4597-a4d7-762099058a31 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:10.891438 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656af43f-4037-4597-a4d7-762099058a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:10.891730 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656af43f-4037-4597-a4d7-762099058a31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:10.892346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656af43f-4037-4597-a4d7-762099058a31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:10.894302 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656af43f-4037-4597-a4d7-762099058a31 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:10.927339 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1158/2309] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:06:10 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:06:10.931848 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1731ffe-f5c6-4a86-b703-6311eba8bb72 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:10.943768 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1731ffe-f5c6-4a86-b703-6311eba8bb72 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:11.027638 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7bb76-2dc1-4f02-90ae-38ec1d221715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:11.028294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7bb76-2dc1-4f02-90ae-38ec1d221715 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:11.028576 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7bb76-2dc1-4f02-90ae-38ec1d221715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:11.028854 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7bb76-2dc1-4f02-90ae-38ec1d221715 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:11.029503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7bb76-2dc1-4f02-90ae-38ec1d221715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:11.031629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7bb76-2dc1-4f02-90ae-38ec1d221715 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:11.063450 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1152/2310] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:06:10 2022] POST /identity/v3/users => generated 283 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:06:11.067860 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656af43f-4037-4597-a4d7-762099058a31 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:11.079738 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656af43f-4037-4597-a4d7-762099058a31 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:11.086172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff7279-6d76-419e-a8be-024cfe2260ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:11.086804 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff7279-6d76-419e-a8be-024cfe2260ac admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:11.087085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff7279-6d76-419e-a8be-024cfe2260ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:11.087358 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff7279-6d76-419e-a8be-024cfe2260ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:11.088017 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff7279-6d76-419e-a8be-024cfe2260ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:11.090116 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff7279-6d76-419e-a8be-024cfe2260ac admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:11.103546 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1159/2311] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:06:11.105269 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7bb76-2dc1-4f02-90ae-38ec1d221715 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:11.118530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7bb76-2dc1-4f02-90ae-38ec1d221715 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:11.127472 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d9c36-af53-4cb2-9135-cbd5c8436ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:11.128667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d9c36-af53-4cb2-9135-cbd5c8436ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:11.129065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d9c36-af53-4cb2-9135-cbd5c8436ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:11.129376 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d9c36-af53-4cb2-9135-cbd5c8436ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:11.130312 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d9c36-af53-4cb2-9135-cbd5c8436ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:11.131974 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d9c36-af53-4cb2-9135-cbd5c8436ca6 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:11.148771 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1153/2312] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 01:06:11.149977 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff7279-6d76-419e-a8be-024cfe2260ac admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:11.162239 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff7279-6d76-419e-a8be-024cfe2260ac admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:11.170642 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075eae2c-ea7f-4358-88d9-ad853ae80372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:11.171842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075eae2c-ea7f-4358-88d9-ad853ae80372 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:11.172330 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075eae2c-ea7f-4358-88d9-ad853ae80372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:11.172803 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075eae2c-ea7f-4358-88d9-ad853ae80372 admin admin] PATH_INFO: `/v3/projects/35288fe046b047398cbba0b9350c86e3/users/26876cf35a4e48c481b0cd09cdd50cfb/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:11.193014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075eae2c-ea7f-4358-88d9-ad853ae80372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35288fe046b047398cbba0b9350c86e3, user_id=26876cf35a4e48c481b0cd09cdd50cfb, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:11.198909 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075eae2c-ea7f-4358-88d9-ad853ae80372 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:11.229267 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1160/2313] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:06:11 2022] PUT /identity/v3/projects/35288fe046b047398cbba0b9350c86e3/users/26876cf35a4e48c481b0cd09cdd50cfb/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:06:11.231583 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd692e6-4a5f-4ef6-b0ce-2019838196f0 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:11.232032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd692e6-4a5f-4ef6-b0ce-2019838196f0 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:11.232453 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd692e6-4a5f-4ef6-b0ce-2019838196f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:11.241700 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:11.266324 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-bbd692e6-4a5f-4ef6-b0ce-2019838196f0 None None] MFA Rules not processed for user `26876cf35a4e48c481b0cd09cdd50cfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:11.267479 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-bbd692e6-4a5f-4ef6-b0ce-2019838196f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:11.344787 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1154/2314] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:11.357433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075eae2c-ea7f-4358-88d9-ad853ae80372 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:11.360008 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-075eae2c-ea7f-4358-88d9-ad853ae80372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:11.436928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075eae2c-ea7f-4358-88d9-ad853ae80372 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:11.442661 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1881b-787c-416a-bcf0-5f813f437cef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:11.443596 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1881b-787c-416a-bcf0-5f813f437cef service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:11.444835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1881b-787c-416a-bcf0-5f813f437cef service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:11.445198 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1881b-787c-416a-bcf0-5f813f437cef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:11.456027 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1881b-787c-416a-bcf0-5f813f437cef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:11.457507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1881b-787c-416a-bcf0-5f813f437cef service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:11.467786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1161/2315] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:06:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:06:12.172870 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd692e6-4a5f-4ef6-b0ce-2019838196f0 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:12.189339 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd692e6-4a5f-4ef6-b0ce-2019838196f0 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:12.193927 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69beb0d5-b86e-4025-8c37-efc57c34d3f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:12.195323 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69beb0d5-b86e-4025-8c37-efc57c34d3f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:12.195737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69beb0d5-b86e-4025-8c37-efc57c34d3f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:12.196004 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69beb0d5-b86e-4025-8c37-efc57c34d3f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:12.197739 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-69beb0d5-b86e-4025-8c37-efc57c34d3f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:12.278456 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69beb0d5-b86e-4025-8c37-efc57c34d3f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:12.278456 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69beb0d5-b86e-4025-8c37-efc57c34d3f1 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:12.285956 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1155/2316] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:06:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:06:12.970763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1881b-787c-416a-bcf0-5f813f437cef service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:12.972307 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f3e1881b-787c-416a-bcf0-5f813f437cef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:12.992859 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1881b-787c-416a-bcf0-5f813f437cef service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:13.005680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e7722-69cb-4385-860d-0059477bd586 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:13.006344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e7722-69cb-4385-860d-0059477bd586 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:13.006622 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e7722-69cb-4385-860d-0059477bd586 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:13.006894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e7722-69cb-4385-860d-0059477bd586 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:13.012812 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-845e7722-69cb-4385-860d-0059477bd586 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:13.018584 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:13.106803 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e7722-69cb-4385-860d-0059477bd586 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:13.110852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e7722-69cb-4385-860d-0059477bd586 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:13.123607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1162/2317] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:06:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:06:15.749983 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d794d-9660-4dce-94ea-3ea2422bc1e9 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:15.750497 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d794d-9660-4dce-94ea-3ea2422bc1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:15.750609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d794d-9660-4dce-94ea-3ea2422bc1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:15.812677 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-7e8d794d-9660-4dce-94ea-3ea2422bc1e9 None None] MFA Rules not processed for user `873f4c5451bf4734bad957df7ecfee23`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:15.814262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7e8d794d-9660-4dce-94ea-3ea2422bc1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:15.896578 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e7722-69cb-4385-860d-0059477bd586 service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:15.897569 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1156/2318] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:15.898418 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-845e7722-69cb-4385-860d-0059477bd586 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:16.011326 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e7722-69cb-4385-860d-0059477bd586 service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:16.024150 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993be51-5d64-43c3-9eef-900f6f4bc21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:16.025118 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993be51-5d64-43c3-9eef-900f6f4bc21b admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:16.025896 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993be51-5d64-43c3-9eef-900f6f4bc21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:16.026359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993be51-5d64-43c3-9eef-900f6f4bc21b admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:16.027310 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993be51-5d64-43c3-9eef-900f6f4bc21b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:16.030556 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993be51-5d64-43c3-9eef-900f6f4bc21b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:16.074123 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1163/2319] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:06:15 2022] POST /identity/v3/projects => generated 371 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:06:16.079081 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d794d-9660-4dce-94ea-3ea2422bc1e9 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:16.096799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d794d-9660-4dce-94ea-3ea2422bc1e9 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:16.119562 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:16.188655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c27efc-a161-4c72-8e31-abe979bf1558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:16.192730 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c27efc-a161-4c72-8e31-abe979bf1558 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:16.192730 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c27efc-a161-4c72-8e31-abe979bf1558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:16.192730 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c27efc-a161-4c72-8e31-abe979bf1558 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:16.193227 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c27efc-a161-4c72-8e31-abe979bf1558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:16.195803 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c27efc-a161-4c72-8e31-abe979bf1558 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:16.242040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1157/2320] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:06:16 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:06:16.242636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993be51-5d64-43c3-9eef-900f6f4bc21b admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:16.259004 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993be51-5d64-43c3-9eef-900f6f4bc21b admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:16.262908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd98aa-f132-4277-9ec3-ad887687246b None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:16.263501 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd98aa-f132-4277-9ec3-ad887687246b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:16.263854 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd98aa-f132-4277-9ec3-ad887687246b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:16.269010 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778ad23-3ab8-4758-85ad-82159e5d0814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:16.270003 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778ad23-3ab8-4758-85ad-82159e5d0814 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:16.270536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778ad23-3ab8-4758-85ad-82159e5d0814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:16.271229 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778ad23-3ab8-4758-85ad-82159e5d0814 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:16.272107 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778ad23-3ab8-4758-85ad-82159e5d0814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:16.274719 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778ad23-3ab8-4758-85ad-82159e5d0814 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:16.287322 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-2ffd98aa-f132-4277-9ec3-ad887687246b None None] MFA Rules not processed for user `f7368f2c6d934517b4b71206473795f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:16.288663 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-2ffd98aa-f132-4277-9ec3-ad887687246b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:16.294543 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1164/2321] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:06:16.299031 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778ad23-3ab8-4758-85ad-82159e5d0814 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:16.312422 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778ad23-3ab8-4758-85ad-82159e5d0814 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:16.318190 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30640d-d49f-4843-bc56-84a8a6d085cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:16.318836 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30640d-d49f-4843-bc56-84a8a6d085cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:16.319125 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30640d-d49f-4843-bc56-84a8a6d085cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:16.319378 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30640d-d49f-4843-bc56-84a8a6d085cd admin admin] PATH_INFO: `/v3/projects/69ee2a12addb488a8c3e78c50e25d4c4/users/ccde5cd6590242379fa8c1b4c0dd1c97/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:16.337401 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30640d-d49f-4843-bc56-84a8a6d085cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=69ee2a12addb488a8c3e78c50e25d4c4, user_id=ccde5cd6590242379fa8c1b4c0dd1c97, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:16.340843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30640d-d49f-4843-bc56-84a8a6d085cd admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:16.353212 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1158/2322] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:06:16.357278 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1165/2323] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:06:16 2022] PUT /identity/v3/projects/69ee2a12addb488a8c3e78c50e25d4c4/users/ccde5cd6590242379fa8c1b4c0dd1c97/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:16.361426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd98aa-f132-4277-9ec3-ad887687246b None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:16.372612 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd98aa-f132-4277-9ec3-ad887687246b None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:16.437162 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133b3a3-2945-4d27-a98e-144bb653d485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:16.437765 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133b3a3-2945-4d27-a98e-144bb653d485 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:16.438074 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133b3a3-2945-4d27-a98e-144bb653d485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:16.438344 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133b3a3-2945-4d27-a98e-144bb653d485 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:16.438987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133b3a3-2945-4d27-a98e-144bb653d485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:16.440619 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133b3a3-2945-4d27-a98e-144bb653d485 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:16.453836 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1159/2324] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:06:16.455727 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30640d-d49f-4843-bc56-84a8a6d085cd admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:16.465974 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30640d-d49f-4843-bc56-84a8a6d085cd admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:16.470621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687a490-e13f-4837-a6d2-13bb08c27e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:16.471271 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687a490-e13f-4837-a6d2-13bb08c27e07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:16.471550 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687a490-e13f-4837-a6d2-13bb08c27e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:16.471823 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687a490-e13f-4837-a6d2-13bb08c27e07 admin admin] PATH_INFO: `/v3/projects/69ee2a12addb488a8c3e78c50e25d4c4/users/ccde5cd6590242379fa8c1b4c0dd1c97/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:16.473757 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687a490-e13f-4837-a6d2-13bb08c27e07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69ee2a12addb488a8c3e78c50e25d4c4, user_id=ccde5cd6590242379fa8c1b4c0dd1c97, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:16.476429 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687a490-e13f-4837-a6d2-13bb08c27e07 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:16.486645 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1166/2325] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:06:16 2022] PUT /identity/v3/projects/69ee2a12addb488a8c3e78c50e25d4c4/users/ccde5cd6590242379fa8c1b4c0dd1c97/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:17.382195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133b3a3-2945-4d27-a98e-144bb653d485 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:17.384753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6133b3a3-2945-4d27-a98e-144bb653d485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:17.418676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133b3a3-2945-4d27-a98e-144bb653d485 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:17.574137 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:17.599495 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5041f-2759-4785-9f7b-e31ad107f0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:17.601201 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5041f-2759-4785-9f7b-e31ad107f0fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:17.601765 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5041f-2759-4785-9f7b-e31ad107f0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:17.602248 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5041f-2759-4785-9f7b-e31ad107f0fb admin admin] PATH_INFO: `/v3/users/484fb69a2d534838a6df2fe1c3750df8` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:17.606515 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5041f-2759-4785-9f7b-e31ad107f0fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=484fb69a2d534838a6df2fe1c3750df8)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:17.610966 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5041f-2759-4785-9f7b-e31ad107f0fb admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:17.723776 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-6ec5041f-2759-4785-9f7b-e31ad107f0fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '484fb69a2d534838a6df2fe1c3750df8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:17.725263 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-6ec5041f-2759-4785-9f7b-e31ad107f0fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '484fb69a2d534838a6df2fe1c3750df8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:17.747496 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-6ec5041f-2759-4785-9f7b-e31ad107f0fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '484fb69a2d534838a6df2fe1c3750df8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:17.794643 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-6ec5041f-2759-4785-9f7b-e31ad107f0fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '484fb69a2d534838a6df2fe1c3750df8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:17.795487 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-6ec5041f-2759-4785-9f7b-e31ad107f0fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '484fb69a2d534838a6df2fe1c3750df8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:17.821495 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1160/2326] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:06:17 2022] DELETE /identity/v3/users/484fb69a2d534838a6df2fe1c3750df8 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:17.824363 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a55a00-088a-4557-8811-e01b51ce66b2 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:17.825312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a55a00-088a-4557-8811-e01b51ce66b2 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:17.825753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a55a00-088a-4557-8811-e01b51ce66b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:17.857116 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-25a55a00-088a-4557-8811-e01b51ce66b2 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:17.863740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-25a55a00-088a-4557-8811-e01b51ce66b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:17.940955 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:18.000967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1167/2327] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:18.012997 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5041f-2759-4785-9f7b-e31ad107f0fb admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:18.015019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6ec5041f-2759-4785-9f7b-e31ad107f0fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:18.116008 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5041f-2759-4785-9f7b-e31ad107f0fb admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:18.119728 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f959cf6-b53a-4729-b323-4d033756cf93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:18.120336 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f959cf6-b53a-4729-b323-4d033756cf93 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:18.120608 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f959cf6-b53a-4729-b323-4d033756cf93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:18.120873 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f959cf6-b53a-4729-b323-4d033756cf93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:18.148687 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f959cf6-b53a-4729-b323-4d033756cf93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:18.150182 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f959cf6-b53a-4729-b323-4d033756cf93 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:18.179272 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1161/2328] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:06:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:06:18.910160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a55a00-088a-4557-8811-e01b51ce66b2 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:18.911826 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-25a55a00-088a-4557-8811-e01b51ce66b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:18.955136 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a55a00-088a-4557-8811-e01b51ce66b2 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:18.974904 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a667d7c-8758-42a8-8467-b8a1c8ee7763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:18.975648 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a667d7c-8758-42a8-8467-b8a1c8ee7763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:18.975992 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a667d7c-8758-42a8-8467-b8a1c8ee7763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:18.976332 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a667d7c-8758-42a8-8467-b8a1c8ee7763 admin admin] PATH_INFO: `/v3/projects/b1e874898e634ac9add6518846c8ae2b` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:18.979712 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a667d7c-8758-42a8-8467-b8a1c8ee7763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1e874898e634ac9add6518846c8ae2b)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:19.002840 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a667d7c-8758-42a8-8467-b8a1c8ee7763 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:19.128172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0a667d7c-8758-42a8-8467-b8a1c8ee7763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1e874898e634ac9add6518846c8ae2b', 'request_id': 'req-0a667d7c-8758-42a8-8467-b8a1c8ee7763'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:19.142631 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0a667d7c-8758-42a8-8467-b8a1c8ee7763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1e874898e634ac9add6518846c8ae2b', 'request_id': 'req-0a667d7c-8758-42a8-8467-b8a1c8ee7763'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:19.156076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0a667d7c-8758-42a8-8467-b8a1c8ee7763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1e874898e634ac9add6518846c8ae2b', 'request_id': 'req-0a667d7c-8758-42a8-8467-b8a1c8ee7763'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:19.171766 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0a667d7c-8758-42a8-8467-b8a1c8ee7763 admin admin] The token cache is being invalidate because project b1e874898e634ac9add6518846c8ae2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:06:19.172889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0a667d7c-8758-42a8-8467-b8a1c8ee7763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:19.173748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0a667d7c-8758-42a8-8467-b8a1c8ee7763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:19.177286 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1168/2329] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:06:18 2022] DELETE /identity/v3/projects/b1e874898e634ac9add6518846c8ae2b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:19.181589 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f959cf6-b53a-4729-b323-4d033756cf93 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:19.197049 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f959cf6-b53a-4729-b323-4d033756cf93 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:19.371691 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6fe24-dfcd-41ca-b527-69de263e43b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:19.372446 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6fe24-dfcd-41ca-b527-69de263e43b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:19.372819 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6fe24-dfcd-41ca-b527-69de263e43b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:19.373184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6fe24-dfcd-41ca-b527-69de263e43b9 admin admin] PATH_INFO: `/v3/users/ed20351ef1a04edc8f8211bca171f50e` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:19.375367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6fe24-dfcd-41ca-b527-69de263e43b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed20351ef1a04edc8f8211bca171f50e)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:19.379395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6fe24-dfcd-41ca-b527-69de263e43b9 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:19.422059 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:19.501118 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-afb6fe24-dfcd-41ca-b527-69de263e43b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed20351ef1a04edc8f8211bca171f50e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:19.502021 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-afb6fe24-dfcd-41ca-b527-69de263e43b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed20351ef1a04edc8f8211bca171f50e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:19.514675 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-afb6fe24-dfcd-41ca-b527-69de263e43b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed20351ef1a04edc8f8211bca171f50e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:19.530976 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-afb6fe24-dfcd-41ca-b527-69de263e43b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed20351ef1a04edc8f8211bca171f50e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:19.531740 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-afb6fe24-dfcd-41ca-b527-69de263e43b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed20351ef1a04edc8f8211bca171f50e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:19.554730 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1162/2330] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:06:19 2022] DELETE /identity/v3/users/ed20351ef1a04edc8f8211bca171f50e => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:20.302318 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a667d7c-8758-42a8-8467-b8a1c8ee7763 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:20.303920 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0a667d7c-8758-42a8-8467-b8a1c8ee7763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:20.337645 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a667d7c-8758-42a8-8467-b8a1c8ee7763 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:20.437151 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460768e-c269-4a74-9633-1331bdae7b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:20.438283 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460768e-c269-4a74-9633-1331bdae7b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:20.438802 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460768e-c269-4a74-9633-1331bdae7b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:20.439288 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460768e-c269-4a74-9633-1331bdae7b09 admin admin] PATH_INFO: `/v3/projects/def10596b80f4958ba5f6e564c4aff63` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:20.440977 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6460768e-c269-4a74-9633-1331bdae7b09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=def10596b80f4958ba5f6e564c4aff63)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:20.443530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6460768e-c269-4a74-9633-1331bdae7b09 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:20.527403 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6460768e-c269-4a74-9633-1331bdae7b09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'def10596b80f4958ba5f6e564c4aff63', 'request_id': 'req-6460768e-c269-4a74-9633-1331bdae7b09'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:20.542853 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6460768e-c269-4a74-9633-1331bdae7b09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'def10596b80f4958ba5f6e564c4aff63', 'request_id': 'req-6460768e-c269-4a74-9633-1331bdae7b09'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:20.578169 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6460768e-c269-4a74-9633-1331bdae7b09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'def10596b80f4958ba5f6e564c4aff63', 'request_id': 'req-6460768e-c269-4a74-9633-1331bdae7b09'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:20.581931 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:20.604485 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6460768e-c269-4a74-9633-1331bdae7b09 admin admin] The token cache is being invalidate because project def10596b80f4958ba5f6e564c4aff63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:06:20.604813 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6460768e-c269-4a74-9633-1331bdae7b09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:20.605649 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6460768e-c269-4a74-9633-1331bdae7b09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:20.608919 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1169/2331] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:06:20 2022] DELETE /identity/v3/projects/def10596b80f4958ba5f6e564c4aff63 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:20.612707 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6fe24-dfcd-41ca-b527-69de263e43b9 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:20.615458 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-afb6fe24-dfcd-41ca-b527-69de263e43b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:20.652660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6fe24-dfcd-41ca-b527-69de263e43b9 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:20.892140 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb55c3-aa4a-43eb-b925-ff32fd00ac2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:20.893278 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb55c3-aa4a-43eb-b925-ff32fd00ac2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:20.893768 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb55c3-aa4a-43eb-b925-ff32fd00ac2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:20.895856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb55c3-aa4a-43eb-b925-ff32fd00ac2f admin admin] PATH_INFO: `/v3/users/587b68728efa470b864c36302134abba` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:20.898190 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb55c3-aa4a-43eb-b925-ff32fd00ac2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=587b68728efa470b864c36302134abba)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:20.906007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb55c3-aa4a-43eb-b925-ff32fd00ac2f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:21.036478 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-16cb55c3-aa4a-43eb-b925-ff32fd00ac2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '587b68728efa470b864c36302134abba'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:21.044859 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-16cb55c3-aa4a-43eb-b925-ff32fd00ac2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '587b68728efa470b864c36302134abba'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:21.073388 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-16cb55c3-aa4a-43eb-b925-ff32fd00ac2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '587b68728efa470b864c36302134abba'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:21.114113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-16cb55c3-aa4a-43eb-b925-ff32fd00ac2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '587b68728efa470b864c36302134abba'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:21.114113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-16cb55c3-aa4a-43eb-b925-ff32fd00ac2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '587b68728efa470b864c36302134abba'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:21.157201 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1163/2332] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:06:20 2022] DELETE /identity/v3/users/587b68728efa470b864c36302134abba => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:06:22.056863 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460768e-c269-4a74-9633-1331bdae7b09 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:22.058396 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6460768e-c269-4a74-9633-1331bdae7b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:22.078997 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460768e-c269-4a74-9633-1331bdae7b09 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:22.143580 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84e42f-e976-4fa6-bb6b-14ed40a0a326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:22.144238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84e42f-e976-4fa6-bb6b-14ed40a0a326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:22.144589 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84e42f-e976-4fa6-bb6b-14ed40a0a326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:22.144939 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84e42f-e976-4fa6-bb6b-14ed40a0a326 admin admin] PATH_INFO: `/v3/projects/f18c59aa7c4445c09f2e20818c8b976a` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:22.146172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84e42f-e976-4fa6-bb6b-14ed40a0a326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f18c59aa7c4445c09f2e20818c8b976a)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:22.148293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84e42f-e976-4fa6-bb6b-14ed40a0a326 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:22.209586 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6d84e42f-e976-4fa6-bb6b-14ed40a0a326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f18c59aa7c4445c09f2e20818c8b976a', 'request_id': 'req-6d84e42f-e976-4fa6-bb6b-14ed40a0a326'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:22.220762 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6d84e42f-e976-4fa6-bb6b-14ed40a0a326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f18c59aa7c4445c09f2e20818c8b976a', 'request_id': 'req-6d84e42f-e976-4fa6-bb6b-14ed40a0a326'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:22.232944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6d84e42f-e976-4fa6-bb6b-14ed40a0a326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f18c59aa7c4445c09f2e20818c8b976a', 'request_id': 'req-6d84e42f-e976-4fa6-bb6b-14ed40a0a326'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:22.251305 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6d84e42f-e976-4fa6-bb6b-14ed40a0a326 admin admin] The token cache is being invalidate because project f18c59aa7c4445c09f2e20818c8b976a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:06:22.251624 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6d84e42f-e976-4fa6-bb6b-14ed40a0a326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:22.252621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6d84e42f-e976-4fa6-bb6b-14ed40a0a326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:06:22.255763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1170/2333] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:06:22 2022] DELETE /identity/v3/projects/f18c59aa7c4445c09f2e20818c8b976a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:06:24.375134 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b9852-aa87-4a0b-a174-47a345a1cdc2 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:24.376247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b9852-aa87-4a0b-a174-47a345a1cdc2 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:24.376725 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b9852-aa87-4a0b-a174-47a345a1cdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:24.407412 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:24.409979 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-de8b9852-aa87-4a0b-a174-47a345a1cdc2 None None] MFA Rules not processed for user `ccde5cd6590242379fa8c1b4c0dd1c97`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:24.412632 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-de8b9852-aa87-4a0b-a174-47a345a1cdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:24.497885 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1164/2334] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:24 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:24.511371 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84e42f-e976-4fa6-bb6b-14ed40a0a326 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:24.512789 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6d84e42f-e976-4fa6-bb6b-14ed40a0a326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:24.589007 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84e42f-e976-4fa6-bb6b-14ed40a0a326 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:24.597739 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9703d8-a957-4286-9667-1c65ab86bf75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:24.598375 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9703d8-a957-4286-9667-1c65ab86bf75 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:24.598667 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9703d8-a957-4286-9667-1c65ab86bf75 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:24.598962 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9703d8-a957-4286-9667-1c65ab86bf75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:24.600898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ad9703d8-a957-4286-9667-1c65ab86bf75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:24.620087 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:24.667053 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9703d8-a957-4286-9667-1c65ab86bf75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:24.668618 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9703d8-a957-4286-9667-1c65ab86bf75 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:24.677976 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1171/2335] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:06:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 01:06:26.048737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46390b8-8c8e-4922-8595-f2378fdd4924 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:26.049269 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46390b8-8c8e-4922-8595-f2378fdd4924 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:26.049868 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46390b8-8c8e-4922-8595-f2378fdd4924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:26.075620 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-d46390b8-8c8e-4922-8595-f2378fdd4924 None None] MFA Rules not processed for user `873f4c5451bf4734bad957df7ecfee23`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:26.077191 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d46390b8-8c8e-4922-8595-f2378fdd4924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:26.087444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1165/2336] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:34.673977 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=19 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:36.068274 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=31 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:39.717297 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277d828-c023-4e3a-ad39-1d6ecf5606fc None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:39.717762 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277d828-c023-4e3a-ad39-1d6ecf5606fc None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:39.718412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277d828-c023-4e3a-ad39-1d6ecf5606fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:39.745150 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-f277d828-c023-4e3a-ad39-1d6ecf5606fc None None] MFA Rules not processed for user `2b5730c49e61438884e3d9f4451e3b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:39.747272 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f277d828-c023-4e3a-ad39-1d6ecf5606fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:39.824025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1172/2337] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:06:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:43.389217 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4727d-0fbd-463c-b71a-82d5010eb2fb None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:43.389661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4727d-0fbd-463c-b71a-82d5010eb2fb None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:43.389767 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4727d-0fbd-463c-b71a-82d5010eb2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:43.413320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-34c4727d-0fbd-463c-b71a-82d5010eb2fb None None] MFA Rules not processed for user `eb9d1149a417436bbf1577d61407c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:43.414493 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-34c4727d-0fbd-463c-b71a-82d5010eb2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:43.473086 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1166/2338] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 14 01:06:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:43.521190 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277d828-c023-4e3a-ad39-1d6ecf5606fc None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:43.522645 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f277d828-c023-4e3a-ad39-1d6ecf5606fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:43.594465 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277d828-c023-4e3a-ad39-1d6ecf5606fc None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:43.599836 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f58901-f93f-4eae-a226-c9630757fdf6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d05652bfe542d5a2cfa39fbf7a83c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:43.600481 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f58901-f93f-4eae-a226-c9630757fdf6 service swift] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:43.600757 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f58901-f93f-4eae-a226-c9630757fdf6 service swift] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:43.601024 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f58901-f93f-4eae-a226-c9630757fdf6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:43.610550 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f58901-f93f-4eae-a226-c9630757fdf6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:43.612151 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f58901-f93f-4eae-a226-c9630757fdf6 service swift] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:43.620601 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1173/2339] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 14 01:06:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 01:06:44.070145 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cd7de-efb6-4474-ac7f-10a8bf825ddc None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:44.070671 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cd7de-efb6-4474-ac7f-10a8bf825ddc None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:44.071385 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cd7de-efb6-4474-ac7f-10a8bf825ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:44.104049 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-881cd7de-efb6-4474-ac7f-10a8bf825ddc None None] MFA Rules not processed for user `eb9d1149a417436bbf1577d61407c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:06:44.105396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-881cd7de-efb6-4474-ac7f-10a8bf825ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:06:44.113999 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1167/2340] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 14 01:06:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:06:44.130635 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f58901-f93f-4eae-a226-c9630757fdf6 service swift] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:06:44.141402 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f58901-f93f-4eae-a226-c9630757fdf6 service swift] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:06:44.147988 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ad14e-8338-4018-9b1d-7966aeae1b39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d05652bfe542d5a2cfa39fbf7a83c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:06:44.148789 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ad14e-8338-4018-9b1d-7966aeae1b39 service swift] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:06:44.149217 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ad14e-8338-4018-9b1d-7966aeae1b39 service swift] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:06:44.149647 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ad14e-8338-4018-9b1d-7966aeae1b39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:06:44.160196 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ad14e-8338-4018-9b1d-7966aeae1b39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:06:44.162302 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ad14e-8338-4018-9b1d-7966aeae1b39 service swift] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:06:44.179652 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1174/2341] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 14 01:06:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 01:06:54.096433 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=28 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:54.174960 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=63 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:07:05.123227 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e8d05-f64d-4771-8729-0b3080da52fb None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:05.123878 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e8d05-f64d-4771-8729-0b3080da52fb None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:05.123878 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e8d05-f64d-4771-8729-0b3080da52fb None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:05.125731 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1168/2342] 10.222.0.20 () {54 vars in 921 bytes} [Wed Sep 14 01:07:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 01:07:05.132524 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2949cb8-c427-43e0-afef-33b0ca304e0c None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:05.133363 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2949cb8-c427-43e0-afef-33b0ca304e0c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:05.133642 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2949cb8-c427-43e0-afef-33b0ca304e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:05.157564 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-d2949cb8-c427-43e0-afef-33b0ca304e0c None None] MFA Rules not processed for user `c05caac9e8b9498583780306887734be`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:07:05.159404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d2949cb8-c427-43e0-afef-33b0ca304e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:05.175061 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1175/2343] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Sep 14 01:07:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:07:05.184216 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e8d05-f64d-4771-8729-0b3080da52fb None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:05.186497 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-465e8d05-f64d-4771-8729-0b3080da52fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:05.302917 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b797c-b417-4c26-b019-771e44def02c None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:05.303618 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b797c-b417-4c26-b019-771e44def02c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:05.304273 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b797c-b417-4c26-b019-771e44def02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:05.314435 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e8d05-f64d-4771-8729-0b3080da52fb None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:05.318221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6fc78-1ebe-4eb4-9317-434771323a6f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee54ed3a092e4eef9082c4e86bd918a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:05.319379 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6fc78-1ebe-4eb4-9317-434771323a6f service glance] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:05.320880 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6fc78-1ebe-4eb4-9317-434771323a6f service glance] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:05.321770 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6fc78-1ebe-4eb4-9317-434771323a6f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:05.337204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6fc78-1ebe-4eb4-9317-434771323a6f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:05.338716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6fc78-1ebe-4eb4-9317-434771323a6f service glance] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:05.343067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-837b797c-b417-4c26-b019-771e44def02c None None] MFA Rules not processed for user `eb9d1149a417436bbf1577d61407c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:07:05.347024 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-837b797c-b417-4c26-b019-771e44def02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:05.351717 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1169/2344] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:07:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:07:05.361964 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1176/2345] 10.222.0.20 () {58 vars in 967 bytes} [Wed Sep 14 01:07:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:07:05.376153 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6fc78-1ebe-4eb4-9317-434771323a6f service glance] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:05.397184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6fc78-1ebe-4eb4-9317-434771323a6f service glance] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:05.405325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3dc5d0-a9c1-4183-85af-da037db9063a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d05652bfe542d5a2cfa39fbf7a83c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:05.406237 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3dc5d0-a9c1-4183-85af-da037db9063a service swift] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:05.407270 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3dc5d0-a9c1-4183-85af-da037db9063a service swift] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:05.407976 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3dc5d0-a9c1-4183-85af-da037db9063a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:05.420433 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3dc5d0-a9c1-4183-85af-da037db9063a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:05.422519 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3dc5d0-a9c1-4183-85af-da037db9063a service swift] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:05.432991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1170/2346] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 14 01:07:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 01:07:05.452064 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac41f7-d34f-48f0-a0c2-327b7de59797 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:05.452352 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac41f7-d34f-48f0-a0c2-327b7de59797 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:05.452626 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac41f7-d34f-48f0-a0c2-327b7de59797 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:05.454286 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1177/2347] 10.222.0.20 () {54 vars in 921 bytes} [Wed Sep 14 01:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 01:07:05.459415 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5604f7e-7adf-4fee-b42b-a14adb61f9ee None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:05.459744 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5604f7e-7adf-4fee-b42b-a14adb61f9ee None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:05.460065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5604f7e-7adf-4fee-b42b-a14adb61f9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:05.530392 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-e5604f7e-7adf-4fee-b42b-a14adb61f9ee None None] MFA Rules not processed for user `b4444b17075f4224a4da1ef501fd4eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:07:05.531646 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e5604f7e-7adf-4fee-b42b-a14adb61f9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:05.684145 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1171/2348] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Sep 14 01:07:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:07:05.724674 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac41f7-d34f-48f0-a0c2-327b7de59797 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:05.726573 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-85ac41f7-d34f-48f0-a0c2-327b7de59797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:05.745867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac41f7-d34f-48f0-a0c2-327b7de59797 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:05.750407 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8143d-e5e7-43f3-a261-af8a58f5b7b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:05.751485 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8143d-e5e7-43f3-a261-af8a58f5b7b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:05.751934 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8143d-e5e7-43f3-a261-af8a58f5b7b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:05.752368 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8143d-e5e7-43f3-a261-af8a58f5b7b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:05.763738 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd8143d-e5e7-43f3-a261-af8a58f5b7b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:05.765831 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd8143d-e5e7-43f3-a261-af8a58f5b7b6 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:05.778743 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1178/2349] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:07:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:07:05.943734 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638edbd-8707-45bf-98d9-3bc1b1d6f75c None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:05.944413 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638edbd-8707-45bf-98d9-3bc1b1d6f75c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:05.944905 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638edbd-8707-45bf-98d9-3bc1b1d6f75c None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:05.947763 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1172/2350] 10.222.0.20 () {54 vars in 921 bytes} [Wed Sep 14 01:07:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 01:07:05.958421 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903d006-efb9-49cd-90d6-a4ee1428b132 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:05.958926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903d006-efb9-49cd-90d6-a4ee1428b132 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:05.959326 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903d006-efb9-49cd-90d6-a4ee1428b132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:05.993992 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-4903d006-efb9-49cd-90d6-a4ee1428b132 None None] MFA Rules not processed for user `c05caac9e8b9498583780306887734be`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:07:05.996162 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4903d006-efb9-49cd-90d6-a4ee1428b132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:06.014016 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1179/2351] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Sep 14 01:07:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:07:06.035201 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638edbd-8707-45bf-98d9-3bc1b1d6f75c None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:06.039334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-0638edbd-8707-45bf-98d9-3bc1b1d6f75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:06.067039 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638edbd-8707-45bf-98d9-3bc1b1d6f75c None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:06.073547 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05e7dc-457b-495c-9992-42c9ec29c5b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:06.074674 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05e7dc-457b-495c-9992-42c9ec29c5b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:06.076291 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05e7dc-457b-495c-9992-42c9ec29c5b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:06.077432 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05e7dc-457b-495c-9992-42c9ec29c5b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:06.093537 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05e7dc-457b-495c-9992-42c9ec29c5b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:06.095478 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05e7dc-457b-495c-9992-42c9ec29c5b7 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:06.117330 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1173/2352] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:07:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:07:06.421733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903d006-efb9-49cd-90d6-a4ee1428b132 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:06.423721 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4903d006-efb9-49cd-90d6-a4ee1428b132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:06.527684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903d006-efb9-49cd-90d6-a4ee1428b132 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:06.558508 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d4de8-c902-44ee-a797-0667f74df402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:06.560115 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d4de8-c902-44ee-a797-0667f74df402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:06.560563 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d4de8-c902-44ee-a797-0667f74df402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:06.561155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d4de8-c902-44ee-a797-0667f74df402 admin admin] PATH_INFO: `/v3/users/26876cf35a4e48c481b0cd09cdd50cfb` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:06.585133 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d4de8-c902-44ee-a797-0667f74df402 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26876cf35a4e48c481b0cd09cdd50cfb)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:06.587252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d4de8-c902-44ee-a797-0667f74df402 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:06.675249 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-594d4de8-c902-44ee-a797-0667f74df402 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26876cf35a4e48c481b0cd09cdd50cfb'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:06.693038 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-594d4de8-c902-44ee-a797-0667f74df402 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26876cf35a4e48c481b0cd09cdd50cfb'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:06.711928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-594d4de8-c902-44ee-a797-0667f74df402 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26876cf35a4e48c481b0cd09cdd50cfb'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:06.712682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-594d4de8-c902-44ee-a797-0667f74df402 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26876cf35a4e48c481b0cd09cdd50cfb'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:06.713665 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-594d4de8-c902-44ee-a797-0667f74df402 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26876cf35a4e48c481b0cd09cdd50cfb'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:06.739844 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1180/2353] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:07:06 2022] DELETE /identity/v3/users/26876cf35a4e48c481b0cd09cdd50cfb => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:07:06.745488 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f19821-cd9a-4bbe-9659-62b82573e21a None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:06.746059 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f19821-cd9a-4bbe-9659-62b82573e21a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:06.746059 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f19821-cd9a-4bbe-9659-62b82573e21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:06.768933 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-00f19821-cd9a-4bbe-9659-62b82573e21a None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:07:06.770407 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-00f19821-cd9a-4bbe-9659-62b82573e21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:06.873392 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1174/2354] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:07:06.888155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d4de8-c902-44ee-a797-0667f74df402 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:06.893273 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-594d4de8-c902-44ee-a797-0667f74df402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:06.958356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:07:06.973596 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d4de8-c902-44ee-a797-0667f74df402 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:06.978028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec4d2a-ca57-4511-aad9-b57ae44f3c62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:06.978842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec4d2a-ca57-4511-aad9-b57ae44f3c62 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:06.979182 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec4d2a-ca57-4511-aad9-b57ae44f3c62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:06.979692 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec4d2a-ca57-4511-aad9-b57ae44f3c62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:07.004329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec4d2a-ca57-4511-aad9-b57ae44f3c62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:07.005450 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec4d2a-ca57-4511-aad9-b57ae44f3c62 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:07.019182 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1181/2355] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:07:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:07:07.429217 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f19821-cd9a-4bbe-9659-62b82573e21a None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:07.431298 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-00f19821-cd9a-4bbe-9659-62b82573e21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:07.446094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f19821-cd9a-4bbe-9659-62b82573e21a None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:07.451164 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf45a5d-bc2e-4bd1-a14d-9e88ce2ea75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:07.451882 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf45a5d-bc2e-4bd1-a14d-9e88ce2ea75b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:07.452248 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf45a5d-bc2e-4bd1-a14d-9e88ce2ea75b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:07.452592 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf45a5d-bc2e-4bd1-a14d-9e88ce2ea75b admin admin] PATH_INFO: `/v3/projects/35288fe046b047398cbba0b9350c86e3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:07.453787 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf45a5d-bc2e-4bd1-a14d-9e88ce2ea75b admin admin] RBAC: Authorizing `identity:delete_project(project_id=35288fe046b047398cbba0b9350c86e3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:07.455854 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf45a5d-bc2e-4bd1-a14d-9e88ce2ea75b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:07.457629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:07:07.514554 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-7bf45a5d-bc2e-4bd1-a14d-9e88ce2ea75b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35288fe046b047398cbba0b9350c86e3', 'request_id': 'req-7bf45a5d-bc2e-4bd1-a14d-9e88ce2ea75b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:07.523077 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-7bf45a5d-bc2e-4bd1-a14d-9e88ce2ea75b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35288fe046b047398cbba0b9350c86e3', 'request_id': 'req-7bf45a5d-bc2e-4bd1-a14d-9e88ce2ea75b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:07.532005 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-7bf45a5d-bc2e-4bd1-a14d-9e88ce2ea75b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35288fe046b047398cbba0b9350c86e3', 'request_id': 'req-7bf45a5d-bc2e-4bd1-a14d-9e88ce2ea75b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:07.544474 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-7bf45a5d-bc2e-4bd1-a14d-9e88ce2ea75b admin admin] The token cache is being invalidate because project 35288fe046b047398cbba0b9350c86e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:07:07.545429 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-7bf45a5d-bc2e-4bd1-a14d-9e88ce2ea75b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:07.546119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-7bf45a5d-bc2e-4bd1-a14d-9e88ce2ea75b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:07.548148 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1175/2356] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:07:07 2022] DELETE /identity/v3/projects/35288fe046b047398cbba0b9350c86e3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:07:07.552865 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970447e-7209-4880-80ab-34af8fd839eb None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:07.553826 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970447e-7209-4880-80ab-34af8fd839eb None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:07.554322 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970447e-7209-4880-80ab-34af8fd839eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:07.583150 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-3970447e-7209-4880-80ab-34af8fd839eb None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:07:07.587029 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3970447e-7209-4880-80ab-34af8fd839eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:07.707781 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1182/2357] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:07:07.716475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecaccf-7f21-45cf-90a7-688d7d5d4c33 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:07.716802 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecaccf-7f21-45cf-90a7-688d7d5d4c33 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:07.717170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecaccf-7f21-45cf-90a7-688d7d5d4c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:07.758810 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-b2ecaccf-7f21-45cf-90a7-688d7d5d4c33 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:07:07.760837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b2ecaccf-7f21-45cf-90a7-688d7d5d4c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:07.771306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1176/2358] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:07:07.778028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970447e-7209-4880-80ab-34af8fd839eb None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:07.794752 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970447e-7209-4880-80ab-34af8fd839eb None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:07.805079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8791f-2a95-4517-8825-b8845811f9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:07.806752 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8791f-2a95-4517-8825-b8845811f9ae admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:07.807393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8791f-2a95-4517-8825-b8845811f9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:07.807897 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8791f-2a95-4517-8825-b8845811f9ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:07.808741 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c8791f-2a95-4517-8825-b8845811f9ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:07:07.809279 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c8791f-2a95-4517-8825-b8845811f9ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:07.811400 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c8791f-2a95-4517-8825-b8845811f9ae admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:07.833314 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1183/2359] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:07:07.836080 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ecaccf-7f21-45cf-90a7-688d7d5d4c33 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:07.855157 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ecaccf-7f21-45cf-90a7-688d7d5d4c33 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:07.863254 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80a351-8707-48f9-ac88-c8d17bdb8bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:07.864257 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80a351-8707-48f9-ac88-c8d17bdb8bcc admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:07.865849 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80a351-8707-48f9-ac88-c8d17bdb8bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:07.866756 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80a351-8707-48f9-ac88-c8d17bdb8bcc admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:07.867691 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80a351-8707-48f9-ac88-c8d17bdb8bcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:07.869906 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80a351-8707-48f9-ac88-c8d17bdb8bcc admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:07.909840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1177/2360] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:07:07 2022] POST /identity/v3/projects => generated 391 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:07:07.912693 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8791f-2a95-4517-8825-b8845811f9ae admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:07.924353 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8791f-2a95-4517-8825-b8845811f9ae admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:08.013676 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a131fc-81bb-4a0e-816b-afad98e69183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:08.014444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a131fc-81bb-4a0e-816b-afad98e69183 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:08.014674 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a131fc-81bb-4a0e-816b-afad98e69183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:08.014908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a131fc-81bb-4a0e-816b-afad98e69183 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:08.015552 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a131fc-81bb-4a0e-816b-afad98e69183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:08.017877 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a131fc-81bb-4a0e-816b-afad98e69183 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:08.050370 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1184/2361] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:07:07 2022] POST /identity/v3/users => generated 296 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:07:08.051652 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80a351-8707-48f9-ac88-c8d17bdb8bcc admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:08.066724 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80a351-8707-48f9-ac88-c8d17bdb8bcc admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:08.073869 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3885e6-e1f1-4e94-b179-e4fb31de3a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:08.074963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3885e6-e1f1-4e94-b179-e4fb31de3a44 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:08.075297 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3885e6-e1f1-4e94-b179-e4fb31de3a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:08.075639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3885e6-e1f1-4e94-b179-e4fb31de3a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:08.076372 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3885e6-e1f1-4e94-b179-e4fb31de3a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:08.078127 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3885e6-e1f1-4e94-b179-e4fb31de3a44 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:08.098770 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1178/2362] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:07:08.103883 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a131fc-81bb-4a0e-816b-afad98e69183 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:08.127195 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a131fc-81bb-4a0e-816b-afad98e69183 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:08.127195 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd983d46-e5af-46fc-ac0f-6dfc44b9c54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:08.127195 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd983d46-e5af-46fc-ac0f-6dfc44b9c54a admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:08.127195 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd983d46-e5af-46fc-ac0f-6dfc44b9c54a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:08.127998 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd983d46-e5af-46fc-ac0f-6dfc44b9c54a admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:08.127998 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd983d46-e5af-46fc-ac0f-6dfc44b9c54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:08.127998 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd983d46-e5af-46fc-ac0f-6dfc44b9c54a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:08.157620 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1185/2363] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:07:08.159377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3885e6-e1f1-4e94-b179-e4fb31de3a44 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:08.173023 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3885e6-e1f1-4e94-b179-e4fb31de3a44 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:08.188345 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fb355-aed6-4134-bdc4-5d2782e2d5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:08.189569 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fb355-aed6-4134-bdc4-5d2782e2d5a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:08.191269 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fb355-aed6-4134-bdc4-5d2782e2d5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:08.191926 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fb355-aed6-4134-bdc4-5d2782e2d5a9 admin admin] PATH_INFO: `/v3/projects/3bab6b61348346bc88bb4d7bce596582/users/a80aa9b5fd664f22b319226a5ea61e10/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:08.223006 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fb355-aed6-4134-bdc4-5d2782e2d5a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bab6b61348346bc88bb4d7bce596582, user_id=a80aa9b5fd664f22b319226a5ea61e10, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:08.225926 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fb355-aed6-4134-bdc4-5d2782e2d5a9 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:08.241612 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1179/2364] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:07:08 2022] PUT /identity/v3/projects/3bab6b61348346bc88bb4d7bce596582/users/a80aa9b5fd664f22b319226a5ea61e10/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:07:08.255666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf6c35-ed7f-406b-bbd1-55da80f20378 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:08.255916 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf6c35-ed7f-406b-bbd1-55da80f20378 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:08.256190 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf6c35-ed7f-406b-bbd1-55da80f20378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:08.323551 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-46bf6c35-ed7f-406b-bbd1-55da80f20378 None None] MFA Rules not processed for user `a80aa9b5fd664f22b319226a5ea61e10`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:07:08.325113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-46bf6c35-ed7f-406b-bbd1-55da80f20378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:08.392945 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:07:08.426079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1186/2365] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:07:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:07:08.435338 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fb355-aed6-4134-bdc4-5d2782e2d5a9 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:08.441406 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1e2fb355-aed6-4134-bdc4-5d2782e2d5a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:08.471697 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf6c35-ed7f-406b-bbd1-55da80f20378 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:08.475491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-46bf6c35-ed7f-406b-bbd1-55da80f20378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:08.536774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fb355-aed6-4134-bdc4-5d2782e2d5a9 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:08.541143 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebad2f-f0b9-4e8c-8e3f-46fdf1cd497f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:08.541756 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebad2f-f0b9-4e8c-8e3f-46fdf1cd497f service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:08.542177 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebad2f-f0b9-4e8c-8e3f-46fdf1cd497f service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:08.542364 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebad2f-f0b9-4e8c-8e3f-46fdf1cd497f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:08.558833 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebad2f-f0b9-4e8c-8e3f-46fdf1cd497f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:08.561595 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebad2f-f0b9-4e8c-8e3f-46fdf1cd497f service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:08.591989 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1180/2366] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:07:08 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:07:08.602617 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf6c35-ed7f-406b-bbd1-55da80f20378 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:08.613120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b33dce-b337-4faf-892b-e7061a5dd9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:08.615427 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b33dce-b337-4faf-892b-e7061a5dd9f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:08.615776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b33dce-b337-4faf-892b-e7061a5dd9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:08.616065 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b33dce-b337-4faf-892b-e7061a5dd9f0 admin admin] PATH_INFO: `/v3/users/f7368f2c6d934517b4b71206473795f4` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:08.618626 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b33dce-b337-4faf-892b-e7061a5dd9f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7368f2c6d934517b4b71206473795f4)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:08.624776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b33dce-b337-4faf-892b-e7061a5dd9f0 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:08.759012 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f5b33dce-b337-4faf-892b-e7061a5dd9f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7368f2c6d934517b4b71206473795f4'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:08.778903 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f5b33dce-b337-4faf-892b-e7061a5dd9f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7368f2c6d934517b4b71206473795f4'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:08.807967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f5b33dce-b337-4faf-892b-e7061a5dd9f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7368f2c6d934517b4b71206473795f4'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:08.808756 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f5b33dce-b337-4faf-892b-e7061a5dd9f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7368f2c6d934517b4b71206473795f4'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:08.809434 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f5b33dce-b337-4faf-892b-e7061a5dd9f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7368f2c6d934517b4b71206473795f4'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:08.832229 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1187/2367] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:07:08 2022] DELETE /identity/v3/users/f7368f2c6d934517b4b71206473795f4 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:07:09.181438 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebad2f-f0b9-4e8c-8e3f-46fdf1cd497f service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:09.214163 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebad2f-f0b9-4e8c-8e3f-46fdf1cd497f service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:09.276893 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:07:09.327644 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c09056-b8c5-42dd-89b8-7f7b4873c09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:09.328179 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c09056-b8c5-42dd-89b8-7f7b4873c09a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:09.328542 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c09056-b8c5-42dd-89b8-7f7b4873c09a admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:09.328924 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c09056-b8c5-42dd-89b8-7f7b4873c09a admin admin] PATH_INFO: `/v3/projects/60a943ca092443e392084bb6ef44a623` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:09.330589 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c09056-b8c5-42dd-89b8-7f7b4873c09a admin admin] RBAC: Authorizing `identity:delete_project(project_id=60a943ca092443e392084bb6ef44a623)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:09.333167 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c09056-b8c5-42dd-89b8-7f7b4873c09a admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:09.411819 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c2c09056-b8c5-42dd-89b8-7f7b4873c09a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60a943ca092443e392084bb6ef44a623', 'request_id': 'req-c2c09056-b8c5-42dd-89b8-7f7b4873c09a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:09.428646 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c2c09056-b8c5-42dd-89b8-7f7b4873c09a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60a943ca092443e392084bb6ef44a623', 'request_id': 'req-c2c09056-b8c5-42dd-89b8-7f7b4873c09a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:09.438145 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c2c09056-b8c5-42dd-89b8-7f7b4873c09a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60a943ca092443e392084bb6ef44a623', 'request_id': 'req-c2c09056-b8c5-42dd-89b8-7f7b4873c09a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:09.450051 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c2c09056-b8c5-42dd-89b8-7f7b4873c09a admin admin] The token cache is being invalidate because project 60a943ca092443e392084bb6ef44a623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:07:09.450427 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c2c09056-b8c5-42dd-89b8-7f7b4873c09a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:09.451156 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c2c09056-b8c5-42dd-89b8-7f7b4873c09a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:09.456128 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1181/2368] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:07:09 2022] DELETE /identity/v3/projects/60a943ca092443e392084bb6ef44a623 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:07:09.458100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c56e7-98eb-4f0f-8faf-0db9c2832688 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:09.458409 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c56e7-98eb-4f0f-8faf-0db9c2832688 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:09.458764 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c56e7-98eb-4f0f-8faf-0db9c2832688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:09.480647 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-937c56e7-98eb-4f0f-8faf-0db9c2832688 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:07:09.482159 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-937c56e7-98eb-4f0f-8faf-0db9c2832688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:09.549880 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1188/2369] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:07:09.554630 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059cf8d-48e4-4a2c-ab5b-8fd04aafd477 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:09.554899 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059cf8d-48e4-4a2c-ab5b-8fd04aafd477 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:09.555174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059cf8d-48e4-4a2c-ab5b-8fd04aafd477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:09.578747 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-4059cf8d-48e4-4a2c-ab5b-8fd04aafd477 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:07:09.580087 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4059cf8d-48e4-4a2c-ab5b-8fd04aafd477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:09.589251 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1182/2370] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:07:09.593735 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c56e7-98eb-4f0f-8faf-0db9c2832688 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:09.601288 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:07:09.605981 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c56e7-98eb-4f0f-8faf-0db9c2832688 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:09.611967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2e247-bc70-4f33-b856-0dda01f0c426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:09.613361 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2e247-bc70-4f33-b856-0dda01f0c426 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:09.614075 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2e247-bc70-4f33-b856-0dda01f0c426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:09.614847 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2e247-bc70-4f33-b856-0dda01f0c426 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:09.615886 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2e247-bc70-4f33-b856-0dda01f0c426 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:07:09.616609 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2e247-bc70-4f33-b856-0dda01f0c426 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:09.618463 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2e247-bc70-4f33-b856-0dda01f0c426 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:09.632580 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1189/2371] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:07:09.638768 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059cf8d-48e4-4a2c-ab5b-8fd04aafd477 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:09.653072 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059cf8d-48e4-4a2c-ab5b-8fd04aafd477 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:09.663195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c81b3d-d75a-4026-9c90-dd14de92a070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:09.664037 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c81b3d-d75a-4026-9c90-dd14de92a070 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:09.664408 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c81b3d-d75a-4026-9c90-dd14de92a070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:09.664748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c81b3d-d75a-4026-9c90-dd14de92a070 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:09.665612 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c81b3d-d75a-4026-9c90-dd14de92a070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:09.668467 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c81b3d-d75a-4026-9c90-dd14de92a070 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:09.707509 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1183/2372] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:07:09 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:07:09.714885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2e247-bc70-4f33-b856-0dda01f0c426 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:09.727507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2e247-bc70-4f33-b856-0dda01f0c426 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:09.859334 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fec79-ca94-4771-ae15-d981094384b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:09.860030 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fec79-ca94-4771-ae15-d981094384b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:09.860313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fec79-ca94-4771-ae15-d981094384b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:09.860587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fec79-ca94-4771-ae15-d981094384b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:09.861279 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fec79-ca94-4771-ae15-d981094384b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:09.863316 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fec79-ca94-4771-ae15-d981094384b5 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:09.919542 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1190/2373] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:07:09 2022] POST /identity/v3/users => generated 286 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:07:09.924578 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c81b3d-d75a-4026-9c90-dd14de92a070 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:09.942649 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c81b3d-d75a-4026-9c90-dd14de92a070 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:09.951525 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95384133-5951-4cd2-a23a-820d0805febf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:09.952286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95384133-5951-4cd2-a23a-820d0805febf admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:09.952688 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95384133-5951-4cd2-a23a-820d0805febf admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:09.954246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95384133-5951-4cd2-a23a-820d0805febf admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:09.954246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95384133-5951-4cd2-a23a-820d0805febf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:09.956336 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95384133-5951-4cd2-a23a-820d0805febf admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:09.977933 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1184/2374] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:07:09.979241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fec79-ca94-4771-ae15-d981094384b5 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:09.995285 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fec79-ca94-4771-ae15-d981094384b5 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:10.004693 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b08f9f-5e43-4485-9a8b-ccbfda539ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:10.005438 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b08f9f-5e43-4485-9a8b-ccbfda539ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:10.005784 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b08f9f-5e43-4485-9a8b-ccbfda539ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:10.006363 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b08f9f-5e43-4485-9a8b-ccbfda539ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:10.007172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b08f9f-5e43-4485-9a8b-ccbfda539ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:10.009237 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b08f9f-5e43-4485-9a8b-ccbfda539ff9 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:10.026348 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1191/2375] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:07:10.027890 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95384133-5951-4cd2-a23a-820d0805febf admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:10.038893 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95384133-5951-4cd2-a23a-820d0805febf admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:10.043918 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144cb937-9b7b-4e85-8d66-a1cd5d645aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:10.046086 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cb937-9b7b-4e85-8d66-a1cd5d645aa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:10.046447 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cb937-9b7b-4e85-8d66-a1cd5d645aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:10.046793 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cb937-9b7b-4e85-8d66-a1cd5d645aa1 admin admin] PATH_INFO: `/v3/projects/003c02e1704b41318336d507d279558f/users/1013318583cf4cf5abeff8b8d6b27ff2/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:10.069920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144cb937-9b7b-4e85-8d66-a1cd5d645aa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=003c02e1704b41318336d507d279558f, user_id=1013318583cf4cf5abeff8b8d6b27ff2, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:10.073626 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144cb937-9b7b-4e85-8d66-a1cd5d645aa1 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:10.090649 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1185/2376] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:07:10 2022] PUT /identity/v3/projects/003c02e1704b41318336d507d279558f/users/1013318583cf4cf5abeff8b8d6b27ff2/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:07:10.102841 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4c22e-7216-4f6c-93f2-e81b6bbd25c3 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:10.103308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4c22e-7216-4f6c-93f2-e81b6bbd25c3 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:10.103658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4c22e-7216-4f6c-93f2-e81b6bbd25c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:10.161373 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-fcd4c22e-7216-4f6c-93f2-e81b6bbd25c3 None None] MFA Rules not processed for user `1013318583cf4cf5abeff8b8d6b27ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:07:10.162863 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-fcd4c22e-7216-4f6c-93f2-e81b6bbd25c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:10.244936 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1192/2377] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:07:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:07:10.257842 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144cb937-9b7b-4e85-8d66-a1cd5d645aa1 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:10.259652 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-144cb937-9b7b-4e85-8d66-a1cd5d645aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:10.351225 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144cb937-9b7b-4e85-8d66-a1cd5d645aa1 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:10.357304 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c7354-382b-4bd1-b51e-f91f0dc95ea2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee54ed3a092e4eef9082c4e86bd918a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:10.358566 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c7354-382b-4bd1-b51e-f91f0dc95ea2 service glance] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:10.358856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c7354-382b-4bd1-b51e-f91f0dc95ea2 service glance] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:10.359129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c7354-382b-4bd1-b51e-f91f0dc95ea2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:10.369649 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c7354-382b-4bd1-b51e-f91f0dc95ea2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:10.371250 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c7354-382b-4bd1-b51e-f91f0dc95ea2 service glance] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:10.377090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:07:10.388525 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1186/2378] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:07:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:07:12.058281 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4f521-2f45-4feb-a61e-19a1fc5ecd54 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:12.058822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4f521-2f45-4feb-a61e-19a1fc5ecd54 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:12.058822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4f521-2f45-4feb-a61e-19a1fc5ecd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:12.080852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-acd4f521-2f45-4feb-a61e-19a1fc5ecd54 None None] MFA Rules not processed for user `eb9d1149a417436bbf1577d61407c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:07:12.082206 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-acd4f521-2f45-4feb-a61e-19a1fc5ecd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:12.146726 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1193/2379] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 14 01:07:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:07:12.160962 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c7354-382b-4bd1-b51e-f91f0dc95ea2 service glance] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:12.162552 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ef2c7354-382b-4bd1-b51e-f91f0dc95ea2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:12.241049 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c7354-382b-4bd1-b51e-f91f0dc95ea2 service glance] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:12.247442 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f10dad-8f9a-4e13-8b6e-86fc6468b2e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d05652bfe542d5a2cfa39fbf7a83c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:12.248078 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f10dad-8f9a-4e13-8b6e-86fc6468b2e9 service swift] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:12.248356 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f10dad-8f9a-4e13-8b6e-86fc6468b2e9 service swift] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:12.248625 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f10dad-8f9a-4e13-8b6e-86fc6468b2e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:12.257473 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f10dad-8f9a-4e13-8b6e-86fc6468b2e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:12.259138 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f10dad-8f9a-4e13-8b6e-86fc6468b2e9 service swift] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:12.269370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1187/2380] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 14 01:07:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 01:07:13.647983 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b350a2d-fbf0-4acb-ba18-320b0fcff916 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:13.648519 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b350a2d-fbf0-4acb-ba18-320b0fcff916 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:13.648608 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b350a2d-fbf0-4acb-ba18-320b0fcff916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:13.658771 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:07:13.670549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-1b350a2d-fbf0-4acb-ba18-320b0fcff916 None None] MFA Rules not processed for user `c6b688a53f9547eba0aa9cbb1b764b63`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:07:13.671921 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1b350a2d-fbf0-4acb-ba18-320b0fcff916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:13.751291 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1194/2381] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:07:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:07:19.711788 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f10dad-8f9a-4e13-8b6e-86fc6468b2e9 service swift] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:19.713668 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-36f10dad-8f9a-4e13-8b6e-86fc6468b2e9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:19.787214 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f10dad-8f9a-4e13-8b6e-86fc6468b2e9 service swift] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:19.792736 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338afd80-c9c0-4462-83b6-b9d6d3e484fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:19.794253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338afd80-c9c0-4462-83b6-b9d6d3e484fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:19.794533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338afd80-c9c0-4462-83b6-b9d6d3e484fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:19.794806 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338afd80-c9c0-4462-83b6-b9d6d3e484fb admin admin] PATH_INFO: `/v3/users/a80aa9b5fd664f22b319226a5ea61e10` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:19.795996 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338afd80-c9c0-4462-83b6-b9d6d3e484fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a80aa9b5fd664f22b319226a5ea61e10)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:19.798010 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338afd80-c9c0-4462-83b6-b9d6d3e484fb admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:19.847722 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-338afd80-c9c0-4462-83b6-b9d6d3e484fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a80aa9b5fd664f22b319226a5ea61e10'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:19.848410 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-338afd80-c9c0-4462-83b6-b9d6d3e484fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a80aa9b5fd664f22b319226a5ea61e10'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:19.856260 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-338afd80-c9c0-4462-83b6-b9d6d3e484fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a80aa9b5fd664f22b319226a5ea61e10'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:19.875709 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-338afd80-c9c0-4462-83b6-b9d6d3e484fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a80aa9b5fd664f22b319226a5ea61e10'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:19.876443 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-338afd80-c9c0-4462-83b6-b9d6d3e484fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a80aa9b5fd664f22b319226a5ea61e10'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:19.898840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1188/2382] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:07:19 2022] DELETE /identity/v3/users/a80aa9b5fd664f22b319226a5ea61e10 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:07:19.903898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86deaa1c-27fd-4f1b-9817-94e70ca3bc53 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:19.904512 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86deaa1c-27fd-4f1b-9817-94e70ca3bc53 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:19.904670 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86deaa1c-27fd-4f1b-9817-94e70ca3bc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:19.926277 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-86deaa1c-27fd-4f1b-9817-94e70ca3bc53 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:07:19.927504 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-86deaa1c-27fd-4f1b-9817-94e70ca3bc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:20.004093 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1195/2383] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:07:20.014470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338afd80-c9c0-4462-83b6-b9d6d3e484fb admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:20.015882 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-338afd80-c9c0-4462-83b6-b9d6d3e484fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:20.031874 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:07:20.125275 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338afd80-c9c0-4462-83b6-b9d6d3e484fb admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:20.129666 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16475867-c4b2-4cc0-9d53-9341886d117a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:20.130394 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16475867-c4b2-4cc0-9d53-9341886d117a service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:20.130743 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16475867-c4b2-4cc0-9d53-9341886d117a service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:20.131088 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16475867-c4b2-4cc0-9d53-9341886d117a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:20.156340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16475867-c4b2-4cc0-9d53-9341886d117a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:20.156788 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16475867-c4b2-4cc0-9d53-9341886d117a service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:20.170550 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1189/2384] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:07:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:07:20.542813 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86deaa1c-27fd-4f1b-9817-94e70ca3bc53 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:20.545078 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-86deaa1c-27fd-4f1b-9817-94e70ca3bc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:20.560037 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86deaa1c-27fd-4f1b-9817-94e70ca3bc53 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:20.566521 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ba5ca-08b5-4400-85de-dbe402373c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:20.567511 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ba5ca-08b5-4400-85de-dbe402373c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:20.567816 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ba5ca-08b5-4400-85de-dbe402373c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:20.568208 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ba5ca-08b5-4400-85de-dbe402373c5a admin admin] PATH_INFO: `/v3/projects/3bab6b61348346bc88bb4d7bce596582` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:20.569528 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ba5ca-08b5-4400-85de-dbe402373c5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bab6b61348346bc88bb4d7bce596582)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:20.571754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ba5ca-08b5-4400-85de-dbe402373c5a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:20.634283 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-bb6ba5ca-08b5-4400-85de-dbe402373c5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bab6b61348346bc88bb4d7bce596582', 'request_id': 'req-bb6ba5ca-08b5-4400-85de-dbe402373c5a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:20.643863 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-bb6ba5ca-08b5-4400-85de-dbe402373c5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bab6b61348346bc88bb4d7bce596582', 'request_id': 'req-bb6ba5ca-08b5-4400-85de-dbe402373c5a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:20.651865 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-bb6ba5ca-08b5-4400-85de-dbe402373c5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bab6b61348346bc88bb4d7bce596582', 'request_id': 'req-bb6ba5ca-08b5-4400-85de-dbe402373c5a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:20.665067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-bb6ba5ca-08b5-4400-85de-dbe402373c5a admin admin] The token cache is being invalidate because project 3bab6b61348346bc88bb4d7bce596582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:07:20.665414 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-bb6ba5ca-08b5-4400-85de-dbe402373c5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:20.666501 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-bb6ba5ca-08b5-4400-85de-dbe402373c5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:20.669894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1196/2385] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:07:20 2022] DELETE /identity/v3/projects/3bab6b61348346bc88bb4d7bce596582 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:07:26.350124 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16475867-c4b2-4cc0-9d53-9341886d117a service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:26.351676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-16475867-c4b2-4cc0-9d53-9341886d117a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:26.364534 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16475867-c4b2-4cc0-9d53-9341886d117a service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:26.421104 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4fe74-7aa6-47c4-9002-eae1f66785a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:26.421379 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4fe74-7aa6-47c4-9002-eae1f66785a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:26.421660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4fe74-7aa6-47c4-9002-eae1f66785a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:26.421958 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4fe74-7aa6-47c4-9002-eae1f66785a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:26.423756 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4ad4fe74-7aa6-47c4-9002-eae1f66785a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:26.508309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4fe74-7aa6-47c4-9002-eae1f66785a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:26.509761 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4fe74-7aa6-47c4-9002-eae1f66785a4 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:26.520000 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1190/2386] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:07:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:07:30.660882 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:07:31.557033 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a7d59-e349-4374-bf55-41817dc356a2 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:31.557315 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a7d59-e349-4374-bf55-41817dc356a2 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:31.557587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a7d59-e349-4374-bf55-41817dc356a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:31.577994 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-b48a7d59-e349-4374-bf55-41817dc356a2 None None] MFA Rules not processed for user `eb9d1149a417436bbf1577d61407c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:07:31.579184 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b48a7d59-e349-4374-bf55-41817dc356a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:31.635321 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1197/2387] 10.222.0.20 () {58 vars in 967 bytes} [Wed Sep 14 01:07:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:07:31.647924 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4fe74-7aa6-47c4-9002-eae1f66785a4 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:31.649385 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4ad4fe74-7aa6-47c4-9002-eae1f66785a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:31.713995 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:07:31.720086 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4fe74-7aa6-47c4-9002-eae1f66785a4 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:31.724982 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875440e9-5c73-4bca-866a-ea274ce50888 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d05652bfe542d5a2cfa39fbf7a83c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:31.725575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875440e9-5c73-4bca-866a-ea274ce50888 service swift] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:31.726007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875440e9-5c73-4bca-866a-ea274ce50888 service swift] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:31.726285 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875440e9-5c73-4bca-866a-ea274ce50888 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:31.734793 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875440e9-5c73-4bca-866a-ea274ce50888 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:31.736494 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875440e9-5c73-4bca-866a-ea274ce50888 service swift] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:31.744789 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1191/2388] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 14 01:07:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 01:07:34.664009 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a7d59-e349-4374-bf55-41817dc356a2 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:34.665425 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b48a7d59-e349-4374-bf55-41817dc356a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:34.728844 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a7d59-e349-4374-bf55-41817dc356a2 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:34.733356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85939a-018e-49cb-a77b-e066ab47fa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:34.734004 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85939a-018e-49cb-a77b-e066ab47fa76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:34.734287 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85939a-018e-49cb-a77b-e066ab47fa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:34.734558 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85939a-018e-49cb-a77b-e066ab47fa76 admin admin] PATH_INFO: `/v3/users/1013318583cf4cf5abeff8b8d6b27ff2` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:34.735669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc85939a-018e-49cb-a77b-e066ab47fa76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1013318583cf4cf5abeff8b8d6b27ff2)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:34.737583 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc85939a-018e-49cb-a77b-e066ab47fa76 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:34.784099 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-dc85939a-018e-49cb-a77b-e066ab47fa76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1013318583cf4cf5abeff8b8d6b27ff2'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:34.790916 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-dc85939a-018e-49cb-a77b-e066ab47fa76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1013318583cf4cf5abeff8b8d6b27ff2'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:34.802500 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-dc85939a-018e-49cb-a77b-e066ab47fa76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1013318583cf4cf5abeff8b8d6b27ff2'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:34.803159 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-dc85939a-018e-49cb-a77b-e066ab47fa76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1013318583cf4cf5abeff8b8d6b27ff2'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:34.803766 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-dc85939a-018e-49cb-a77b-e066ab47fa76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1013318583cf4cf5abeff8b8d6b27ff2'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:34.816504 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1198/2389] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:07:34 2022] DELETE /identity/v3/users/1013318583cf4cf5abeff8b8d6b27ff2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:07:34.820986 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad493e-df45-4617-9e1c-9cba91d500ef None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:34.821436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad493e-df45-4617-9e1c-9cba91d500ef None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:34.821545 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad493e-df45-4617-9e1c-9cba91d500ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:34.842457 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-ccad493e-df45-4617-9e1c-9cba91d500ef None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:07:34.843925 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ccad493e-df45-4617-9e1c-9cba91d500ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:34.903446 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1192/2390] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:07:34.912877 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85939a-018e-49cb-a77b-e066ab47fa76 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:34.914298 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-dc85939a-018e-49cb-a77b-e066ab47fa76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:34.945057 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:07:34.982821 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85939a-018e-49cb-a77b-e066ab47fa76 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:34.988937 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93af3a9-3bf9-4b74-9776-80b77e10ca18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:34.989915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93af3a9-3bf9-4b74-9776-80b77e10ca18 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:34.990309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93af3a9-3bf9-4b74-9776-80b77e10ca18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:34.990622 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93af3a9-3bf9-4b74-9776-80b77e10ca18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:35.001468 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93af3a9-3bf9-4b74-9776-80b77e10ca18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:35.002926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93af3a9-3bf9-4b74-9776-80b77e10ca18 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:35.014829 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1199/2391] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:07:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:07:35.281310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad493e-df45-4617-9e1c-9cba91d500ef None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:35.282851 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ccad493e-df45-4617-9e1c-9cba91d500ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:35.296017 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad493e-df45-4617-9e1c-9cba91d500ef None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:35.300637 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cea8f-3fb2-4525-a630-2a104d6f34e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:35.301404 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cea8f-3fb2-4525-a630-2a104d6f34e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:35.301683 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cea8f-3fb2-4525-a630-2a104d6f34e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:35.301996 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cea8f-3fb2-4525-a630-2a104d6f34e2 admin admin] PATH_INFO: `/v3/projects/003c02e1704b41318336d507d279558f` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:35.303800 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40cea8f-3fb2-4525-a630-2a104d6f34e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=003c02e1704b41318336d507d279558f)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:35.305821 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40cea8f-3fb2-4525-a630-2a104d6f34e2 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:35.355828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d40cea8f-3fb2-4525-a630-2a104d6f34e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '003c02e1704b41318336d507d279558f', 'request_id': 'req-d40cea8f-3fb2-4525-a630-2a104d6f34e2'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:35.364965 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d40cea8f-3fb2-4525-a630-2a104d6f34e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '003c02e1704b41318336d507d279558f', 'request_id': 'req-d40cea8f-3fb2-4525-a630-2a104d6f34e2'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:35.373485 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d40cea8f-3fb2-4525-a630-2a104d6f34e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '003c02e1704b41318336d507d279558f', 'request_id': 'req-d40cea8f-3fb2-4525-a630-2a104d6f34e2'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:35.384525 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d40cea8f-3fb2-4525-a630-2a104d6f34e2 admin admin] The token cache is being invalidate because project 003c02e1704b41318336d507d279558f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:07:35.384814 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d40cea8f-3fb2-4525-a630-2a104d6f34e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:35.385454 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d40cea8f-3fb2-4525-a630-2a104d6f34e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:35.387317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1193/2392] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:07:35 2022] DELETE /identity/v3/projects/003c02e1704b41318336d507d279558f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:07:35.391877 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fd125-05c4-4575-b5d1-9e6b524918ff None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:35.392153 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fd125-05c4-4575-b5d1-9e6b524918ff None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:35.392425 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fd125-05c4-4575-b5d1-9e6b524918ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:35.413245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-1a8fd125-05c4-4575-b5d1-9e6b524918ff None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:07:35.414409 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1a8fd125-05c4-4575-b5d1-9e6b524918ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:35.477376 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1200/2393] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:07:35.485628 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134c443-963a-4711-9e1e-0fa34d4a7081 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:35.485945 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134c443-963a-4711-9e1e-0fa34d4a7081 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:35.486217 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134c443-963a-4711-9e1e-0fa34d4a7081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:35.506879 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-7134c443-963a-4711-9e1e-0fa34d4a7081 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:07:35.508073 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7134c443-963a-4711-9e1e-0fa34d4a7081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:35.516611 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1194/2394] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:07:35.520634 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fd125-05c4-4575-b5d1-9e6b524918ff None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:35.530980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fd125-05c4-4575-b5d1-9e6b524918ff None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:35.535695 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586064a8-1407-46f3-b59f-040097418d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:35.536398 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586064a8-1407-46f3-b59f-040097418d15 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:35.536681 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586064a8-1407-46f3-b59f-040097418d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:35.536949 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586064a8-1407-46f3-b59f-040097418d15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:35.537614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586064a8-1407-46f3-b59f-040097418d15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:07:35.538018 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586064a8-1407-46f3-b59f-040097418d15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:35.539638 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586064a8-1407-46f3-b59f-040097418d15 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:35.551745 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1201/2395] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:07:35.556185 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134c443-963a-4711-9e1e-0fa34d4a7081 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:35.565247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134c443-963a-4711-9e1e-0fa34d4a7081 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:35.569865 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c84245-20f5-4a22-9dda-3b3ce1ab5b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:35.570455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c84245-20f5-4a22-9dda-3b3ce1ab5b99 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:35.570727 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c84245-20f5-4a22-9dda-3b3ce1ab5b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:35.570990 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c84245-20f5-4a22-9dda-3b3ce1ab5b99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:35.571620 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c84245-20f5-4a22-9dda-3b3ce1ab5b99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:35.573528 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c84245-20f5-4a22-9dda-3b3ce1ab5b99 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:35.602475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1195/2396] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:07:35 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:07:35.606651 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586064a8-1407-46f3-b59f-040097418d15 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:35.616981 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586064a8-1407-46f3-b59f-040097418d15 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:35.676375 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4600ec-1bb4-4025-bdba-00ce4acda91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:35.676977 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4600ec-1bb4-4025-bdba-00ce4acda91d admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:35.677268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4600ec-1bb4-4025-bdba-00ce4acda91d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:35.677518 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4600ec-1bb4-4025-bdba-00ce4acda91d admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:35.678183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4600ec-1bb4-4025-bdba-00ce4acda91d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:35.680088 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4600ec-1bb4-4025-bdba-00ce4acda91d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:35.702113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1202/2397] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:07:35 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:07:35.706102 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c84245-20f5-4a22-9dda-3b3ce1ab5b99 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:35.717285 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c84245-20f5-4a22-9dda-3b3ce1ab5b99 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:35.721739 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec9f7e-dfd7-4ca9-9bfb-a9fcc16737e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:35.722360 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec9f7e-dfd7-4ca9-9bfb-a9fcc16737e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:35.722638 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec9f7e-dfd7-4ca9-9bfb-a9fcc16737e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:35.722926 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec9f7e-dfd7-4ca9-9bfb-a9fcc16737e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:35.723557 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec9f7e-dfd7-4ca9-9bfb-a9fcc16737e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:35.725139 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec9f7e-dfd7-4ca9-9bfb-a9fcc16737e7 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:35.735471 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1196/2398] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:07:35.739573 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4600ec-1bb4-4025-bdba-00ce4acda91d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:35.750508 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4600ec-1bb4-4025-bdba-00ce4acda91d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:35.755223 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc3151-5142-40f0-b6e4-27307accae1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:35.755817 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc3151-5142-40f0-b6e4-27307accae1c admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:35.756095 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc3151-5142-40f0-b6e4-27307accae1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:35.756366 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc3151-5142-40f0-b6e4-27307accae1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:35.757005 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc3151-5142-40f0-b6e4-27307accae1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:35.758627 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc3151-5142-40f0-b6e4-27307accae1c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:35.769990 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1203/2399] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:07:35.774241 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec9f7e-dfd7-4ca9-9bfb-a9fcc16737e7 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:35.784345 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec9f7e-dfd7-4ca9-9bfb-a9fcc16737e7 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:35.788933 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e4371-6248-4889-aacd-57a2c2e356ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:35.789574 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e4371-6248-4889-aacd-57a2c2e356ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:35.789871 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e4371-6248-4889-aacd-57a2c2e356ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:35.790146 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e4371-6248-4889-aacd-57a2c2e356ef admin admin] PATH_INFO: `/v3/projects/b4be3ab84fdd4161a9c03ddfb68b6d3c/users/c8c77e6242074e948f3ad4d73b28977d/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:35.804850 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e4371-6248-4889-aacd-57a2c2e356ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4be3ab84fdd4161a9c03ddfb68b6d3c, user_id=c8c77e6242074e948f3ad4d73b28977d, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:35.807511 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e4371-6248-4889-aacd-57a2c2e356ef admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:35.822383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1197/2400] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:07:35 2022] PUT /identity/v3/projects/b4be3ab84fdd4161a9c03ddfb68b6d3c/users/c8c77e6242074e948f3ad4d73b28977d/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:07:35.834233 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7913f-a8fe-4068-a4a9-cd888c6e9fb8 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:35.834518 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7913f-a8fe-4068-a4a9-cd888c6e9fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:35.834787 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7913f-a8fe-4068-a4a9-cd888c6e9fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:35.862572 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-89f7913f-a8fe-4068-a4a9-cd888c6e9fb8 None None] MFA Rules not processed for user `c8c77e6242074e948f3ad4d73b28977d`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:07:35.863827 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-89f7913f-a8fe-4068-a4a9-cd888c6e9fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:35.885102 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:07:35.934738 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1204/2401] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:07:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:07:35.949561 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e4371-6248-4889-aacd-57a2c2e356ef admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:35.951306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a51e4371-6248-4889-aacd-57a2c2e356ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:35.962304 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:07:36.020847 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e4371-6248-4889-aacd-57a2c2e356ef admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:36.024486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a350a-2427-4939-bb93-a26de130fc1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:36.025098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a350a-2427-4939-bb93-a26de130fc1f service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:36.025623 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a350a-2427-4939-bb93-a26de130fc1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:36.025915 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a350a-2427-4939-bb93-a26de130fc1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:36.035534 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a350a-2427-4939-bb93-a26de130fc1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:36.037110 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a350a-2427-4939-bb93-a26de130fc1f service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:36.048041 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1198/2402] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:07:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:07:36.074510 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7913f-a8fe-4068-a4a9-cd888c6e9fb8 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:36.140306 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7913f-a8fe-4068-a4a9-cd888c6e9fb8 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:36.144907 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97f2ae-4d87-4be7-a3e1-4bb23a1d604a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:36.145544 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97f2ae-4d87-4be7-a3e1-4bb23a1d604a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:36.145843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97f2ae-4d87-4be7-a3e1-4bb23a1d604a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:36.146117 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97f2ae-4d87-4be7-a3e1-4bb23a1d604a admin admin] PATH_INFO: `/v3/users/c8c77e6242074e948f3ad4d73b28977d` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:36.147267 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97f2ae-4d87-4be7-a3e1-4bb23a1d604a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8c77e6242074e948f3ad4d73b28977d)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:36.149199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97f2ae-4d87-4be7-a3e1-4bb23a1d604a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:36.200947 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1d97f2ae-4d87-4be7-a3e1-4bb23a1d604a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8c77e6242074e948f3ad4d73b28977d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:36.207900 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1d97f2ae-4d87-4be7-a3e1-4bb23a1d604a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8c77e6242074e948f3ad4d73b28977d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:36.220678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1d97f2ae-4d87-4be7-a3e1-4bb23a1d604a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8c77e6242074e948f3ad4d73b28977d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:36.221564 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1d97f2ae-4d87-4be7-a3e1-4bb23a1d604a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8c77e6242074e948f3ad4d73b28977d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:36.222322 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1d97f2ae-4d87-4be7-a3e1-4bb23a1d604a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8c77e6242074e948f3ad4d73b28977d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:36.235818 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1205/2403] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:07:36 2022] DELETE /identity/v3/users/c8c77e6242074e948f3ad4d73b28977d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:07:36.240253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ac328-5e19-48d3-a808-f7991362e4d8 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:36.240536 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ac328-5e19-48d3-a808-f7991362e4d8 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:36.240810 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ac328-5e19-48d3-a808-f7991362e4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:36.260777 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-d44ac328-5e19-48d3-a808-f7991362e4d8 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:07:36.262040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d44ac328-5e19-48d3-a808-f7991362e4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:36.334173 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1199/2404] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:07:36.343893 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97f2ae-4d87-4be7-a3e1-4bb23a1d604a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:36.345342 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1d97f2ae-4d87-4be7-a3e1-4bb23a1d604a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:36.392487 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:07:36.406583 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97f2ae-4d87-4be7-a3e1-4bb23a1d604a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:36.410573 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088d6ec-ef2e-4a50-9ea5-15d65fa42ed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:36.411178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088d6ec-ef2e-4a50-9ea5-15d65fa42ed7 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:36.411451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088d6ec-ef2e-4a50-9ea5-15d65fa42ed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:36.411724 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088d6ec-ef2e-4a50-9ea5-15d65fa42ed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:36.422040 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088d6ec-ef2e-4a50-9ea5-15d65fa42ed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:36.423554 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088d6ec-ef2e-4a50-9ea5-15d65fa42ed7 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:36.434272 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1206/2405] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:07:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:07:36.870808 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ac328-5e19-48d3-a808-f7991362e4d8 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:36.872971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d44ac328-5e19-48d3-a808-f7991362e4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:36.888208 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ac328-5e19-48d3-a808-f7991362e4d8 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:36.892995 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2638a92-7424-48ab-a47c-89740a983fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:36.893621 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2638a92-7424-48ab-a47c-89740a983fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:36.893934 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2638a92-7424-48ab-a47c-89740a983fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:36.894200 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2638a92-7424-48ab-a47c-89740a983fad admin admin] PATH_INFO: `/v3/projects/b4be3ab84fdd4161a9c03ddfb68b6d3c` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:36.895316 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2638a92-7424-48ab-a47c-89740a983fad admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4be3ab84fdd4161a9c03ddfb68b6d3c)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:36.897605 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2638a92-7424-48ab-a47c-89740a983fad admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:36.959008 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d2638a92-7424-48ab-a47c-89740a983fad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4be3ab84fdd4161a9c03ddfb68b6d3c', 'request_id': 'req-d2638a92-7424-48ab-a47c-89740a983fad'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:36.970696 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d2638a92-7424-48ab-a47c-89740a983fad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4be3ab84fdd4161a9c03ddfb68b6d3c', 'request_id': 'req-d2638a92-7424-48ab-a47c-89740a983fad'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:36.978469 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d2638a92-7424-48ab-a47c-89740a983fad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4be3ab84fdd4161a9c03ddfb68b6d3c', 'request_id': 'req-d2638a92-7424-48ab-a47c-89740a983fad'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:36.993616 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d2638a92-7424-48ab-a47c-89740a983fad admin admin] The token cache is being invalidate because project b4be3ab84fdd4161a9c03ddfb68b6d3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:07:36.993981 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d2638a92-7424-48ab-a47c-89740a983fad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:36.994670 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d2638a92-7424-48ab-a47c-89740a983fad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:07:36.999024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1200/2406] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:07:36 2022] DELETE /identity/v3/projects/b4be3ab84fdd4161a9c03ddfb68b6d3c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:07:46.429118 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=7 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:07:46.990131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:07:55.480942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088d6ec-ef2e-4a50-9ea5-15d65fa42ed7 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:07:55.482485 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-9088d6ec-ef2e-4a50-9ea5-15d65fa42ed7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:55.565337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088d6ec-ef2e-4a50-9ea5-15d65fa42ed7 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:07:55.627168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bf8a0-720b-4918-8686-5e55f0bd21ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abf9ab5fafe94afdb3ebe98536b5cc3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:07:55.627691 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bf8a0-720b-4918-8686-5e55f0bd21ad service placement] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:07:55.627970 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bf8a0-720b-4918-8686-5e55f0bd21ad service placement] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:07:55.628248 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bf8a0-720b-4918-8686-5e55f0bd21ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:07:55.630003 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b26bf8a0-720b-4918-8686-5e55f0bd21ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:07:55.641918 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26bf8a0-720b-4918-8686-5e55f0bd21ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:07:55.643653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26bf8a0-720b-4918-8686-5e55f0bd21ad service placement] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:07:55.654658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1207/2407] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:07:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:08:05.649633 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=58 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:08:06.173657 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf569b4-8763-4a10-b179-a3493e001b68 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:08:06.174203 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf569b4-8763-4a10-b179-a3493e001b68 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:08:06.174310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf569b4-8763-4a10-b179-a3493e001b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:08:06.193895 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-3cf569b4-8763-4a10-b179-a3493e001b68 None None] MFA Rules not processed for user `2b5730c49e61438884e3d9f4451e3b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:08:06.195103 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3cf569b4-8763-4a10-b179-a3493e001b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:08:06.248338 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1201/2408] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:08:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:08:16.241738 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=25 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:08:23.064280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365435e-aceb-4a73-aec2-b4a759365359 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:08:23.064811 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365435e-aceb-4a73-aec2-b4a759365359 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:08:23.064964 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365435e-aceb-4a73-aec2-b4a759365359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:08:23.084438 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e365435e-aceb-4a73-aec2-b4a759365359 None None] MFA Rules not processed for user `bfd8052af6ab43beae0e8d6bb3af5bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:08:23.085642 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e365435e-aceb-4a73-aec2-b4a759365359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:08:23.140096 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1208/2409] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:08:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:08:33.133054 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=25 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:08:43.388127 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e1a0f-e762-46a8-a573-5421b38addd2 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:08:43.388641 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e1a0f-e762-46a8-a573-5421b38addd2 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:08:43.388739 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e1a0f-e762-46a8-a573-5421b38addd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:08:43.408486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-a25e1a0f-e762-46a8-a573-5421b38addd2 None None] MFA Rules not processed for user `c6b688a53f9547eba0aa9cbb1b764b63`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:08:43.409669 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a25e1a0f-e762-46a8-a573-5421b38addd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:08:43.461774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1202/2410] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:08:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:08:53.455403 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=25 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:08.237490 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803ec5f-4066-48f9-b93d-37b58d82a536 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:08.238066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803ec5f-4066-48f9-b93d-37b58d82a536 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:08.238193 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803ec5f-4066-48f9-b93d-37b58d82a536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:08.257032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-c803ec5f-4066-48f9-b93d-37b58d82a536 None None] MFA Rules not processed for user `2b5730c49e61438884e3d9f4451e3b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:09:08.258251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c803ec5f-4066-48f9-b93d-37b58d82a536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:08.264852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1209/2411] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:09:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:09:18.252393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:27.271799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada2e98-21f0-4186-a7ee-0a26880a5be4 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:27.272301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada2e98-21f0-4186-a7ee-0a26880a5be4 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:27.272468 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada2e98-21f0-4186-a7ee-0a26880a5be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:27.292171 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-fada2e98-21f0-4186-a7ee-0a26880a5be4 None None] MFA Rules not processed for user `eb9d1149a417436bbf1577d61407c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:09:27.293495 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fada2e98-21f0-4186-a7ee-0a26880a5be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:27.361628 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1203/2412] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 14 01:09:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:09:27.409259 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803ec5f-4066-48f9-b93d-37b58d82a536 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:27.411219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c803ec5f-4066-48f9-b93d-37b58d82a536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:27.484704 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803ec5f-4066-48f9-b93d-37b58d82a536 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:27.491975 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e782a-0274-4d60-b9a5-06ea2b355cca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d05652bfe542d5a2cfa39fbf7a83c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:27.493213 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e782a-0274-4d60-b9a5-06ea2b355cca service swift] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:27.493636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e782a-0274-4d60-b9a5-06ea2b355cca service swift] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:27.494004 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e782a-0274-4d60-b9a5-06ea2b355cca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:27.505882 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e782a-0274-4d60-b9a5-06ea2b355cca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:27.507652 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e782a-0274-4d60-b9a5-06ea2b355cca service swift] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:27.516869 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1210/2413] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 14 01:09:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 01:09:37.354551 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=25 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:37.513532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=32 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:43.037936 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc446662-43d3-4d5b-b82b-d8f777c30f57 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:43.038849 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc446662-43d3-4d5b-b82b-d8f777c30f57 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:43.039306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc446662-43d3-4d5b-b82b-d8f777c30f57 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:43.040785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1204/2414] 10.222.0.20 () {54 vars in 921 bytes} [Wed Sep 14 01:09:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 01:09:43.055501 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb9c72-9b3c-4adb-a89a-c2b3a8cd4bde None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:43.056034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb9c72-9b3c-4adb-a89a-c2b3a8cd4bde None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:43.056034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb9c72-9b3c-4adb-a89a-c2b3a8cd4bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:43.076708 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e5cb9c72-9b3c-4adb-a89a-c2b3a8cd4bde None None] MFA Rules not processed for user `c05caac9e8b9498583780306887734be`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:09:43.077951 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e5cb9c72-9b3c-4adb-a89a-c2b3a8cd4bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:43.154167 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1211/2415] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Sep 14 01:09:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:09:43.175391 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc446662-43d3-4d5b-b82b-d8f777c30f57 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:43.177270 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fc446662-43d3-4d5b-b82b-d8f777c30f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:43.245990 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc446662-43d3-4d5b-b82b-d8f777c30f57 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:43.249536 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31885859-38fe-4d74-b7b3-8b37c0dfa94c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee54ed3a092e4eef9082c4e86bd918a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:43.250150 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31885859-38fe-4d74-b7b3-8b37c0dfa94c service glance] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:43.250423 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31885859-38fe-4d74-b7b3-8b37c0dfa94c service glance] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:43.250689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31885859-38fe-4d74-b7b3-8b37c0dfa94c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:43.261251 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31885859-38fe-4d74-b7b3-8b37c0dfa94c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:43.262713 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31885859-38fe-4d74-b7b3-8b37c0dfa94c service glance] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:43.273958 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1205/2416] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:09:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:09:43.351267 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76039eea-70a5-4cd5-8a52-4bf86521f13e None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:43.351619 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76039eea-70a5-4cd5-8a52-4bf86521f13e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:43.351843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76039eea-70a5-4cd5-8a52-4bf86521f13e None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:43.353332 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1212/2417] 10.222.0.20 () {54 vars in 921 bytes} [Wed Sep 14 01:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 01:09:43.364057 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe9882-df2a-4227-af1e-e83ed85dbe65 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:43.364340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe9882-df2a-4227-af1e-e83ed85dbe65 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:43.364798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe9882-df2a-4227-af1e-e83ed85dbe65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:43.384785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-b5fe9882-df2a-4227-af1e-e83ed85dbe65 None None] MFA Rules not processed for user `b4444b17075f4224a4da1ef501fd4eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:09:43.386030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b5fe9882-df2a-4227-af1e-e83ed85dbe65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:43.463281 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1206/2418] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Sep 14 01:09:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:09:43.476062 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76039eea-70a5-4cd5-8a52-4bf86521f13e None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:43.478371 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-76039eea-70a5-4cd5-8a52-4bf86521f13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:43.492944 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76039eea-70a5-4cd5-8a52-4bf86521f13e None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:43.497106 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259ce3f-f07a-4b12-80b8-103106f66c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:43.498056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259ce3f-f07a-4b12-80b8-103106f66c68 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:43.498332 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259ce3f-f07a-4b12-80b8-103106f66c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:43.498601 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259ce3f-f07a-4b12-80b8-103106f66c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:43.506362 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259ce3f-f07a-4b12-80b8-103106f66c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:43.507984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259ce3f-f07a-4b12-80b8-103106f66c68 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:43.516050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1213/2419] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:09:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:09:43.645395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37313ec7-3419-440c-b150-d8d7063b6f30 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:43.645983 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37313ec7-3419-440c-b150-d8d7063b6f30 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:43.646363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37313ec7-3419-440c-b150-d8d7063b6f30 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:43.648301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1207/2420] 10.222.0.20 () {54 vars in 921 bytes} [Wed Sep 14 01:09:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 01:09:43.661347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a434092-45fb-4891-ac2f-e27eb1a66598 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:43.661633 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a434092-45fb-4891-ac2f-e27eb1a66598 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:43.661957 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a434092-45fb-4891-ac2f-e27eb1a66598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:43.688643 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-2a434092-45fb-4891-ac2f-e27eb1a66598 None None] MFA Rules not processed for user `c05caac9e8b9498583780306887734be`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:09:43.689895 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2a434092-45fb-4891-ac2f-e27eb1a66598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:43.699700 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1214/2421] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Sep 14 01:09:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:09:43.711327 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37313ec7-3419-440c-b150-d8d7063b6f30 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:43.723204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37313ec7-3419-440c-b150-d8d7063b6f30 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:43.727208 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a945598-7d7f-45db-9eb9-e6ae208ede44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:43.727813 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a945598-7d7f-45db-9eb9-e6ae208ede44 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:43.728090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a945598-7d7f-45db-9eb9-e6ae208ede44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:43.728382 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a945598-7d7f-45db-9eb9-e6ae208ede44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:43.739517 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a945598-7d7f-45db-9eb9-e6ae208ede44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:43.740954 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a945598-7d7f-45db-9eb9-e6ae208ede44 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:43.752241 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1208/2422] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:09:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:09:44.579797 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a434092-45fb-4891-ac2f-e27eb1a66598 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:44.581363 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2a434092-45fb-4891-ac2f-e27eb1a66598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:44.593696 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a434092-45fb-4891-ac2f-e27eb1a66598 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:44.597675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a3c38-6d22-4073-a82d-ae92126d83b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:44.598433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a3c38-6d22-4073-a82d-ae92126d83b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:44.598769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a3c38-6d22-4073-a82d-ae92126d83b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:44.599042 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a3c38-6d22-4073-a82d-ae92126d83b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:44.601170 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4f7a3c38-6d22-4073-a82d-ae92126d83b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:44.667031 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a3c38-6d22-4073-a82d-ae92126d83b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:44.668470 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a3c38-6d22-4073-a82d-ae92126d83b5 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:44.679426 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1215/2423] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:09:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:09:45.473513 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a945598-7d7f-45db-9eb9-e6ae208ede44 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:45.492199 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a945598-7d7f-45db-9eb9-e6ae208ede44 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:45.497494 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0cea2-11d1-444c-a6ab-43fdb3393125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:45.498377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0cea2-11d1-444c-a6ab-43fdb3393125 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:45.498854 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0cea2-11d1-444c-a6ab-43fdb3393125 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:45.502520 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0cea2-11d1-444c-a6ab-43fdb3393125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:45.505504 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-0ff0cea2-11d1-444c-a6ab-43fdb3393125 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:45.527889 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0cea2-11d1-444c-a6ab-43fdb3393125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:45.529445 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0cea2-11d1-444c-a6ab-43fdb3393125 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:45.544407 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1209/2424] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:09:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:09:45.700737 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1f7d8-5823-470c-8bd7-603c59346858 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:45.701175 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1f7d8-5823-470c-8bd7-603c59346858 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:45.701274 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1f7d8-5823-470c-8bd7-603c59346858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:45.727456 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-97f1f7d8-5823-470c-8bd7-603c59346858 None None] MFA Rules not processed for user `eb9d1149a417436bbf1577d61407c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:09:45.728702 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-97f1f7d8-5823-470c-8bd7-603c59346858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:45.736251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1216/2425] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 14 01:09:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:09:45.749219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0cea2-11d1-444c-a6ab-43fdb3393125 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:45.763194 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0cea2-11d1-444c-a6ab-43fdb3393125 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:45.770206 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ec5fa-ec89-4157-8f49-a11b74e553eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d05652bfe542d5a2cfa39fbf7a83c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:45.770827 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ec5fa-ec89-4157-8f49-a11b74e553eb service swift] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:45.771114 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ec5fa-ec89-4157-8f49-a11b74e553eb service swift] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:45.771385 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ec5fa-ec89-4157-8f49-a11b74e553eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:45.780632 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ec5fa-ec89-4157-8f49-a11b74e553eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:45.782302 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ec5fa-ec89-4157-8f49-a11b74e553eb service swift] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:45.791077 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1210/2426] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 14 01:09:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 01:09:47.146700 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1f7d8-5823-470c-8bd7-603c59346858 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:47.148158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-97f1f7d8-5823-470c-8bd7-603c59346858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:47.169361 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1f7d8-5823-470c-8bd7-603c59346858 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:47.174448 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccbf03-0362-4126-a6a8-86d7d39228ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:47.175157 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccbf03-0362-4126-a6a8-86d7d39228ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:47.175502 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccbf03-0362-4126-a6a8-86d7d39228ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:47.175840 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccbf03-0362-4126-a6a8-86d7d39228ae admin admin] PATH_INFO: `/v3/users/c6b688a53f9547eba0aa9cbb1b764b63` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:47.177053 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccbf03-0362-4126-a6a8-86d7d39228ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6b688a53f9547eba0aa9cbb1b764b63)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:47.179120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccbf03-0362-4126-a6a8-86d7d39228ae admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:47.233145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f1ccbf03-0362-4126-a6a8-86d7d39228ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6b688a53f9547eba0aa9cbb1b764b63'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:09:47.239342 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:47.241619 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f1ccbf03-0362-4126-a6a8-86d7d39228ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6b688a53f9547eba0aa9cbb1b764b63'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:09:47.261708 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f1ccbf03-0362-4126-a6a8-86d7d39228ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6b688a53f9547eba0aa9cbb1b764b63'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:09:47.262592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f1ccbf03-0362-4126-a6a8-86d7d39228ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6b688a53f9547eba0aa9cbb1b764b63'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:09:47.263204 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f1ccbf03-0362-4126-a6a8-86d7d39228ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6b688a53f9547eba0aa9cbb1b764b63'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:09:47.285953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1217/2427] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:09:47 2022] DELETE /identity/v3/users/c6b688a53f9547eba0aa9cbb1b764b63 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:09:47.478076 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ec5fa-ec89-4157-8f49-a11b74e553eb service swift] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:47.514331 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ec5fa-ec89-4157-8f49-a11b74e553eb service swift] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:47.586039 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6b7f8-9275-481b-8e9c-ff15ae379769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:47.587488 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6b7f8-9275-481b-8e9c-ff15ae379769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:47.588011 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6b7f8-9275-481b-8e9c-ff15ae379769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:47.588825 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6b7f8-9275-481b-8e9c-ff15ae379769 admin admin] PATH_INFO: `/v3/projects/1f0d081d730748f587aa7a3e93653c13` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:47.590255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6b7f8-9275-481b-8e9c-ff15ae379769 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f0d081d730748f587aa7a3e93653c13)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:47.592210 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6b7f8-9275-481b-8e9c-ff15ae379769 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:47.609677 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:47.646897 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e8e6b7f8-9275-481b-8e9c-ff15ae379769 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f0d081d730748f587aa7a3e93653c13', 'request_id': 'req-e8e6b7f8-9275-481b-8e9c-ff15ae379769'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:09:47.663029 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e8e6b7f8-9275-481b-8e9c-ff15ae379769 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f0d081d730748f587aa7a3e93653c13', 'request_id': 'req-e8e6b7f8-9275-481b-8e9c-ff15ae379769'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:09:47.670292 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e8e6b7f8-9275-481b-8e9c-ff15ae379769 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f0d081d730748f587aa7a3e93653c13', 'request_id': 'req-e8e6b7f8-9275-481b-8e9c-ff15ae379769'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:09:47.693209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e8e6b7f8-9275-481b-8e9c-ff15ae379769 admin admin] The token cache is being invalidate because project 1f0d081d730748f587aa7a3e93653c13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:09:47.693957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e8e6b7f8-9275-481b-8e9c-ff15ae379769 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:09:47.694943 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e8e6b7f8-9275-481b-8e9c-ff15ae379769 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:09:47.696444 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1211/2428] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:09:47 2022] DELETE /identity/v3/projects/1f0d081d730748f587aa7a3e93653c13 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:09:47.701941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344fc84-2c63-401f-b261-12b4d6b981e5 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:47.702302 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344fc84-2c63-401f-b261-12b4d6b981e5 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:47.702870 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344fc84-2c63-401f-b261-12b4d6b981e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:47.710155 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6b7f8-9275-481b-8e9c-ff15ae379769 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:47.711639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e8e6b7f8-9275-481b-8e9c-ff15ae379769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:47.735286 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-6344fc84-2c63-401f-b261-12b4d6b981e5 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:09:47.736551 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6344fc84-2c63-401f-b261-12b4d6b981e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:47.782407 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6b7f8-9275-481b-8e9c-ff15ae379769 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:47.786988 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ccb14-b61a-46d8-a66f-62f3f2ab18f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:47.787607 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ccb14-b61a-46d8-a66f-62f3f2ab18f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:47.787885 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ccb14-b61a-46d8-a66f-62f3f2ab18f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:47.788221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ccb14-b61a-46d8-a66f-62f3f2ab18f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:47.790291 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c39ccb14-b61a-46d8-a66f-62f3f2ab18f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:47.842632 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1218/2429] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:09:47.851238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53c1ed-4b86-4d98-aac2-1757aee12dc1 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:47.851540 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53c1ed-4b86-4d98-aac2-1757aee12dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:47.852080 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53c1ed-4b86-4d98-aac2-1757aee12dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:47.876404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-5c53c1ed-4b86-4d98-aac2-1757aee12dc1 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:09:47.877642 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5c53c1ed-4b86-4d98-aac2-1757aee12dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:47.888280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1219/2430] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:09:47.893405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53c1ed-4b86-4d98-aac2-1757aee12dc1 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:47.896791 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ccb14-b61a-46d8-a66f-62f3f2ab18f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:47.898368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ccb14-b61a-46d8-a66f-62f3f2ab18f7 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:47.905976 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53c1ed-4b86-4d98-aac2-1757aee12dc1 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:47.913100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b494d-6d65-4622-bfb4-0d785b4f7fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:47.913996 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b494d-6d65-4622-bfb4-0d785b4f7fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:47.914430 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b494d-6d65-4622-bfb4-0d785b4f7fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:47.914854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b494d-6d65-4622-bfb4-0d785b4f7fd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:47.915651 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b494d-6d65-4622-bfb4-0d785b4f7fd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:09:47.916127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b494d-6d65-4622-bfb4-0d785b4f7fd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:47.918171 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b494d-6d65-4622-bfb4-0d785b4f7fd0 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:47.922082 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1212/2431] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:09:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 01:09:47.937777 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1220/2432] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:09:47.942671 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ccb14-b61a-46d8-a66f-62f3f2ab18f7 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:47.973258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ccb14-b61a-46d8-a66f-62f3f2ab18f7 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:47.980161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118afcf-db06-4703-83fe-c1d5c70ab34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:47.981101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118afcf-db06-4703-83fe-c1d5c70ab34b admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:47.981544 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118afcf-db06-4703-83fe-c1d5c70ab34b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:47.981988 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118afcf-db06-4703-83fe-c1d5c70ab34b admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:47.983065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118afcf-db06-4703-83fe-c1d5c70ab34b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:47.985155 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118afcf-db06-4703-83fe-c1d5c70ab34b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:48.017266 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1213/2433] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:09:47 2022] POST /identity/v3/projects => generated 367 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:09:48.021560 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b494d-6d65-4622-bfb4-0d785b4f7fd0 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:48.032491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b494d-6d65-4622-bfb4-0d785b4f7fd0 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:48.103516 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e71565-5dd9-4342-a958-db3fd2b99672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:48.104200 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e71565-5dd9-4342-a958-db3fd2b99672 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:48.104550 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e71565-5dd9-4342-a958-db3fd2b99672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:48.104919 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e71565-5dd9-4342-a958-db3fd2b99672 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:48.106049 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e71565-5dd9-4342-a958-db3fd2b99672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:48.108405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e71565-5dd9-4342-a958-db3fd2b99672 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:48.134683 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1221/2434] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:09:48 2022] POST /identity/v3/users => generated 284 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:09:48.138665 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118afcf-db06-4703-83fe-c1d5c70ab34b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:48.153594 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118afcf-db06-4703-83fe-c1d5c70ab34b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:48.160307 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65ce87-bb4c-4bd7-b8ee-e0134c77db68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:48.161008 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65ce87-bb4c-4bd7-b8ee-e0134c77db68 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:48.161358 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65ce87-bb4c-4bd7-b8ee-e0134c77db68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:48.161990 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65ce87-bb4c-4bd7-b8ee-e0134c77db68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:48.162837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65ce87-bb4c-4bd7-b8ee-e0134c77db68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:48.165530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65ce87-bb4c-4bd7-b8ee-e0134c77db68 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:48.177816 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1214/2435] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:09:48.181986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e71565-5dd9-4342-a958-db3fd2b99672 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:48.194633 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e71565-5dd9-4342-a958-db3fd2b99672 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:48.201655 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73415d48-26aa-434f-8a4b-e2d5f031425c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:48.202581 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73415d48-26aa-434f-8a4b-e2d5f031425c admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:48.202973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73415d48-26aa-434f-8a4b-e2d5f031425c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:48.203363 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73415d48-26aa-434f-8a4b-e2d5f031425c admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:48.204353 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73415d48-26aa-434f-8a4b-e2d5f031425c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:48.207286 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73415d48-26aa-434f-8a4b-e2d5f031425c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:48.222426 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1222/2436] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 01:09:48.226572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65ce87-bb4c-4bd7-b8ee-e0134c77db68 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:48.238062 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65ce87-bb4c-4bd7-b8ee-e0134c77db68 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:48.247047 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2ac46-15d5-49dd-922c-2f7b46e1e9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:48.247803 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2ac46-15d5-49dd-922c-2f7b46e1e9af admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:48.248149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2ac46-15d5-49dd-922c-2f7b46e1e9af admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:48.248491 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2ac46-15d5-49dd-922c-2f7b46e1e9af admin admin] PATH_INFO: `/v3/projects/692e95b7aedf4278bf4ae582248673b5/users/f779e16ad05d47cbbb410c9c8bc95237/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:48.257244 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:48.269008 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2ac46-15d5-49dd-922c-2f7b46e1e9af admin admin] RBAC: Authorizing `identity:create_grant(project_id=692e95b7aedf4278bf4ae582248673b5, user_id=f779e16ad05d47cbbb410c9c8bc95237, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:48.273175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2ac46-15d5-49dd-922c-2f7b46e1e9af admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:48.305607 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1215/2437] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:09:48 2022] PUT /identity/v3/projects/692e95b7aedf4278bf4ae582248673b5/users/f779e16ad05d47cbbb410c9c8bc95237/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:09:48.307511 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b145fa-23ff-4be3-95a4-64cd91b5abb6 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:48.307785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b145fa-23ff-4be3-95a4-64cd91b5abb6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:48.308057 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b145fa-23ff-4be3-95a4-64cd91b5abb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:48.341703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-a3b145fa-23ff-4be3-95a4-64cd91b5abb6 None None] MFA Rules not processed for user `f779e16ad05d47cbbb410c9c8bc95237`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:09:48.343122 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a3b145fa-23ff-4be3-95a4-64cd91b5abb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:48.366089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:48.432366 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1223/2438] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:09:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:09:48.444018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2ac46-15d5-49dd-922c-2f7b46e1e9af admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:48.445675 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-12c2ac46-15d5-49dd-922c-2f7b46e1e9af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:48.526247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2ac46-15d5-49dd-922c-2f7b46e1e9af admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:48.530246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45964c6f-5068-422d-be38-d9f32ba8033f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:48.530849 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45964c6f-5068-422d-be38-d9f32ba8033f service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:48.531128 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45964c6f-5068-422d-be38-d9f32ba8033f service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:48.531400 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45964c6f-5068-422d-be38-d9f32ba8033f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:48.540209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45964c6f-5068-422d-be38-d9f32ba8033f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:48.541632 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45964c6f-5068-422d-be38-d9f32ba8033f service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:48.551905 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1216/2439] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:09:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:09:52.937248 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b145fa-23ff-4be3-95a4-64cd91b5abb6 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:52.938766 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a3b145fa-23ff-4be3-95a4-64cd91b5abb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:53.040069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b145fa-23ff-4be3-95a4-64cd91b5abb6 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:53.044514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01409dbc-8afa-4f05-bc31-04a4bf0580d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:53.045221 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01409dbc-8afa-4f05-bc31-04a4bf0580d7 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:53.045573 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01409dbc-8afa-4f05-bc31-04a4bf0580d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:53.045959 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01409dbc-8afa-4f05-bc31-04a4bf0580d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:53.047868 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-01409dbc-8afa-4f05-bc31-04a4bf0580d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:53.128877 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01409dbc-8afa-4f05-bc31-04a4bf0580d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:53.130687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01409dbc-8afa-4f05-bc31-04a4bf0580d7 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:53.144670 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1224/2440] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:09:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:09:57.354681 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45964c6f-5068-422d-be38-d9f32ba8033f service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:57.418185 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45964c6f-5068-422d-be38-d9f32ba8033f service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:57.422691 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37b142-e14c-4d4c-8da2-6a3ca05bc2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:57.423332 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37b142-e14c-4d4c-8da2-6a3ca05bc2b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:57.423609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37b142-e14c-4d4c-8da2-6a3ca05bc2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:57.423896 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37b142-e14c-4d4c-8da2-6a3ca05bc2b5 admin admin] PATH_INFO: `/v3/users/f779e16ad05d47cbbb410c9c8bc95237` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:57.425293 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37b142-e14c-4d4c-8da2-6a3ca05bc2b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f779e16ad05d47cbbb410c9c8bc95237)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:57.427299 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37b142-e14c-4d4c-8da2-6a3ca05bc2b5 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:57.480570 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3b37b142-e14c-4d4c-8da2-6a3ca05bc2b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f779e16ad05d47cbbb410c9c8bc95237'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:09:57.481226 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3b37b142-e14c-4d4c-8da2-6a3ca05bc2b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f779e16ad05d47cbbb410c9c8bc95237'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:09:57.489561 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3b37b142-e14c-4d4c-8da2-6a3ca05bc2b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f779e16ad05d47cbbb410c9c8bc95237'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:09:57.503048 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3b37b142-e14c-4d4c-8da2-6a3ca05bc2b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f779e16ad05d47cbbb410c9c8bc95237'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:09:57.503773 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3b37b142-e14c-4d4c-8da2-6a3ca05bc2b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f779e16ad05d47cbbb410c9c8bc95237'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:09:57.516872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1217/2441] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:09:57 2022] DELETE /identity/v3/users/f779e16ad05d47cbbb410c9c8bc95237 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:09:57.521980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd442882-a3a1-41ea-90b2-63460c43d132 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:57.522496 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd442882-a3a1-41ea-90b2-63460c43d132 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:57.522662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd442882-a3a1-41ea-90b2-63460c43d132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:57.543279 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-fd442882-a3a1-41ea-90b2-63460c43d132 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:09:57.544666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-fd442882-a3a1-41ea-90b2-63460c43d132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:57.607085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:57.621295 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1225/2442] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:09:57.628553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37b142-e14c-4d4c-8da2-6a3ca05bc2b5 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:57.630007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3b37b142-e14c-4d4c-8da2-6a3ca05bc2b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:57.641241 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:57.698571 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37b142-e14c-4d4c-8da2-6a3ca05bc2b5 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:57.705624 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1becd66-3481-42eb-b81a-8344b73726ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:57.706335 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1becd66-3481-42eb-b81a-8344b73726ad service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:57.706677 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1becd66-3481-42eb-b81a-8344b73726ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:57.707092 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1becd66-3481-42eb-b81a-8344b73726ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:57.717615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1becd66-3481-42eb-b81a-8344b73726ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:57.719161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1becd66-3481-42eb-b81a-8344b73726ad service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:57.729472 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1218/2443] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:09:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:09:58.016326 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd442882-a3a1-41ea-90b2-63460c43d132 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:58.017954 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-fd442882-a3a1-41ea-90b2-63460c43d132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:58.034409 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd442882-a3a1-41ea-90b2-63460c43d132 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:58.048399 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4396d-c118-4334-b5b6-a371292f0d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:58.049940 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4396d-c118-4334-b5b6-a371292f0d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:58.050424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4396d-c118-4334-b5b6-a371292f0d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:58.050902 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4396d-c118-4334-b5b6-a371292f0d0f admin admin] PATH_INFO: `/v3/projects/692e95b7aedf4278bf4ae582248673b5` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:58.053248 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4396d-c118-4334-b5b6-a371292f0d0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=692e95b7aedf4278bf4ae582248673b5)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:58.055529 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4396d-c118-4334-b5b6-a371292f0d0f admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:58.113054 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-aec4396d-c118-4334-b5b6-a371292f0d0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '692e95b7aedf4278bf4ae582248673b5', 'request_id': 'req-aec4396d-c118-4334-b5b6-a371292f0d0f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:09:58.121524 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-aec4396d-c118-4334-b5b6-a371292f0d0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '692e95b7aedf4278bf4ae582248673b5', 'request_id': 'req-aec4396d-c118-4334-b5b6-a371292f0d0f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:09:58.128272 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-aec4396d-c118-4334-b5b6-a371292f0d0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '692e95b7aedf4278bf4ae582248673b5', 'request_id': 'req-aec4396d-c118-4334-b5b6-a371292f0d0f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:09:58.146458 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-aec4396d-c118-4334-b5b6-a371292f0d0f admin admin] The token cache is being invalidate because project 692e95b7aedf4278bf4ae582248673b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:09:58.146683 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-aec4396d-c118-4334-b5b6-a371292f0d0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:09:58.147337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-aec4396d-c118-4334-b5b6-a371292f0d0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:09:58.149079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1226/2444] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:09:58 2022] DELETE /identity/v3/projects/692e95b7aedf4278bf4ae582248673b5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:09:58.154136 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74705047-de02-4245-87d3-f68868d7121b None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:58.154797 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74705047-de02-4245-87d3-f68868d7121b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:58.155254 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74705047-de02-4245-87d3-f68868d7121b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:58.184761 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-74705047-de02-4245-87d3-f68868d7121b None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:09:58.186019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-74705047-de02-4245-87d3-f68868d7121b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:58.266735 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1219/2445] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:09:58.274721 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5b2d2-a5b0-4eaf-8d39-04eaf49536aa None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:58.275012 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5b2d2-a5b0-4eaf-8d39-04eaf49536aa None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:58.275549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5b2d2-a5b0-4eaf-8d39-04eaf49536aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:58.307679 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-40d5b2d2-a5b0-4eaf-8d39-04eaf49536aa None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:09:58.309003 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-40d5b2d2-a5b0-4eaf-8d39-04eaf49536aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:58.317577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1227/2446] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:09:58.322087 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74705047-de02-4245-87d3-f68868d7121b None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:58.335454 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74705047-de02-4245-87d3-f68868d7121b None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:58.340311 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07eea5-61fd-4256-a4f3-dc1042edc017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:58.341042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07eea5-61fd-4256-a4f3-dc1042edc017 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:58.341383 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07eea5-61fd-4256-a4f3-dc1042edc017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:58.341720 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07eea5-61fd-4256-a4f3-dc1042edc017 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:58.342464 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07eea5-61fd-4256-a4f3-dc1042edc017 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:09:58.342830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07eea5-61fd-4256-a4f3-dc1042edc017 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:58.344543 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07eea5-61fd-4256-a4f3-dc1042edc017 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:58.358099 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1220/2447] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 01:09:58.362722 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5b2d2-a5b0-4eaf-8d39-04eaf49536aa None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:58.372409 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5b2d2-a5b0-4eaf-8d39-04eaf49536aa None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:58.377451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a95e5-cd10-4d05-8f56-037807c481e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:58.378162 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a95e5-cd10-4d05-8f56-037807c481e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:58.378409 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a95e5-cd10-4d05-8f56-037807c481e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:58.378694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a95e5-cd10-4d05-8f56-037807c481e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:58.379393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a95e5-cd10-4d05-8f56-037807c481e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:58.381307 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a95e5-cd10-4d05-8f56-037807c481e3 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:58.415481 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1228/2448] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:09:58 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:09:58.416652 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07eea5-61fd-4256-a4f3-dc1042edc017 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:58.427567 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07eea5-61fd-4256-a4f3-dc1042edc017 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:58.493475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012ad94-5a78-40ba-9450-5336e2a4c29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:58.494338 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012ad94-5a78-40ba-9450-5336e2a4c29b admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:58.494810 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012ad94-5a78-40ba-9450-5336e2a4c29b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:58.495979 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012ad94-5a78-40ba-9450-5336e2a4c29b admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:58.496805 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a012ad94-5a78-40ba-9450-5336e2a4c29b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:58.499506 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a012ad94-5a78-40ba-9450-5336e2a4c29b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:58.527589 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1221/2449] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:09:58 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:09:58.532118 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a95e5-cd10-4d05-8f56-037807c481e3 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:58.543326 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a95e5-cd10-4d05-8f56-037807c481e3 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:58.548083 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ee7f1-9fc6-4522-9b0a-a3f1a322a194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:58.548679 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ee7f1-9fc6-4522-9b0a-a3f1a322a194 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:58.549152 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ee7f1-9fc6-4522-9b0a-a3f1a322a194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:58.549588 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ee7f1-9fc6-4522-9b0a-a3f1a322a194 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:58.550255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ee7f1-9fc6-4522-9b0a-a3f1a322a194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:58.551969 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ee7f1-9fc6-4522-9b0a-a3f1a322a194 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:58.567135 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1229/2450] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:09:58.571274 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012ad94-5a78-40ba-9450-5336e2a4c29b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:58.584083 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012ad94-5a78-40ba-9450-5336e2a4c29b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:58.588897 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254f303-8954-4cda-8651-6302db06a54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:58.589524 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254f303-8954-4cda-8651-6302db06a54c admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:58.589817 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254f303-8954-4cda-8651-6302db06a54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:58.590094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254f303-8954-4cda-8651-6302db06a54c admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:58.590733 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254f303-8954-4cda-8651-6302db06a54c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:58.592473 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254f303-8954-4cda-8651-6302db06a54c admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:58.605706 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1222/2451] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:09:58.608699 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ee7f1-9fc6-4522-9b0a-a3f1a322a194 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:58.619647 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ee7f1-9fc6-4522-9b0a-a3f1a322a194 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:58.625399 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4b14b-24a6-4fdc-af7b-b67f40644496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:58.625948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4b14b-24a6-4fdc-af7b-b67f40644496 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:58.626226 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4b14b-24a6-4fdc-af7b-b67f40644496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:58.626531 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4b14b-24a6-4fdc-af7b-b67f40644496 admin admin] PATH_INFO: `/v3/projects/ad342249125a4bfe9f112ebafc61776c/users/b0406c888c4b439eaadb093599318cbb/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:58.642306 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4b14b-24a6-4fdc-af7b-b67f40644496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad342249125a4bfe9f112ebafc61776c, user_id=b0406c888c4b439eaadb093599318cbb, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:58.645646 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4b14b-24a6-4fdc-af7b-b67f40644496 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:58.661257 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1230/2452] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:09:58 2022] PUT /identity/v3/projects/ad342249125a4bfe9f112ebafc61776c/users/b0406c888c4b439eaadb093599318cbb/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:09:58.672272 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e0d0f-84e3-449c-876c-28659c486439 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:58.672995 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e0d0f-84e3-449c-876c-28659c486439 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:58.673486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e0d0f-84e3-449c-876c-28659c486439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:58.708636 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-a51e0d0f-84e3-449c-876c-28659c486439 None None] MFA Rules not processed for user `b0406c888c4b439eaadb093599318cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:09:58.709907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a51e0d0f-84e3-449c-876c-28659c486439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:58.715864 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:58.797933 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1223/2453] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:09:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:09:58.799914 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4b14b-24a6-4fdc-af7b-b67f40644496 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:58.892751 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4b14b-24a6-4fdc-af7b-b67f40644496 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:58.898460 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ce328-0c81-4d08-8b54-43b915fadb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:58.899069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ce328-0c81-4d08-8b54-43b915fadb21 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:58.899348 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ce328-0c81-4d08-8b54-43b915fadb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:58.899623 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ce328-0c81-4d08-8b54-43b915fadb21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:58.900514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ce328-0c81-4d08-8b54-43b915fadb21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:58.902467 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ce328-0c81-4d08-8b54-43b915fadb21 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:58.932763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1231/2454] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:09:58 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:09:58.933973 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e0d0f-84e3-449c-876c-28659c486439 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:58.945080 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e0d0f-84e3-449c-876c-28659c486439 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:59.003660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf62b1-c6d5-4fa6-ad48-fb7ecb636fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:59.004260 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf62b1-c6d5-4fa6-ad48-fb7ecb636fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:59.004537 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf62b1-c6d5-4fa6-ad48-fb7ecb636fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:59.004838 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf62b1-c6d5-4fa6-ad48-fb7ecb636fe3 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:59.005460 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf62b1-c6d5-4fa6-ad48-fb7ecb636fe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:59.007426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf62b1-c6d5-4fa6-ad48-fb7ecb636fe3 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:59.028825 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1224/2455] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:09:58 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:09:59.032879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ce328-0c81-4d08-8b54-43b915fadb21 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:59.038531 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:59.045428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ce328-0c81-4d08-8b54-43b915fadb21 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:59.050957 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4652a-433c-4855-9929-9247d8fee445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:59.051579 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4652a-433c-4855-9929-9247d8fee445 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:59.051849 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4652a-433c-4855-9929-9247d8fee445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:59.052134 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4652a-433c-4855-9929-9247d8fee445 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:59.052745 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4652a-433c-4855-9929-9247d8fee445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:59.054353 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4652a-433c-4855-9929-9247d8fee445 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:59.065236 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1232/2456] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:09:59.069349 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf62b1-c6d5-4fa6-ad48-fb7ecb636fe3 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:59.079329 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf62b1-c6d5-4fa6-ad48-fb7ecb636fe3 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:59.084569 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0fbec-7d9b-40be-b337-4af376804ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:59.085160 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0fbec-7d9b-40be-b337-4af376804ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:59.085437 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0fbec-7d9b-40be-b337-4af376804ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:59.085705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0fbec-7d9b-40be-b337-4af376804ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:59.086368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0fbec-7d9b-40be-b337-4af376804ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:59.087946 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0fbec-7d9b-40be-b337-4af376804ed1 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:59.097661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1225/2457] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 01:09:59.101570 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4652a-433c-4855-9929-9247d8fee445 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:59.112105 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4652a-433c-4855-9929-9247d8fee445 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:59.117050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b04e00-32e7-407d-af00-b8d643792dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:59.117710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b04e00-32e7-407d-af00-b8d643792dfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:59.118020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b04e00-32e7-407d-af00-b8d643792dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:59.118614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b04e00-32e7-407d-af00-b8d643792dfd admin admin] PATH_INFO: `/v3/projects/917b2faf2dfe4e6896aca90c040ad913/users/b2156bd8a22749a085e1acb16df05b10/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:59.136280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b04e00-32e7-407d-af00-b8d643792dfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=917b2faf2dfe4e6896aca90c040ad913, user_id=b2156bd8a22749a085e1acb16df05b10, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:59.139186 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b04e00-32e7-407d-af00-b8d643792dfd admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:59.152181 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1233/2458] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:09:59 2022] PUT /identity/v3/projects/917b2faf2dfe4e6896aca90c040ad913/users/b2156bd8a22749a085e1acb16df05b10/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:09:59.163937 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8458e3-e6e4-412f-ab1d-fc554a4ac925 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:59.164222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8458e3-e6e4-412f-ab1d-fc554a4ac925 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:59.164496 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8458e3-e6e4-412f-ab1d-fc554a4ac925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:59.196455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-af8458e3-e6e4-412f-ab1d-fc554a4ac925 None None] MFA Rules not processed for user `b2156bd8a22749a085e1acb16df05b10`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:09:59.197706 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-af8458e3-e6e4-412f-ab1d-fc554a4ac925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:59.262195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1226/2459] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:09:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:09:59.266719 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b04e00-32e7-407d-af00-b8d643792dfd admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:59.326907 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b04e00-32e7-407d-af00-b8d643792dfd admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:59.331593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cfb7a-0cd6-4531-aacb-4c18c7598b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:59.332197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cfb7a-0cd6-4531-aacb-4c18c7598b89 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:59.332476 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cfb7a-0cd6-4531-aacb-4c18c7598b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:59.332750 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cfb7a-0cd6-4531-aacb-4c18c7598b89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:59.333379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cfb7a-0cd6-4531-aacb-4c18c7598b89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:59.335319 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cfb7a-0cd6-4531-aacb-4c18c7598b89 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:59.367064 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1234/2460] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:09:59 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:09:59.368264 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8458e3-e6e4-412f-ab1d-fc554a4ac925 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:59.380056 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8458e3-e6e4-412f-ab1d-fc554a4ac925 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:59.395903 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:59.449174 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab32b3e-61d3-418a-849d-20e1edb1326f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:59.450152 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab32b3e-61d3-418a-849d-20e1edb1326f admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:59.450432 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab32b3e-61d3-418a-849d-20e1edb1326f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:59.450702 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab32b3e-61d3-418a-849d-20e1edb1326f admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:59.451352 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab32b3e-61d3-418a-849d-20e1edb1326f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:59.453435 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab32b3e-61d3-418a-849d-20e1edb1326f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:59.499251 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1227/2461] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:09:59 2022] POST /identity/v3/users => generated 300 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:09:59.502894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cfb7a-0cd6-4531-aacb-4c18c7598b89 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:59.518495 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cfb7a-0cd6-4531-aacb-4c18c7598b89 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:59.524363 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c167d8-840f-4f85-aa81-6317189cbf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:59.525012 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c167d8-840f-4f85-aa81-6317189cbf9e admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:59.525486 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c167d8-840f-4f85-aa81-6317189cbf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:59.525755 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c167d8-840f-4f85-aa81-6317189cbf9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:59.526535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c167d8-840f-4f85-aa81-6317189cbf9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:59.528057 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c167d8-840f-4f85-aa81-6317189cbf9e admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:59.539349 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1235/2462] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:09:59.543742 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab32b3e-61d3-418a-849d-20e1edb1326f admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:59.554507 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab32b3e-61d3-418a-849d-20e1edb1326f admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:59.559373 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa1ec2-2967-4c3f-a56a-32ef8172855a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:59.560034 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa1ec2-2967-4c3f-a56a-32ef8172855a admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:59.560297 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa1ec2-2967-4c3f-a56a-32ef8172855a admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:59.560565 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa1ec2-2967-4c3f-a56a-32ef8172855a admin admin] PATH_INFO: `/v3/projects/3dff0af48f304f5b87b30d77a7ad3ca8/users/fdafab1f376240eb89d8e1aa5292f3ab/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:59.582445 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa1ec2-2967-4c3f-a56a-32ef8172855a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dff0af48f304f5b87b30d77a7ad3ca8, user_id=fdafab1f376240eb89d8e1aa5292f3ab, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:59.585274 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa1ec2-2967-4c3f-a56a-32ef8172855a admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:59.601691 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1228/2463] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:09:59 2022] PUT /identity/v3/projects/3dff0af48f304f5b87b30d77a7ad3ca8/users/fdafab1f376240eb89d8e1aa5292f3ab/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:09:59.605979 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c167d8-840f-4f85-aa81-6317189cbf9e admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:59.618890 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c167d8-840f-4f85-aa81-6317189cbf9e admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:59.681930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ba1b9-52c9-48ed-b19c-f218351628f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:59.682542 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ba1b9-52c9-48ed-b19c-f218351628f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:59.682815 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ba1b9-52c9-48ed-b19c-f218351628f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:59.683121 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ba1b9-52c9-48ed-b19c-f218351628f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:59.683755 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ba1b9-52c9-48ed-b19c-f218351628f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:59.685333 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ba1b9-52c9-48ed-b19c-f218351628f5 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:59.700287 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1236/2464] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 01:09:59.705340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa1ec2-2967-4c3f-a56a-32ef8172855a admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:59.722157 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa1ec2-2967-4c3f-a56a-32ef8172855a admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:59.729087 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9668666-dfd9-44cf-bcd7-a79b02b143db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:59.730561 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9668666-dfd9-44cf-bcd7-a79b02b143db admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:59.731037 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9668666-dfd9-44cf-bcd7-a79b02b143db admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:59.731460 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9668666-dfd9-44cf-bcd7-a79b02b143db admin admin] PATH_INFO: `/v3/projects/3dff0af48f304f5b87b30d77a7ad3ca8/users/fdafab1f376240eb89d8e1aa5292f3ab/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:59.734521 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9668666-dfd9-44cf-bcd7-a79b02b143db admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dff0af48f304f5b87b30d77a7ad3ca8, user_id=fdafab1f376240eb89d8e1aa5292f3ab, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:59.740597 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9668666-dfd9-44cf-bcd7-a79b02b143db admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:59.766077 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54dd40a-568d-4f05-b7dc-1a5ee93ae8e8 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:59.766582 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54dd40a-568d-4f05-b7dc-1a5ee93ae8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:59.766939 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54dd40a-568d-4f05-b7dc-1a5ee93ae8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:59.774222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1229/2465] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:09:59 2022] PUT /identity/v3/projects/3dff0af48f304f5b87b30d77a7ad3ca8/users/fdafab1f376240eb89d8e1aa5292f3ab/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:09:59.798579 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-f54dd40a-568d-4f05-b7dc-1a5ee93ae8e8 None None] MFA Rules not processed for user `fdafab1f376240eb89d8e1aa5292f3ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:09:59.800627 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f54dd40a-568d-4f05-b7dc-1a5ee93ae8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:59.832351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:59.887015 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1237/2466] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:09:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:09:59.898504 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9668666-dfd9-44cf-bcd7-a79b02b143db admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:09:59.900499 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f9668666-dfd9-44cf-bcd7-a79b02b143db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:09:59.963845 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9668666-dfd9-44cf-bcd7-a79b02b143db admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:09:59.967924 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf01b9-ad59-4ed7-b9e4-5cd0783b74f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:09:59.968609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf01b9-ad59-4ed7-b9e4-5cd0783b74f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:09:59.968950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf01b9-ad59-4ed7-b9e4-5cd0783b74f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:09:59.969284 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf01b9-ad59-4ed7-b9e4-5cd0783b74f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:09:59.980111 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf01b9-ad59-4ed7-b9e4-5cd0783b74f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:09:59.985525 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf01b9-ad59-4ed7-b9e4-5cd0783b74f0 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:09:59.995173 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1230/2467] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:09:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:10:00.562238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54dd40a-568d-4f05-b7dc-1a5ee93ae8e8 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:00.563677 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f54dd40a-568d-4f05-b7dc-1a5ee93ae8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:00.576151 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54dd40a-568d-4f05-b7dc-1a5ee93ae8e8 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:00.579897 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db2716-9f2b-449a-b998-b7dd2c64b311 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:00.580981 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db2716-9f2b-449a-b998-b7dd2c64b311 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:00.581260 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db2716-9f2b-449a-b998-b7dd2c64b311 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:00.581523 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db2716-9f2b-449a-b998-b7dd2c64b311 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:00.649716 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db2716-9f2b-449a-b998-b7dd2c64b311 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:00.651431 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db2716-9f2b-449a-b998-b7dd2c64b311 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:00.663072 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1238/2468] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:10:01.100208 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343b460-31bb-450d-9ca9-974b331d58f8 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:01.100891 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343b460-31bb-450d-9ca9-974b331d58f8 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:01.101167 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343b460-31bb-450d-9ca9-974b331d58f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:01.122153 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-c343b460-31bb-450d-9ca9-974b331d58f8 None None] MFA Rules not processed for user `eb9d1149a417436bbf1577d61407c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:01.123533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c343b460-31bb-450d-9ca9-974b331d58f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:01.188062 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1231/2469] 10.222.0.20 () {58 vars in 967 bytes} [Wed Sep 14 01:10:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:01.201355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db2716-9f2b-449a-b998-b7dd2c64b311 service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:01.202802 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e1db2716-9f2b-449a-b998-b7dd2c64b311 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:01.275345 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db2716-9f2b-449a-b998-b7dd2c64b311 service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:01.280506 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a5da3-1892-4fb1-b51e-113f827f6589 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d05652bfe542d5a2cfa39fbf7a83c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:01.281169 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a5da3-1892-4fb1-b51e-113f827f6589 service swift] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:01.281446 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a5da3-1892-4fb1-b51e-113f827f6589 service swift] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:01.281714 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a5da3-1892-4fb1-b51e-113f827f6589 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:01.290751 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a5da3-1892-4fb1-b51e-113f827f6589 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:01.293021 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a5da3-1892-4fb1-b51e-113f827f6589 service swift] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:01.302979 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1239/2470] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 14 01:10:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 01:10:04.786706 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343b460-31bb-450d-9ca9-974b331d58f8 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:04.804186 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343b460-31bb-450d-9ca9-974b331d58f8 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:04.809046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8682207-00ed-46c4-82ec-45ed67188b87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:04.809894 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8682207-00ed-46c4-82ec-45ed67188b87 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:04.810172 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8682207-00ed-46c4-82ec-45ed67188b87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:04.810440 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8682207-00ed-46c4-82ec-45ed67188b87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:04.827025 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:04.887510 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8682207-00ed-46c4-82ec-45ed67188b87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:04.889647 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8682207-00ed-46c4-82ec-45ed67188b87 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:04.900480 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1232/2471] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:10:07.235472 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a5da3-1892-4fb1-b51e-113f827f6589 service swift] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:07.285821 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:07.297953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a5da3-1892-4fb1-b51e-113f827f6589 service swift] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:07.302531 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03866ab5-fa32-4285-86db-8647d2b8a31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:07.303221 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03866ab5-fa32-4285-86db-8647d2b8a31a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:07.303445 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03866ab5-fa32-4285-86db-8647d2b8a31a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:07.303714 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03866ab5-fa32-4285-86db-8647d2b8a31a admin admin] PATH_INFO: `/v3/users/b0406c888c4b439eaadb093599318cbb` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:07.304843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03866ab5-fa32-4285-86db-8647d2b8a31a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0406c888c4b439eaadb093599318cbb)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:07.306836 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03866ab5-fa32-4285-86db-8647d2b8a31a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:07.352257 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-03866ab5-fa32-4285-86db-8647d2b8a31a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0406c888c4b439eaadb093599318cbb'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:07.359067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-03866ab5-fa32-4285-86db-8647d2b8a31a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0406c888c4b439eaadb093599318cbb'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:07.371572 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-03866ab5-fa32-4285-86db-8647d2b8a31a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0406c888c4b439eaadb093599318cbb'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:07.372237 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-03866ab5-fa32-4285-86db-8647d2b8a31a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0406c888c4b439eaadb093599318cbb'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:07.372854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-03866ab5-fa32-4285-86db-8647d2b8a31a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0406c888c4b439eaadb093599318cbb'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:07.387688 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1240/2472] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:10:07 2022] DELETE /identity/v3/users/b0406c888c4b439eaadb093599318cbb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:07.392278 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aecedc-08ff-4c20-8931-8f48b74f666c None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:07.393637 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aecedc-08ff-4c20-8931-8f48b74f666c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:07.393637 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aecedc-08ff-4c20-8931-8f48b74f666c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:07.412885 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-03aecedc-08ff-4c20-8931-8f48b74f666c None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:07.414104 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-03aecedc-08ff-4c20-8931-8f48b74f666c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:07.472691 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1233/2473] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:07.482950 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03866ab5-fa32-4285-86db-8647d2b8a31a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:07.484439 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-03866ab5-fa32-4285-86db-8647d2b8a31a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:07.549822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03866ab5-fa32-4285-86db-8647d2b8a31a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:07.553771 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4427c-38d0-4304-bd21-0335e77bdece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:07.554492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4427c-38d0-4304-bd21-0335e77bdece service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:07.554875 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4427c-38d0-4304-bd21-0335e77bdece service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:07.555184 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4427c-38d0-4304-bd21-0335e77bdece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:07.565216 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4427c-38d0-4304-bd21-0335e77bdece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:07.566681 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4427c-38d0-4304-bd21-0335e77bdece service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:07.577061 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1241/2474] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:10:07.962446 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aecedc-08ff-4c20-8931-8f48b74f666c None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:07.963985 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-03aecedc-08ff-4c20-8931-8f48b74f666c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:07.977565 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aecedc-08ff-4c20-8931-8f48b74f666c None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:07.988066 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3881d8-3769-4ece-acb7-370589f645b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:07.988798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3881d8-3769-4ece-acb7-370589f645b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:07.989185 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3881d8-3769-4ece-acb7-370589f645b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:07.989567 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3881d8-3769-4ece-acb7-370589f645b7 admin admin] PATH_INFO: `/v3/projects/ad342249125a4bfe9f112ebafc61776c` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:07.990839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3881d8-3769-4ece-acb7-370589f645b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad342249125a4bfe9f112ebafc61776c)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:07.992862 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3881d8-3769-4ece-acb7-370589f645b7 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:08.052812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9a3881d8-3769-4ece-acb7-370589f645b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad342249125a4bfe9f112ebafc61776c', 'request_id': 'req-9a3881d8-3769-4ece-acb7-370589f645b7'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:08.064447 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9a3881d8-3769-4ece-acb7-370589f645b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad342249125a4bfe9f112ebafc61776c', 'request_id': 'req-9a3881d8-3769-4ece-acb7-370589f645b7'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:08.072098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9a3881d8-3769-4ece-acb7-370589f645b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad342249125a4bfe9f112ebafc61776c', 'request_id': 'req-9a3881d8-3769-4ece-acb7-370589f645b7'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:08.088743 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9a3881d8-3769-4ece-acb7-370589f645b7 admin admin] The token cache is being invalidate because project ad342249125a4bfe9f112ebafc61776c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:10:08.089126 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9a3881d8-3769-4ece-acb7-370589f645b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:08.089826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9a3881d8-3769-4ece-acb7-370589f645b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:08.091460 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1234/2475] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:10:07 2022] DELETE /identity/v3/projects/ad342249125a4bfe9f112ebafc61776c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:08.095538 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4427c-38d0-4304-bd21-0335e77bdece service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:08.110614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4427c-38d0-4304-bd21-0335e77bdece service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:08.174941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f57e1-ccaa-4556-8f10-552d83a5f84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:08.175665 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f57e1-ccaa-4556-8f10-552d83a5f84c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:08.176013 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f57e1-ccaa-4556-8f10-552d83a5f84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:08.176287 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f57e1-ccaa-4556-8f10-552d83a5f84c admin admin] PATH_INFO: `/v3/users/b2156bd8a22749a085e1acb16df05b10` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:08.177503 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f57e1-ccaa-4556-8f10-552d83a5f84c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2156bd8a22749a085e1acb16df05b10)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:08.179510 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f57e1-ccaa-4556-8f10-552d83a5f84c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:08.196211 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:08.231769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-085f57e1-ccaa-4556-8f10-552d83a5f84c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2156bd8a22749a085e1acb16df05b10'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:08.239825 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-085f57e1-ccaa-4556-8f10-552d83a5f84c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2156bd8a22749a085e1acb16df05b10'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:08.253144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-085f57e1-ccaa-4556-8f10-552d83a5f84c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2156bd8a22749a085e1acb16df05b10'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:08.253978 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-085f57e1-ccaa-4556-8f10-552d83a5f84c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2156bd8a22749a085e1acb16df05b10'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:08.254638 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-085f57e1-ccaa-4556-8f10-552d83a5f84c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2156bd8a22749a085e1acb16df05b10'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:08.268366 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1242/2476] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:10:08 2022] DELETE /identity/v3/users/b2156bd8a22749a085e1acb16df05b10 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:08.556289 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3881d8-3769-4ece-acb7-370589f645b7 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:08.557882 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9a3881d8-3769-4ece-acb7-370589f645b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:08.571580 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3881d8-3769-4ece-acb7-370589f645b7 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:08.606255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:08.631163 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b90872-1c74-4fe0-96ba-c399faf32257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:08.631786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b90872-1c74-4fe0-96ba-c399faf32257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:08.632060 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b90872-1c74-4fe0-96ba-c399faf32257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:08.632328 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b90872-1c74-4fe0-96ba-c399faf32257 admin admin] PATH_INFO: `/v3/projects/917b2faf2dfe4e6896aca90c040ad913` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:08.633423 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b90872-1c74-4fe0-96ba-c399faf32257 admin admin] RBAC: Authorizing `identity:delete_project(project_id=917b2faf2dfe4e6896aca90c040ad913)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:08.635372 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b90872-1c74-4fe0-96ba-c399faf32257 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:08.682665 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-f6b90872-1c74-4fe0-96ba-c399faf32257 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '917b2faf2dfe4e6896aca90c040ad913', 'request_id': 'req-f6b90872-1c74-4fe0-96ba-c399faf32257'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:08.690244 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-f6b90872-1c74-4fe0-96ba-c399faf32257 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '917b2faf2dfe4e6896aca90c040ad913', 'request_id': 'req-f6b90872-1c74-4fe0-96ba-c399faf32257'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:08.696475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-f6b90872-1c74-4fe0-96ba-c399faf32257 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '917b2faf2dfe4e6896aca90c040ad913', 'request_id': 'req-f6b90872-1c74-4fe0-96ba-c399faf32257'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:08.707425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-f6b90872-1c74-4fe0-96ba-c399faf32257 admin admin] The token cache is being invalidate because project 917b2faf2dfe4e6896aca90c040ad913 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:10:08.707709 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-f6b90872-1c74-4fe0-96ba-c399faf32257 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:08.708353 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-f6b90872-1c74-4fe0-96ba-c399faf32257 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:08.709815 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1235/2477] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:10:08 2022] DELETE /identity/v3/projects/917b2faf2dfe4e6896aca90c040ad913 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:08.713920 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f57e1-ccaa-4556-8f10-552d83a5f84c admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:08.715313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-085f57e1-ccaa-4556-8f10-552d83a5f84c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:08.727785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f57e1-ccaa-4556-8f10-552d83a5f84c admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:08.785411 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a9701-f481-442a-8a1a-de1e4fdcaa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:08.786160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a9701-f481-442a-8a1a-de1e4fdcaa89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:08.786439 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a9701-f481-442a-8a1a-de1e4fdcaa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:08.786773 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a9701-f481-442a-8a1a-de1e4fdcaa89 admin admin] PATH_INFO: `/v3/users/fdafab1f376240eb89d8e1aa5292f3ab` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:08.788292 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a9701-f481-442a-8a1a-de1e4fdcaa89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdafab1f376240eb89d8e1aa5292f3ab)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:08.790581 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a9701-f481-442a-8a1a-de1e4fdcaa89 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:08.848469 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-2d1a9701-f481-442a-8a1a-de1e4fdcaa89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdafab1f376240eb89d8e1aa5292f3ab'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:08.856387 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-2d1a9701-f481-442a-8a1a-de1e4fdcaa89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdafab1f376240eb89d8e1aa5292f3ab'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:08.870683 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-2d1a9701-f481-442a-8a1a-de1e4fdcaa89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdafab1f376240eb89d8e1aa5292f3ab'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:08.871400 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-2d1a9701-f481-442a-8a1a-de1e4fdcaa89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdafab1f376240eb89d8e1aa5292f3ab'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:08.872004 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-2d1a9701-f481-442a-8a1a-de1e4fdcaa89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdafab1f376240eb89d8e1aa5292f3ab'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:08.888497 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1243/2478] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:10:08 2022] DELETE /identity/v3/users/fdafab1f376240eb89d8e1aa5292f3ab => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:09.162518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b90872-1c74-4fe0-96ba-c399faf32257 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:09.164030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f6b90872-1c74-4fe0-96ba-c399faf32257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:09.183961 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b90872-1c74-4fe0-96ba-c399faf32257 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:09.249117 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34d458-5b95-411b-a7dd-6fe9e01ae8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:09.249657 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34d458-5b95-411b-a7dd-6fe9e01ae8dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:09.249967 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34d458-5b95-411b-a7dd-6fe9e01ae8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:09.250236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34d458-5b95-411b-a7dd-6fe9e01ae8dd admin admin] PATH_INFO: `/v3/projects/3dff0af48f304f5b87b30d77a7ad3ca8` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:09.251321 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34d458-5b95-411b-a7dd-6fe9e01ae8dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dff0af48f304f5b87b30d77a7ad3ca8)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:09.253313 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34d458-5b95-411b-a7dd-6fe9e01ae8dd admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:09.303081 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-6e34d458-5b95-411b-a7dd-6fe9e01ae8dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dff0af48f304f5b87b30d77a7ad3ca8', 'request_id': 'req-6e34d458-5b95-411b-a7dd-6fe9e01ae8dd'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:09.310694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-6e34d458-5b95-411b-a7dd-6fe9e01ae8dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dff0af48f304f5b87b30d77a7ad3ca8', 'request_id': 'req-6e34d458-5b95-411b-a7dd-6fe9e01ae8dd'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:09.317006 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-6e34d458-5b95-411b-a7dd-6fe9e01ae8dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dff0af48f304f5b87b30d77a7ad3ca8', 'request_id': 'req-6e34d458-5b95-411b-a7dd-6fe9e01ae8dd'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:09.325136 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:09.331418 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-6e34d458-5b95-411b-a7dd-6fe9e01ae8dd admin admin] The token cache is being invalidate because project 3dff0af48f304f5b87b30d77a7ad3ca8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:10:09.331714 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-6e34d458-5b95-411b-a7dd-6fe9e01ae8dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:09.332676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-6e34d458-5b95-411b-a7dd-6fe9e01ae8dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:09.335087 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1236/2479] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:10:09 2022] DELETE /identity/v3/projects/3dff0af48f304f5b87b30d77a7ad3ca8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:09.341055 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c10112-a89a-4b9d-9bdb-3d25c9ccc3cf None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:09.341508 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c10112-a89a-4b9d-9bdb-3d25c9ccc3cf None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:09.341628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c10112-a89a-4b9d-9bdb-3d25c9ccc3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:09.366706 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-86c10112-a89a-4b9d-9bdb-3d25c9ccc3cf None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:09.367877 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-86c10112-a89a-4b9d-9bdb-3d25c9ccc3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:09.373549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:09.432577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1244/2480] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:09.441792 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b593df5-8a8e-47ba-a4ce-6e02606be73a None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:09.441792 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b593df5-8a8e-47ba-a4ce-6e02606be73a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:09.441792 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b593df5-8a8e-47ba-a4ce-6e02606be73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:09.463024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-1b593df5-8a8e-47ba-a4ce-6e02606be73a None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:09.464322 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1b593df5-8a8e-47ba-a4ce-6e02606be73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:09.473075 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1237/2481] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:09.477566 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c10112-a89a-4b9d-9bdb-3d25c9ccc3cf None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:09.492461 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c10112-a89a-4b9d-9bdb-3d25c9ccc3cf None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:09.498409 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abdece-efd2-4ccf-ae63-bca96f4cae39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:09.499556 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abdece-efd2-4ccf-ae63-bca96f4cae39 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:09.499900 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abdece-efd2-4ccf-ae63-bca96f4cae39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:09.500369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abdece-efd2-4ccf-ae63-bca96f4cae39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:09.501311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abdece-efd2-4ccf-ae63-bca96f4cae39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:10:09.501478 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abdece-efd2-4ccf-ae63-bca96f4cae39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:09.503195 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abdece-efd2-4ccf-ae63-bca96f4cae39 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:09.516509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1245/2482] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 01:10:09.521388 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b593df5-8a8e-47ba-a4ce-6e02606be73a None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:09.532277 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b593df5-8a8e-47ba-a4ce-6e02606be73a None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:09.537728 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73add6b9-353d-4995-a6f3-942bd32f2052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:09.538430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73add6b9-353d-4995-a6f3-942bd32f2052 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:09.538775 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73add6b9-353d-4995-a6f3-942bd32f2052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:09.539120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73add6b9-353d-4995-a6f3-942bd32f2052 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:09.539796 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73add6b9-353d-4995-a6f3-942bd32f2052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:09.541786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73add6b9-353d-4995-a6f3-942bd32f2052 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:09.576090 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1238/2483] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:10:09 2022] POST /identity/v3/projects => generated 393 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:09.581287 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abdece-efd2-4ccf-ae63-bca96f4cae39 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:09.592105 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abdece-efd2-4ccf-ae63-bca96f4cae39 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:09.657491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c670f7-916e-4e8f-8ebc-120300fa9d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:09.658382 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c670f7-916e-4e8f-8ebc-120300fa9d35 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:09.658769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c670f7-916e-4e8f-8ebc-120300fa9d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:09.659102 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c670f7-916e-4e8f-8ebc-120300fa9d35 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:09.659942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c670f7-916e-4e8f-8ebc-120300fa9d35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:09.662368 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c670f7-916e-4e8f-8ebc-120300fa9d35 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:09.690027 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1246/2484] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:10:09 2022] POST /identity/v3/users => generated 297 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:09.692399 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73add6b9-353d-4995-a6f3-942bd32f2052 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:09.704972 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73add6b9-353d-4995-a6f3-942bd32f2052 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:09.710436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29821aeb-5c60-41dd-b15c-65adc758d0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:09.711053 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29821aeb-5c60-41dd-b15c-65adc758d0ab admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:09.711327 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29821aeb-5c60-41dd-b15c-65adc758d0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:09.711595 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29821aeb-5c60-41dd-b15c-65adc758d0ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:09.712242 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29821aeb-5c60-41dd-b15c-65adc758d0ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:09.713857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29821aeb-5c60-41dd-b15c-65adc758d0ab admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:09.724744 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1239/2485] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:09.729012 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c670f7-916e-4e8f-8ebc-120300fa9d35 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:09.739619 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c670f7-916e-4e8f-8ebc-120300fa9d35 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:09.744710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c4fbc-5c31-43e4-a56d-2b981220f484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:09.745305 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c4fbc-5c31-43e4-a56d-2b981220f484 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:09.745585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c4fbc-5c31-43e4-a56d-2b981220f484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:09.745889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c4fbc-5c31-43e4-a56d-2b981220f484 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:09.746525 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c4fbc-5c31-43e4-a56d-2b981220f484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:09.748139 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c4fbc-5c31-43e4-a56d-2b981220f484 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:09.758802 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1247/2486] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:09.762783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29821aeb-5c60-41dd-b15c-65adc758d0ab admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:09.772671 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29821aeb-5c60-41dd-b15c-65adc758d0ab admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:09.777531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab74c39-2865-4294-8839-3af10cb44c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:09.778221 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab74c39-2865-4294-8839-3af10cb44c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:09.778494 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab74c39-2865-4294-8839-3af10cb44c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:09.779040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab74c39-2865-4294-8839-3af10cb44c45 admin admin] PATH_INFO: `/v3/projects/b587ba900c9b4b9c93ffa23fd536b525/users/dd9ccfbf0fa740c2a76faf4f5f40ddc3/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:09.794769 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab74c39-2865-4294-8839-3af10cb44c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b587ba900c9b4b9c93ffa23fd536b525, user_id=dd9ccfbf0fa740c2a76faf4f5f40ddc3, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:09.797416 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab74c39-2865-4294-8839-3af10cb44c45 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:09.812849 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1240/2487] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:10:09 2022] PUT /identity/v3/projects/b587ba900c9b4b9c93ffa23fd536b525/users/dd9ccfbf0fa740c2a76faf4f5f40ddc3/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:09.825903 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778df761-cbe0-4708-b94b-6df927d153fb None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:09.826184 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778df761-cbe0-4708-b94b-6df927d153fb None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:09.826451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778df761-cbe0-4708-b94b-6df927d153fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:09.856661 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-778df761-cbe0-4708-b94b-6df927d153fb None None] MFA Rules not processed for user `dd9ccfbf0fa740c2a76faf4f5f40ddc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:09.858028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-778df761-cbe0-4708-b94b-6df927d153fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:09.924165 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1248/2488] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:09.928684 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab74c39-2865-4294-8839-3af10cb44c45 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:09.998240 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab74c39-2865-4294-8839-3af10cb44c45 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:10.004046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add68d9-225f-4fde-9ef7-713271a40c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:10.004683 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add68d9-225f-4fde-9ef7-713271a40c35 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:10.004963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add68d9-225f-4fde-9ef7-713271a40c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:10.005234 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add68d9-225f-4fde-9ef7-713271a40c35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:10.005892 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add68d9-225f-4fde-9ef7-713271a40c35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:10.007800 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add68d9-225f-4fde-9ef7-713271a40c35 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:10.039543 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1241/2489] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:10:09 2022] POST /identity/v3/projects => generated 393 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:10.040636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778df761-cbe0-4708-b94b-6df927d153fb None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:10.052191 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778df761-cbe0-4708-b94b-6df927d153fb None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:10.055984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:10.113531 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15347e-db31-470b-b078-b75913822a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:10.114227 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15347e-db31-470b-b078-b75913822a5d admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:10.114528 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15347e-db31-470b-b078-b75913822a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:10.114801 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15347e-db31-470b-b078-b75913822a5d admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:10.115495 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15347e-db31-470b-b078-b75913822a5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:10.117585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15347e-db31-470b-b078-b75913822a5d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:10.140485 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1249/2490] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:10:10 2022] POST /identity/v3/users => generated 303 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:10:10.144668 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add68d9-225f-4fde-9ef7-713271a40c35 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:10.155327 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add68d9-225f-4fde-9ef7-713271a40c35 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:10.160627 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071275c-3336-454a-aa4c-235c609cc71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:10.161218 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071275c-3336-454a-aa4c-235c609cc71c admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:10.161496 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071275c-3336-454a-aa4c-235c609cc71c admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:10.161770 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071275c-3336-454a-aa4c-235c609cc71c admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:10.162442 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071275c-3336-454a-aa4c-235c609cc71c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:10.164047 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071275c-3336-454a-aa4c-235c609cc71c admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:10.175919 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1242/2491] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:10.180432 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15347e-db31-470b-b078-b75913822a5d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:10.195811 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15347e-db31-470b-b078-b75913822a5d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:10.201498 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514dc9bc-abed-479a-b8b4-8742c95bf5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:10.202197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514dc9bc-abed-479a-b8b4-8742c95bf5e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:10.202477 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514dc9bc-abed-479a-b8b4-8742c95bf5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:10.202748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514dc9bc-abed-479a-b8b4-8742c95bf5e4 admin admin] PATH_INFO: `/v3/projects/373bdbb785f941a1aff4f6b1b3431481/users/115f59dce58f4a6dac33b87c57c42f51/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:10.218222 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514dc9bc-abed-479a-b8b4-8742c95bf5e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=373bdbb785f941a1aff4f6b1b3431481, user_id=115f59dce58f4a6dac33b87c57c42f51, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:10.220926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514dc9bc-abed-479a-b8b4-8742c95bf5e4 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:10.236430 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1250/2492] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:10:10 2022] PUT /identity/v3/projects/373bdbb785f941a1aff4f6b1b3431481/users/115f59dce58f4a6dac33b87c57c42f51/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:10.240593 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071275c-3336-454a-aa4c-235c609cc71c admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:10.250431 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071275c-3336-454a-aa4c-235c609cc71c admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:10.306976 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe4ca6-7841-4c13-b578-ee24238c3197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:10.307453 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe4ca6-7841-4c13-b578-ee24238c3197 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:10.307718 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe4ca6-7841-4c13-b578-ee24238c3197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:10.307986 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe4ca6-7841-4c13-b578-ee24238c3197 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:10.308613 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe4ca6-7841-4c13-b578-ee24238c3197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:10.310233 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe4ca6-7841-4c13-b578-ee24238c3197 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:10.320523 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1243/2493] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:10.324854 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514dc9bc-abed-479a-b8b4-8742c95bf5e4 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:10.335527 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514dc9bc-abed-479a-b8b4-8742c95bf5e4 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:10.340068 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27685681-4bbd-423a-adc3-c1f19bbdf430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:10.340711 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27685681-4bbd-423a-adc3-c1f19bbdf430 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:10.340994 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27685681-4bbd-423a-adc3-c1f19bbdf430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:10.341271 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27685681-4bbd-423a-adc3-c1f19bbdf430 admin admin] PATH_INFO: `/v3/projects/373bdbb785f941a1aff4f6b1b3431481/users/115f59dce58f4a6dac33b87c57c42f51/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:10.343549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27685681-4bbd-423a-adc3-c1f19bbdf430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=373bdbb785f941a1aff4f6b1b3431481, user_id=115f59dce58f4a6dac33b87c57c42f51, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:10.346149 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27685681-4bbd-423a-adc3-c1f19bbdf430 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:10.356796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1251/2494] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:10:10 2022] PUT /identity/v3/projects/373bdbb785f941a1aff4f6b1b3431481/users/115f59dce58f4a6dac33b87c57c42f51/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:10.367616 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309dc767-54a2-4030-a6b4-85d15d8273a1 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:10.367900 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309dc767-54a2-4030-a6b4-85d15d8273a1 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:10.368178 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309dc767-54a2-4030-a6b4-85d15d8273a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:10.376041 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:10.400994 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-309dc767-54a2-4030-a6b4-85d15d8273a1 None None] MFA Rules not processed for user `115f59dce58f4a6dac33b87c57c42f51`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:10.402396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-309dc767-54a2-4030-a6b4-85d15d8273a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:10.472912 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1244/2495] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:10 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:10.484890 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27685681-4bbd-423a-adc3-c1f19bbdf430 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:10.487139 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-27685681-4bbd-423a-adc3-c1f19bbdf430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:10.549889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27685681-4bbd-423a-adc3-c1f19bbdf430 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:10.553484 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01e08f-4e22-4296-9601-00a9bbfab7ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:10.554120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01e08f-4e22-4296-9601-00a9bbfab7ee service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:10.554396 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01e08f-4e22-4296-9601-00a9bbfab7ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:10.554663 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01e08f-4e22-4296-9601-00a9bbfab7ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:10.563513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01e08f-4e22-4296-9601-00a9bbfab7ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:10.564859 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01e08f-4e22-4296-9601-00a9bbfab7ee service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:10.574100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1252/2496] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:10 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:10:10.623966 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309dc767-54a2-4030-a6b4-85d15d8273a1 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:10.625513 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-309dc767-54a2-4030-a6b4-85d15d8273a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:10.644063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309dc767-54a2-4030-a6b4-85d15d8273a1 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:10.647797 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a444ccd-df22-4102-b54f-0b076111ee86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:10.647797 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a444ccd-df22-4102-b54f-0b076111ee86 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:10.647797 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a444ccd-df22-4102-b54f-0b076111ee86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:10.647797 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a444ccd-df22-4102-b54f-0b076111ee86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:10.689524 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01e08f-4e22-4296-9601-00a9bbfab7ee service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:10.690979 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2e01e08f-4e22-4296-9601-00a9bbfab7ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:10.709910 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a444ccd-df22-4102-b54f-0b076111ee86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:10.711418 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a444ccd-df22-4102-b54f-0b076111ee86 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:10.720750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1245/2497] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:10 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:10:10.756472 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01e08f-4e22-4296-9601-00a9bbfab7ee service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:10.760256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddc440-069c-48ce-8f17-d77824d4c824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:10.760858 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddc440-069c-48ce-8f17-d77824d4c824 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:10.761156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddc440-069c-48ce-8f17-d77824d4c824 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:10.761430 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddc440-069c-48ce-8f17-d77824d4c824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:10.763233 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b4ddc440-069c-48ce-8f17-d77824d4c824 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:10.778817 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:10.834316 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ddc440-069c-48ce-8f17-d77824d4c824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:10.835932 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ddc440-069c-48ce-8f17-d77824d4c824 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:10.846308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1253/2498] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 01:10:14.158640 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a444ccd-df22-4102-b54f-0b076111ee86 service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:14.160102 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4a444ccd-df22-4102-b54f-0b076111ee86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:14.245611 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddc440-069c-48ce-8f17-d77824d4c824 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:14.247847 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b4ddc440-069c-48ce-8f17-d77824d4c824 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:14.263441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a444ccd-df22-4102-b54f-0b076111ee86 service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:14.266311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddc440-069c-48ce-8f17-d77824d4c824 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:14.270294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a45aa-64dd-410a-b241-50e9d42b121a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abf9ab5fafe94afdb3ebe98536b5cc3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:14.270903 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a45aa-64dd-410a-b241-50e9d42b121a service placement] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:14.271292 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a45aa-64dd-410a-b241-50e9d42b121a service placement] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:14.271443 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a45aa-64dd-410a-b241-50e9d42b121a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:14.276456 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-498a45aa-64dd-410a-b241-50e9d42b121a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:14.283183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d682d-6fb8-45b2-8789-dfbdfcca8ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:14.284726 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d682d-6fb8-45b2-8789-dfbdfcca8ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:14.285017 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d682d-6fb8-45b2-8789-dfbdfcca8ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:14.285353 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d682d-6fb8-45b2-8789-dfbdfcca8ce8 admin admin] PATH_INFO: `/v3/users/2b5730c49e61438884e3d9f4451e3b9a` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:14.287711 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d682d-6fb8-45b2-8789-dfbdfcca8ce8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b5730c49e61438884e3d9f4451e3b9a)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:14.289004 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d682d-6fb8-45b2-8789-dfbdfcca8ce8 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:14.289940 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a45aa-64dd-410a-b241-50e9d42b121a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:14.291589 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a45aa-64dd-410a-b241-50e9d42b121a service placement] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:14.315812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1246/2499] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:10:14.316858 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a45aa-64dd-410a-b241-50e9d42b121a service placement] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:14.341033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a45aa-64dd-410a-b241-50e9d42b121a service placement] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:14.349900 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5f536-5ba3-47e7-a758-fa642fadacc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:14.350685 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5f536-5ba3-47e7-a758-fa642fadacc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:14.350970 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5f536-5ba3-47e7-a758-fa642fadacc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:14.351243 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5f536-5ba3-47e7-a758-fa642fadacc5 admin admin] PATH_INFO: `/v3/users/dd9ccfbf0fa740c2a76faf4f5f40ddc3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:14.352580 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5f536-5ba3-47e7-a758-fa642fadacc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd9ccfbf0fa740c2a76faf4f5f40ddc3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:14.354542 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5f536-5ba3-47e7-a758-fa642fadacc5 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:14.361746 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-a16d682d-6fb8-45b2-8789-dfbdfcca8ce8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b5730c49e61438884e3d9f4451e3b9a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:14.372475 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-a16d682d-6fb8-45b2-8789-dfbdfcca8ce8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b5730c49e61438884e3d9f4451e3b9a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:14.375386 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:14.386648 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-a16d682d-6fb8-45b2-8789-dfbdfcca8ce8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b5730c49e61438884e3d9f4451e3b9a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:14.387694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-a16d682d-6fb8-45b2-8789-dfbdfcca8ce8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b5730c49e61438884e3d9f4451e3b9a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:14.388598 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-a16d682d-6fb8-45b2-8789-dfbdfcca8ce8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b5730c49e61438884e3d9f4451e3b9a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:14.404594 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1254/2500] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:10:14 2022] DELETE /identity/v3/users/2b5730c49e61438884e3d9f4451e3b9a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:14.414410 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c2d5f536-5ba3-47e7-a758-fa642fadacc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd9ccfbf0fa740c2a76faf4f5f40ddc3'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:14.415072 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c2d5f536-5ba3-47e7-a758-fa642fadacc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd9ccfbf0fa740c2a76faf4f5f40ddc3'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:14.421927 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c2d5f536-5ba3-47e7-a758-fa642fadacc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd9ccfbf0fa740c2a76faf4f5f40ddc3'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:14.434760 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c2d5f536-5ba3-47e7-a758-fa642fadacc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd9ccfbf0fa740c2a76faf4f5f40ddc3'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:14.435474 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c2d5f536-5ba3-47e7-a758-fa642fadacc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd9ccfbf0fa740c2a76faf4f5f40ddc3'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:14.449307 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1247/2501] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:10:14 2022] DELETE /identity/v3/users/dd9ccfbf0fa740c2a76faf4f5f40ddc3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:14.453589 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06c6b5-da63-404a-9ad5-0b86f1b888f4 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:14.453977 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06c6b5-da63-404a-9ad5-0b86f1b888f4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:14.454256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06c6b5-da63-404a-9ad5-0b86f1b888f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:14.474320 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-7d06c6b5-da63-404a-9ad5-0b86f1b888f4 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:14.475540 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7d06c6b5-da63-404a-9ad5-0b86f1b888f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:14.538704 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1255/2502] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:14.548232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5f536-5ba3-47e7-a758-fa642fadacc5 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:14.550323 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c2d5f536-5ba3-47e7-a758-fa642fadacc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:14.587648 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06c6b5-da63-404a-9ad5-0b86f1b888f4 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:14.589280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7d06c6b5-da63-404a-9ad5-0b86f1b888f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:14.602747 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06c6b5-da63-404a-9ad5-0b86f1b888f4 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:14.607838 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb1d4c-8e36-4ddd-9455-7e92f7cd10ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:14.608251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb1d4c-8e36-4ddd-9455-7e92f7cd10ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:14.608560 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb1d4c-8e36-4ddd-9455-7e92f7cd10ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:14.608989 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb1d4c-8e36-4ddd-9455-7e92f7cd10ce admin admin] PATH_INFO: `/v3/projects/a096c51fd3034ca9ae0b71a8cbb1af17` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:14.610163 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb1d4c-8e36-4ddd-9455-7e92f7cd10ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=a096c51fd3034ca9ae0b71a8cbb1af17)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:14.612810 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb1d4c-8e36-4ddd-9455-7e92f7cd10ce admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:14.616051 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5f536-5ba3-47e7-a758-fa642fadacc5 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:14.619887 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0ba3b-a64b-44d8-9a87-a1dea8929d33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:14.620396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0ba3b-a64b-44d8-9a87-a1dea8929d33 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:14.620716 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0ba3b-a64b-44d8-9a87-a1dea8929d33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:14.620936 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0ba3b-a64b-44d8-9a87-a1dea8929d33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:14.630822 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0ba3b-a64b-44d8-9a87-a1dea8929d33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:14.632247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0ba3b-a64b-44d8-9a87-a1dea8929d33 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:14.636141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:14.643509 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1248/2503] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:10:14.664982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-bbfb1d4c-8e36-4ddd-9455-7e92f7cd10ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a096c51fd3034ca9ae0b71a8cbb1af17', 'request_id': 'req-bbfb1d4c-8e36-4ddd-9455-7e92f7cd10ce'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:14.673343 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-bbfb1d4c-8e36-4ddd-9455-7e92f7cd10ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a096c51fd3034ca9ae0b71a8cbb1af17', 'request_id': 'req-bbfb1d4c-8e36-4ddd-9455-7e92f7cd10ce'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:14.680436 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-bbfb1d4c-8e36-4ddd-9455-7e92f7cd10ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a096c51fd3034ca9ae0b71a8cbb1af17', 'request_id': 'req-bbfb1d4c-8e36-4ddd-9455-7e92f7cd10ce'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:14.691759 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-bbfb1d4c-8e36-4ddd-9455-7e92f7cd10ce admin admin] The token cache is being invalidate because project a096c51fd3034ca9ae0b71a8cbb1af17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:10:14.692050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-bbfb1d4c-8e36-4ddd-9455-7e92f7cd10ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:14.692710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-bbfb1d4c-8e36-4ddd-9455-7e92f7cd10ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:14.694288 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1256/2504] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:10:14 2022] DELETE /identity/v3/projects/a096c51fd3034ca9ae0b71a8cbb1af17 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:14.699752 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd549f-6326-45ce-9b14-d98a4730e182 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:14.700131 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd549f-6326-45ce-9b14-d98a4730e182 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:14.700558 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd549f-6326-45ce-9b14-d98a4730e182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:14.723815 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-f6dd549f-6326-45ce-9b14-d98a4730e182 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:14.725054 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f6dd549f-6326-45ce-9b14-d98a4730e182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:14.795064 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1249/2505] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:14.797415 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c13d4-0259-48c2-bf4d-4370a053c53d None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:14.797979 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c13d4-0259-48c2-bf4d-4370a053c53d None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:14.798261 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c13d4-0259-48c2-bf4d-4370a053c53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:14.820368 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e34c13d4-0259-48c2-bf4d-4370a053c53d None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:14.821583 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e34c13d4-0259-48c2-bf4d-4370a053c53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:14.830316 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1257/2506] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:10:14.834539 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd549f-6326-45ce-9b14-d98a4730e182 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:14.846278 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd549f-6326-45ce-9b14-d98a4730e182 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:14.851299 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e2b91-cdfc-404c-a176-51c3cc49d31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:14.851899 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e2b91-cdfc-404c-a176-51c3cc49d31a admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:14.852178 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e2b91-cdfc-404c-a176-51c3cc49d31a admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:14.852454 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e2b91-cdfc-404c-a176-51c3cc49d31a admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:14.853141 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e2b91-cdfc-404c-a176-51c3cc49d31a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:10:14.853376 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e2b91-cdfc-404c-a176-51c3cc49d31a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:14.855213 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e2b91-cdfc-404c-a176-51c3cc49d31a admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:14.878489 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1250/2507] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:10:14.882816 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c13d4-0259-48c2-bf4d-4370a053c53d None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:14.892257 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c13d4-0259-48c2-bf4d-4370a053c53d None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:14.898172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2aa5a9-d66b-4909-898f-c45229f8a6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:14.898928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aa5a9-d66b-4909-898f-c45229f8a6fd admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:14.899276 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aa5a9-d66b-4909-898f-c45229f8a6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:14.899644 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aa5a9-d66b-4909-898f-c45229f8a6fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:14.901076 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2aa5a9-d66b-4909-898f-c45229f8a6fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:14.902685 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2aa5a9-d66b-4909-898f-c45229f8a6fd admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:14.934184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e2b91-cdfc-404c-a176-51c3cc49d31a admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:14.934619 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1258/2508] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:10:14 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:14.936382 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-263e2b91-cdfc-404c-a176-51c3cc49d31a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:14.938731 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2aa5a9-d66b-4909-898f-c45229f8a6fd admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:14.951395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e2b91-cdfc-404c-a176-51c3cc49d31a admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:14.970056 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:15.022350 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5deebaa-edc2-44ea-ac90-9f0cdbd1318f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:15.022977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deebaa-edc2-44ea-ac90-9f0cdbd1318f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:15.023256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deebaa-edc2-44ea-ac90-9f0cdbd1318f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:15.023528 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deebaa-edc2-44ea-ac90-9f0cdbd1318f admin admin] PATH_INFO: `/v3/projects/b587ba900c9b4b9c93ffa23fd536b525` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:15.024187 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2aa5a9-d66b-4909-898f-c45229f8a6fd admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:15.024662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5deebaa-edc2-44ea-ac90-9f0cdbd1318f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b587ba900c9b4b9c93ffa23fd536b525)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:15.026868 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5deebaa-edc2-44ea-ac90-9f0cdbd1318f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:15.029262 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9caad8-e94e-4dbf-b4be-368ee77b091d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:15.029893 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9caad8-e94e-4dbf-b4be-368ee77b091d admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:15.030177 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9caad8-e94e-4dbf-b4be-368ee77b091d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:15.030453 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9caad8-e94e-4dbf-b4be-368ee77b091d admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:15.031083 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9caad8-e94e-4dbf-b4be-368ee77b091d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:15.033025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9caad8-e94e-4dbf-b4be-368ee77b091d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:15.055975 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1259/2509] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:10:14 2022] POST /identity/v3/users => generated 286 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:10:15.059813 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9caad8-e94e-4dbf-b4be-368ee77b091d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:15.069730 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9caad8-e94e-4dbf-b4be-368ee77b091d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:15.077095 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d5deebaa-edc2-44ea-ac90-9f0cdbd1318f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b587ba900c9b4b9c93ffa23fd536b525', 'request_id': 'req-d5deebaa-edc2-44ea-ac90-9f0cdbd1318f'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:15.085146 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d5deebaa-edc2-44ea-ac90-9f0cdbd1318f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b587ba900c9b4b9c93ffa23fd536b525', 'request_id': 'req-d5deebaa-edc2-44ea-ac90-9f0cdbd1318f'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:15.091729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d5deebaa-edc2-44ea-ac90-9f0cdbd1318f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b587ba900c9b4b9c93ffa23fd536b525', 'request_id': 'req-d5deebaa-edc2-44ea-ac90-9f0cdbd1318f'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:15.102304 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d5deebaa-edc2-44ea-ac90-9f0cdbd1318f admin admin] The token cache is being invalidate because project b587ba900c9b4b9c93ffa23fd536b525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:10:15.102589 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d5deebaa-edc2-44ea-ac90-9f0cdbd1318f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:15.103247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d5deebaa-edc2-44ea-ac90-9f0cdbd1318f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:15.104947 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1251/2510] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:10:14 2022] DELETE /identity/v3/projects/b587ba900c9b4b9c93ffa23fd536b525 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:15.108492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5deebaa-edc2-44ea-ac90-9f0cdbd1318f admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:15.109835 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d5deebaa-edc2-44ea-ac90-9f0cdbd1318f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:15.128023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bdd75-e2f6-4f98-b66b-883884508c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:15.128690 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bdd75-e2f6-4f98-b66b-883884508c5b admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:15.128911 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bdd75-e2f6-4f98-b66b-883884508c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:15.129183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bdd75-e2f6-4f98-b66b-883884508c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:15.129830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9bdd75-e2f6-4f98-b66b-883884508c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:15.131471 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9bdd75-e2f6-4f98-b66b-883884508c5b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:15.144511 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1260/2511] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 01:10:15.145436 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bdd75-e2f6-4f98-b66b-883884508c5b admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:15.147110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ba9bdd75-e2f6-4f98-b66b-883884508c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:15.155785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:15.159776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bdd75-e2f6-4f98-b66b-883884508c5b admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:15.165870 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbbdbd-e9e5-48c2-9008-8e9809968cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:15.166566 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbbdbd-e9e5-48c2-9008-8e9809968cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:15.167082 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbbdbd-e9e5-48c2-9008-8e9809968cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:15.167514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbbdbd-e9e5-48c2-9008-8e9809968cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:15.168354 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bbbdbd-e9e5-48c2-9008-8e9809968cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:15.170005 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bbbdbd-e9e5-48c2-9008-8e9809968cf1 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:15.177707 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5deebaa-edc2-44ea-ac90-9f0cdbd1318f admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:15.183067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1261/2512] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 01:10:15.184469 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fead91-6630-4e77-9008-98abf9b77a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:15.185092 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fead91-6630-4e77-9008-98abf9b77a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:15.185344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbbdbd-e9e5-48c2-9008-8e9809968cf1 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:15.185448 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fead91-6630-4e77-9008-98abf9b77a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:15.185626 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fead91-6630-4e77-9008-98abf9b77a66 admin admin] PATH_INFO: `/v3/users/115f59dce58f4a6dac33b87c57c42f51` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:15.186787 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fead91-6630-4e77-9008-98abf9b77a66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=115f59dce58f4a6dac33b87c57c42f51)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:15.188785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fead91-6630-4e77-9008-98abf9b77a66 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:15.195769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbbdbd-e9e5-48c2-9008-8e9809968cf1 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:15.200967 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ee58f-49d9-47c4-91e1-b71f7d2e813a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:15.201628 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ee58f-49d9-47c4-91e1-b71f7d2e813a admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:15.201934 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ee58f-49d9-47c4-91e1-b71f7d2e813a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:15.202202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ee58f-49d9-47c4-91e1-b71f7d2e813a admin admin] PATH_INFO: `/v3/projects/a1ba8fe9047842fe9752462a56bc4fe6/users/bccfd9b0b71c42d389abcf028b7483d5/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:15.217123 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ee58f-49d9-47c4-91e1-b71f7d2e813a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1ba8fe9047842fe9752462a56bc4fe6, user_id=bccfd9b0b71c42d389abcf028b7483d5, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:15.220937 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ee58f-49d9-47c4-91e1-b71f7d2e813a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:15.233723 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1262/2513] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:10:15 2022] PUT /identity/v3/projects/a1ba8fe9047842fe9752462a56bc4fe6/users/bccfd9b0b71c42d389abcf028b7483d5/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:10:15.238632 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-04fead91-6630-4e77-9008-98abf9b77a66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '115f59dce58f4a6dac33b87c57c42f51'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:15.239521 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-04fead91-6630-4e77-9008-98abf9b77a66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '115f59dce58f4a6dac33b87c57c42f51'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:15.244280 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:15.244724 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb1c9f-fb86-43f6-b440-dea6edb3889a None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:15.245008 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb1c9f-fb86-43f6-b440-dea6edb3889a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:15.245286 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb1c9f-fb86-43f6-b440-dea6edb3889a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:15.249133 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-04fead91-6630-4e77-9008-98abf9b77a66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '115f59dce58f4a6dac33b87c57c42f51'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:15.263393 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-04fead91-6630-4e77-9008-98abf9b77a66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '115f59dce58f4a6dac33b87c57c42f51'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:15.264115 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-04fead91-6630-4e77-9008-98abf9b77a66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '115f59dce58f4a6dac33b87c57c42f51'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:15.274319 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-5ebb1c9f-fb86-43f6-b440-dea6edb3889a None None] MFA Rules not processed for user `bccfd9b0b71c42d389abcf028b7483d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:15.275888 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5ebb1c9f-fb86-43f6-b440-dea6edb3889a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:15.278336 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1252/2514] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:10:15 2022] DELETE /identity/v3/users/115f59dce58f4a6dac33b87c57c42f51 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:10:15.342809 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1263/2515] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:10:15.348376 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fead91-6630-4e77-9008-98abf9b77a66 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:15.349986 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-04fead91-6630-4e77-9008-98abf9b77a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:15.416789 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fead91-6630-4e77-9008-98abf9b77a66 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:15.421403 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4634a-a165-4800-9c1a-38c69a7c62ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:15.422035 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4634a-a165-4800-9c1a-38c69a7c62ad admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:15.422306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4634a-a165-4800-9c1a-38c69a7c62ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:15.422570 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4634a-a165-4800-9c1a-38c69a7c62ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:15.423187 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4634a-a165-4800-9c1a-38c69a7c62ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:15.425722 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4634a-a165-4800-9c1a-38c69a7c62ad admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:15.454935 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1253/2516] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:10:15 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:15.458958 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb1c9f-fb86-43f6-b440-dea6edb3889a None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:15.469860 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb1c9f-fb86-43f6-b440-dea6edb3889a None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:15.535654 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c56d5-097f-42cb-b55c-21be32355ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:15.536270 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c56d5-097f-42cb-b55c-21be32355ddc admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:15.536551 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c56d5-097f-42cb-b55c-21be32355ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:15.536824 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c56d5-097f-42cb-b55c-21be32355ddc admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:15.537451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c56d5-097f-42cb-b55c-21be32355ddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:15.539396 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c56d5-097f-42cb-b55c-21be32355ddc admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:15.561309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1264/2517] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:10:15 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:15.565782 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4634a-a165-4800-9c1a-38c69a7c62ad admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:15.576728 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4634a-a165-4800-9c1a-38c69a7c62ad admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:15.582341 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836626a-31d4-43b3-a485-0def36ccb8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:15.583094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836626a-31d4-43b3-a485-0def36ccb8da admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:15.583446 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836626a-31d4-43b3-a485-0def36ccb8da admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:15.583765 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836626a-31d4-43b3-a485-0def36ccb8da admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:15.584406 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836626a-31d4-43b3-a485-0def36ccb8da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:15.586175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836626a-31d4-43b3-a485-0def36ccb8da admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:15.594911 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c56d5-097f-42cb-b55c-21be32355ddc admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:15.597635 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-657c56d5-097f-42cb-b55c-21be32355ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:15.612483 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1254/2518] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 01:10:15.612668 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c56d5-097f-42cb-b55c-21be32355ddc admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:15.614334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836626a-31d4-43b3-a485-0def36ccb8da admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:15.617719 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a2991-a826-4f37-a049-ffcdbfbeb299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:15.618430 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a2991-a826-4f37-a049-ffcdbfbeb299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:15.618709 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a2991-a826-4f37-a049-ffcdbfbeb299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:15.619127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a2991-a826-4f37-a049-ffcdbfbeb299 admin admin] PATH_INFO: `/v3/projects/373bdbb785f941a1aff4f6b1b3431481` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:15.620280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a2991-a826-4f37-a049-ffcdbfbeb299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=373bdbb785f941a1aff4f6b1b3431481)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:15.622460 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a2991-a826-4f37-a049-ffcdbfbeb299 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:15.625283 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836626a-31d4-43b3-a485-0def36ccb8da admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:15.630922 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfbdb4-4ab2-4570-a8e3-55cf007174e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:15.631547 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfbdb4-4ab2-4570-a8e3-55cf007174e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:15.631826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfbdb4-4ab2-4570-a8e3-55cf007174e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:15.632097 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfbdb4-4ab2-4570-a8e3-55cf007174e5 admin admin] PATH_INFO: `/v3/projects/80567a5d0d854959aa3bcf0c75534440/users/f3fc7ed2ced54938a20ff18c650158ab/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:15.647757 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdfbdb4-4ab2-4570-a8e3-55cf007174e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80567a5d0d854959aa3bcf0c75534440, user_id=f3fc7ed2ced54938a20ff18c650158ab, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:15.651049 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdfbdb4-4ab2-4570-a8e3-55cf007174e5 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:15.664491 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1255/2519] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:10:15 2022] PUT /identity/v3/projects/80567a5d0d854959aa3bcf0c75534440/users/f3fc7ed2ced54938a20ff18c650158ab/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:10:15.668381 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfbdb4-4ab2-4570-a8e3-55cf007174e5 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:15.670970 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:15.675524 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-bb7a2991-a826-4f37-a049-ffcdbfbeb299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '373bdbb785f941a1aff4f6b1b3431481', 'request_id': 'req-bb7a2991-a826-4f37-a049-ffcdbfbeb299'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:15.686454 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-bb7a2991-a826-4f37-a049-ffcdbfbeb299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '373bdbb785f941a1aff4f6b1b3431481', 'request_id': 'req-bb7a2991-a826-4f37-a049-ffcdbfbeb299'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:15.694166 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-bb7a2991-a826-4f37-a049-ffcdbfbeb299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '373bdbb785f941a1aff4f6b1b3431481', 'request_id': 'req-bb7a2991-a826-4f37-a049-ffcdbfbeb299'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:15.705457 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-bb7a2991-a826-4f37-a049-ffcdbfbeb299 admin admin] The token cache is being invalidate because project 373bdbb785f941a1aff4f6b1b3431481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:10:15.705992 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-bb7a2991-a826-4f37-a049-ffcdbfbeb299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:15.706648 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-bb7a2991-a826-4f37-a049-ffcdbfbeb299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:15.708231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1265/2520] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:10:15 2022] DELETE /identity/v3/projects/373bdbb785f941a1aff4f6b1b3431481 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:15.712782 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed63c2e-68f4-4a1d-96f5-d253927d996b None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:15.713056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed63c2e-68f4-4a1d-96f5-d253927d996b None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:15.713350 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed63c2e-68f4-4a1d-96f5-d253927d996b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:15.733404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-1ed63c2e-68f4-4a1d-96f5-d253927d996b None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:15.734647 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1ed63c2e-68f4-4a1d-96f5-d253927d996b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:15.734935 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfbdb4-4ab2-4570-a8e3-55cf007174e5 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:15.759164 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:15.794622 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1266/2521] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:10:15.795720 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ffac6-0eab-4388-9815-63f8c6bc6255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:15.796330 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ffac6-0eab-4388-9815-63f8c6bc6255 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:15.796663 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ffac6-0eab-4388-9815-63f8c6bc6255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:15.797348 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ffac6-0eab-4388-9815-63f8c6bc6255 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:15.798120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ffac6-0eab-4388-9815-63f8c6bc6255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:15.799834 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ffac6-0eab-4388-9815-63f8c6bc6255 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:15.803729 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadb383-f3e7-4ed1-acf0-5cedf5d2af21 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:15.804377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadb383-f3e7-4ed1-acf0-5cedf5d2af21 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:15.804641 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadb383-f3e7-4ed1-acf0-5cedf5d2af21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:15.813255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1256/2522] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 01:10:15.815127 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ffac6-0eab-4388-9815-63f8c6bc6255 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:15.816818 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6b7ffac6-0eab-4388-9815-63f8c6bc6255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:15.826693 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-daadb383-f3e7-4ed1-acf0-5cedf5d2af21 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:15.827910 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-daadb383-f3e7-4ed1-acf0-5cedf5d2af21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:15.829253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ffac6-0eab-4388-9815-63f8c6bc6255 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:15.834429 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbcc07-dae1-4afc-9ea4-adb387fb6132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:15.835061 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbcc07-dae1-4afc-9ea4-adb387fb6132 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:15.835334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbcc07-dae1-4afc-9ea4-adb387fb6132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:15.835601 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbcc07-dae1-4afc-9ea4-adb387fb6132 admin admin] PATH_INFO: `/v3/projects/80567a5d0d854959aa3bcf0c75534440/users/f3fc7ed2ced54938a20ff18c650158ab/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:15.836336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1267/2523] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:10:15.837655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bbcc07-dae1-4afc-9ea4-adb387fb6132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80567a5d0d854959aa3bcf0c75534440, user_id=f3fc7ed2ced54938a20ff18c650158ab, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:15.840306 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadb383-f3e7-4ed1-acf0-5cedf5d2af21 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:15.840461 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bbcc07-dae1-4afc-9ea4-adb387fb6132 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:15.849424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadb383-f3e7-4ed1-acf0-5cedf5d2af21 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:15.850840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1257/2524] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:10:15 2022] PUT /identity/v3/projects/80567a5d0d854959aa3bcf0c75534440/users/f3fc7ed2ced54938a20ff18c650158ab/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:15.862342 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc9f69-c96b-4093-bb34-82b382f885af None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:15.862707 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc9f69-c96b-4093-bb34-82b382f885af None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:15.862892 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc9f69-c96b-4093-bb34-82b382f885af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:15.896466 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-21cc9f69-c96b-4093-bb34-82b382f885af None None] MFA Rules not processed for user `f3fc7ed2ced54938a20ff18c650158ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:15.897924 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-21cc9f69-c96b-4093-bb34-82b382f885af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:15.918542 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9acdd9-6ea1-4625-879d-0f57b75f5fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:15.919194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9acdd9-6ea1-4625-879d-0f57b75f5fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:15.919610 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9acdd9-6ea1-4625-879d-0f57b75f5fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:15.919980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9acdd9-6ea1-4625-879d-0f57b75f5fa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:15.924784 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9acdd9-6ea1-4625-879d-0f57b75f5fa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:10:15.924784 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9acdd9-6ea1-4625-879d-0f57b75f5fa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:15.924784 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9acdd9-6ea1-4625-879d-0f57b75f5fa5 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:15.944686 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1268/2525] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 01:10:15.949245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9acdd9-6ea1-4625-879d-0f57b75f5fa5 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:15.960349 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9acdd9-6ea1-4625-879d-0f57b75f5fa5 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:15.964952 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26162a79-7700-4eb4-be1d-129e124a0b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:15.965553 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26162a79-7700-4eb4-be1d-129e124a0b5e admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:15.965843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26162a79-7700-4eb4-be1d-129e124a0b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:15.966135 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26162a79-7700-4eb4-be1d-129e124a0b5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:15.966744 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26162a79-7700-4eb4-be1d-129e124a0b5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:15.968679 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26162a79-7700-4eb4-be1d-129e124a0b5e admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:15.974300 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1258/2526] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:10:15.985558 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc9f69-c96b-4093-bb34-82b382f885af None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:15.987880 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-21cc9f69-c96b-4093-bb34-82b382f885af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:15.998659 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1269/2527] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:10:15 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:10:16.002879 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26162a79-7700-4eb4-be1d-129e124a0b5e admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:16.045838 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:16.051748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc9f69-c96b-4093-bb34-82b382f885af None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:16.067523 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26162a79-7700-4eb4-be1d-129e124a0b5e admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:16.072263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc7bcb-8f93-498c-8b03-57305e988607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:16.072861 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc7bcb-8f93-498c-8b03-57305e988607 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:16.073135 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc7bcb-8f93-498c-8b03-57305e988607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:16.073403 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc7bcb-8f93-498c-8b03-57305e988607 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:16.074048 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc7bcb-8f93-498c-8b03-57305e988607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:16.075978 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc7bcb-8f93-498c-8b03-57305e988607 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:16.098948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1270/2528] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:10:16 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:10:16.100515 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec96d5-a8c3-4d68-97bb-867215a04239 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:16.101121 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec96d5-a8c3-4d68-97bb-867215a04239 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:16.101398 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec96d5-a8c3-4d68-97bb-867215a04239 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:16.101671 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec96d5-a8c3-4d68-97bb-867215a04239 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:16.102980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc7bcb-8f93-498c-8b03-57305e988607 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:16.105889 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:16.113088 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc7bcb-8f93-498c-8b03-57305e988607 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:16.117908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b54cb7-eff6-47ce-b10a-ed2c815cda75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:16.118500 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b54cb7-eff6-47ce-b10a-ed2c815cda75 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:16.118780 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b54cb7-eff6-47ce-b10a-ed2c815cda75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:16.119054 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b54cb7-eff6-47ce-b10a-ed2c815cda75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:16.119684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b54cb7-eff6-47ce-b10a-ed2c815cda75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:16.121269 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b54cb7-eff6-47ce-b10a-ed2c815cda75 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:16.131426 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1271/2529] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 01:10:16.135207 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b54cb7-eff6-47ce-b10a-ed2c815cda75 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:16.145347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b54cb7-eff6-47ce-b10a-ed2c815cda75 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:16.151407 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4b400-1461-48a7-a075-80e604042506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:16.151962 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4b400-1461-48a7-a075-80e604042506 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:16.152243 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4b400-1461-48a7-a075-80e604042506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:16.152514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4b400-1461-48a7-a075-80e604042506 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:16.153146 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4b400-1461-48a7-a075-80e604042506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:16.154907 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4b400-1461-48a7-a075-80e604042506 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:16.165687 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec96d5-a8c3-4d68-97bb-867215a04239 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:16.169484 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1272/2530] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:16.169639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec96d5-a8c3-4d68-97bb-867215a04239 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:16.170484 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4b400-1461-48a7-a075-80e604042506 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:16.177146 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1259/2531] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 01:10:16.180668 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4b400-1461-48a7-a075-80e604042506 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:16.185577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55069fc8-82c0-4259-85db-cde3d322c42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:16.186319 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55069fc8-82c0-4259-85db-cde3d322c42b admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:16.186626 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55069fc8-82c0-4259-85db-cde3d322c42b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:16.186927 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55069fc8-82c0-4259-85db-cde3d322c42b admin admin] PATH_INFO: `/v3/projects/8e531ffc6b9548c79c4f1b64bb6f2f81/users/fdd191baad03417fbebb20ea0c2015fe/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:16.201869 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55069fc8-82c0-4259-85db-cde3d322c42b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e531ffc6b9548c79c4f1b64bb6f2f81, user_id=fdd191baad03417fbebb20ea0c2015fe, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:16.204534 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55069fc8-82c0-4259-85db-cde3d322c42b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:16.217521 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1273/2532] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:10:16 2022] PUT /identity/v3/projects/8e531ffc6b9548c79c4f1b64bb6f2f81/users/fdd191baad03417fbebb20ea0c2015fe/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:10:16.228733 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814ed9f-bcf9-4cd5-b4f9-cbd7fe4c5776 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:16.229196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814ed9f-bcf9-4cd5-b4f9-cbd7fe4c5776 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:16.229309 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814ed9f-bcf9-4cd5-b4f9-cbd7fe4c5776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:16.262972 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-7814ed9f-bcf9-4cd5-b4f9-cbd7fe4c5776 None None] MFA Rules not processed for user `fdd191baad03417fbebb20ea0c2015fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:16.263750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7814ed9f-bcf9-4cd5-b4f9-cbd7fe4c5776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:16.277498 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55069fc8-82c0-4259-85db-cde3d322c42b admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:16.335092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55069fc8-82c0-4259-85db-cde3d322c42b admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:16.335996 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1260/2533] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:16.338951 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4766763-169e-4236-aecc-b9a0ac6fb9a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:16.339815 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4766763-169e-4236-aecc-b9a0ac6fb9a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:16.340100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4766763-169e-4236-aecc-b9a0ac6fb9a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:16.340400 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4766763-169e-4236-aecc-b9a0ac6fb9a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:16.340510 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814ed9f-bcf9-4cd5-b4f9-cbd7fe4c5776 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:16.342201 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e4766763-169e-4236-aecc-b9a0ac6fb9a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:16.402834 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4766763-169e-4236-aecc-b9a0ac6fb9a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:16.404277 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4766763-169e-4236-aecc-b9a0ac6fb9a1 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:16.404517 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814ed9f-bcf9-4cd5-b4f9-cbd7fe4c5776 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:16.409786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59369140-6f8d-4025-baa7-f2537358ce3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:16.410402 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59369140-6f8d-4025-baa7-f2537358ce3e admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:16.410681 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59369140-6f8d-4025-baa7-f2537358ce3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:16.410978 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59369140-6f8d-4025-baa7-f2537358ce3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:16.411601 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59369140-6f8d-4025-baa7-f2537358ce3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:16.413567 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59369140-6f8d-4025-baa7-f2537358ce3e admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:16.413941 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1274/2534] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 01:10:16.446786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1261/2535] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:10:16 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:10:16.448145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4766763-169e-4236-aecc-b9a0ac6fb9a1 service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:16.459953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4766763-169e-4236-aecc-b9a0ac6fb9a1 service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:16.495222 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:16.530728 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4867be-4be5-47f5-9eb8-e38b79d60242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:16.531344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4867be-4be5-47f5-9eb8-e38b79d60242 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:16.531623 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4867be-4be5-47f5-9eb8-e38b79d60242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:16.531895 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4867be-4be5-47f5-9eb8-e38b79d60242 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:16.532544 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4867be-4be5-47f5-9eb8-e38b79d60242 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:16.535363 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4867be-4be5-47f5-9eb8-e38b79d60242 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:16.562012 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1275/2536] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:10:16 2022] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:10:16.566136 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59369140-6f8d-4025-baa7-f2537358ce3e admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:16.577841 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59369140-6f8d-4025-baa7-f2537358ce3e admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:16.584389 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae7dba-28f1-4207-aa3e-b69dbecee56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:16.584989 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae7dba-28f1-4207-aa3e-b69dbecee56b admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:16.585446 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae7dba-28f1-4207-aa3e-b69dbecee56b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:16.585581 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae7dba-28f1-4207-aa3e-b69dbecee56b admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:16.586235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae7dba-28f1-4207-aa3e-b69dbecee56b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:16.587845 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae7dba-28f1-4207-aa3e-b69dbecee56b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:16.600027 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1262/2537] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:16.604379 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4867be-4be5-47f5-9eb8-e38b79d60242 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:16.614082 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4867be-4be5-47f5-9eb8-e38b79d60242 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:16.618673 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4267c78-7cee-4942-86bb-4f2f999f5761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:16.619316 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4267c78-7cee-4942-86bb-4f2f999f5761 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:16.619590 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4267c78-7cee-4942-86bb-4f2f999f5761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:16.619877 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4267c78-7cee-4942-86bb-4f2f999f5761 admin admin] PATH_INFO: `/v3/projects/1bf3090baea74e6dbcca0e053a817c47/users/46b046754fb645b5b2b7e96778087255/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:16.634077 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4267c78-7cee-4942-86bb-4f2f999f5761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bf3090baea74e6dbcca0e053a817c47, user_id=46b046754fb645b5b2b7e96778087255, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:16.636717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4267c78-7cee-4942-86bb-4f2f999f5761 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:16.649911 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1276/2538] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:10:16 2022] PUT /identity/v3/projects/1bf3090baea74e6dbcca0e053a817c47/users/46b046754fb645b5b2b7e96778087255/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:10:16.654098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae7dba-28f1-4207-aa3e-b69dbecee56b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:16.660977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:16.664992 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae7dba-28f1-4207-aa3e-b69dbecee56b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:16.721737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4417e-bfff-45a6-bf6b-7aee7b477473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:16.722358 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4417e-bfff-45a6-bf6b-7aee7b477473 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:16.722639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4417e-bfff-45a6-bf6b-7aee7b477473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:16.722908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4417e-bfff-45a6-bf6b-7aee7b477473 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:16.723534 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4417e-bfff-45a6-bf6b-7aee7b477473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:16.725167 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4417e-bfff-45a6-bf6b-7aee7b477473 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:16.735225 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1263/2539] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:16.739544 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4267c78-7cee-4942-86bb-4f2f999f5761 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:16.750623 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4267c78-7cee-4942-86bb-4f2f999f5761 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:16.755740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9159d6c-a2eb-403e-82bb-0e53e8579dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:16.756387 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9159d6c-a2eb-403e-82bb-0e53e8579dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:16.756670 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9159d6c-a2eb-403e-82bb-0e53e8579dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:16.756948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9159d6c-a2eb-403e-82bb-0e53e8579dc4 admin admin] PATH_INFO: `/v3/projects/1bf3090baea74e6dbcca0e053a817c47/users/46b046754fb645b5b2b7e96778087255/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:16.758891 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9159d6c-a2eb-403e-82bb-0e53e8579dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bf3090baea74e6dbcca0e053a817c47, user_id=46b046754fb645b5b2b7e96778087255, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:16.761536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9159d6c-a2eb-403e-82bb-0e53e8579dc4 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:16.772085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1277/2540] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:10:16 2022] PUT /identity/v3/projects/1bf3090baea74e6dbcca0e053a817c47/users/46b046754fb645b5b2b7e96778087255/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:16.782606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbad21-bf9a-4803-aa9b-fb13fdbbc8a1 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:16.782991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbad21-bf9a-4803-aa9b-fb13fdbbc8a1 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:16.783348 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbad21-bf9a-4803-aa9b-fb13fdbbc8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:16.810278 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-1efbad21-bf9a-4803-aa9b-fb13fdbbc8a1 None None] MFA Rules not processed for user `46b046754fb645b5b2b7e96778087255`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:16.811480 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1efbad21-bf9a-4803-aa9b-fb13fdbbc8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:16.879626 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1264/2541] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:16.890702 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9159d6c-a2eb-403e-82bb-0e53e8579dc4 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:16.949693 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9159d6c-a2eb-403e-82bb-0e53e8579dc4 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:16.953239 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf073600-f76f-46e6-b140-ff2c2c93caf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:16.953865 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf073600-f76f-46e6-b140-ff2c2c93caf9 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:16.954147 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf073600-f76f-46e6-b140-ff2c2c93caf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:16.954418 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf073600-f76f-46e6-b140-ff2c2c93caf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:16.963920 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf073600-f76f-46e6-b140-ff2c2c93caf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:16.965335 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf073600-f76f-46e6-b140-ff2c2c93caf9 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:16.974613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1278/2542] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:10:17.077631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efbad21-bf9a-4803-aa9b-fb13fdbbc8a1 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:17.087754 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efbad21-bf9a-4803-aa9b-fb13fdbbc8a1 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:17.091620 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ac34f-bc3e-4b38-afdd-39bda42e5208 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:17.092247 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ac34f-bc3e-4b38-afdd-39bda42e5208 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:17.092553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ac34f-bc3e-4b38-afdd-39bda42e5208 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:17.092831 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ac34f-bc3e-4b38-afdd-39bda42e5208 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:17.149826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ac34f-bc3e-4b38-afdd-39bda42e5208 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:17.151526 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ac34f-bc3e-4b38-afdd-39bda42e5208 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:17.160451 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1265/2543] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:10:19.739062 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf073600-f76f-46e6-b140-ff2c2c93caf9 service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:19.799130 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf073600-f76f-46e6-b140-ff2c2c93caf9 service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:19.803639 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7d0f4-9ed5-49ee-88ca-dc2d9fa9fa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:19.804254 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7d0f4-9ed5-49ee-88ca-dc2d9fa9fa91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:19.804533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7d0f4-9ed5-49ee-88ca-dc2d9fa9fa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:19.804805 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7d0f4-9ed5-49ee-88ca-dc2d9fa9fa91 admin admin] PATH_INFO: `/v3/users/fdd191baad03417fbebb20ea0c2015fe` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:19.805945 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7d0f4-9ed5-49ee-88ca-dc2d9fa9fa91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdd191baad03417fbebb20ea0c2015fe)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:19.807847 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7d0f4-9ed5-49ee-88ca-dc2d9fa9fa91 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:19.840868 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:19.854808 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-efc7d0f4-9ed5-49ee-88ca-dc2d9fa9fa91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdd191baad03417fbebb20ea0c2015fe'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:19.862923 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-efc7d0f4-9ed5-49ee-88ca-dc2d9fa9fa91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdd191baad03417fbebb20ea0c2015fe'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:19.874714 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-efc7d0f4-9ed5-49ee-88ca-dc2d9fa9fa91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdd191baad03417fbebb20ea0c2015fe'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:19.875402 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-efc7d0f4-9ed5-49ee-88ca-dc2d9fa9fa91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdd191baad03417fbebb20ea0c2015fe'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:19.876003 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-efc7d0f4-9ed5-49ee-88ca-dc2d9fa9fa91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdd191baad03417fbebb20ea0c2015fe'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:19.888775 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1279/2544] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:10:19 2022] DELETE /identity/v3/users/fdd191baad03417fbebb20ea0c2015fe => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:19.893649 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41a87a-17da-4769-907d-565bc5ed4147 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:19.894149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41a87a-17da-4769-907d-565bc5ed4147 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:19.894262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41a87a-17da-4769-907d-565bc5ed4147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:19.914168 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-3f41a87a-17da-4769-907d-565bc5ed4147 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:19.915356 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3f41a87a-17da-4769-907d-565bc5ed4147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:19.933474 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:19.972560 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1266/2545] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:19.982373 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7d0f4-9ed5-49ee-88ca-dc2d9fa9fa91 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:19.983760 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-efc7d0f4-9ed5-49ee-88ca-dc2d9fa9fa91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:20.039829 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7d0f4-9ed5-49ee-88ca-dc2d9fa9fa91 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:20.043385 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51572566-3256-4993-bdf8-0e6911875cf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:20.043976 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51572566-3256-4993-bdf8-0e6911875cf7 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:20.044251 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51572566-3256-4993-bdf8-0e6911875cf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:20.044520 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51572566-3256-4993-bdf8-0e6911875cf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:20.053750 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51572566-3256-4993-bdf8-0e6911875cf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:20.055223 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51572566-3256-4993-bdf8-0e6911875cf7 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:20.064441 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1280/2546] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:10:20.335926 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41a87a-17da-4769-907d-565bc5ed4147 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:20.337392 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3f41a87a-17da-4769-907d-565bc5ed4147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:20.349581 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41a87a-17da-4769-907d-565bc5ed4147 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:20.354226 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c4aec-9158-4087-b6c7-35ad1b6794f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:20.354853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c4aec-9158-4087-b6c7-35ad1b6794f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:20.355124 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c4aec-9158-4087-b6c7-35ad1b6794f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:20.355388 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c4aec-9158-4087-b6c7-35ad1b6794f8 admin admin] PATH_INFO: `/v3/projects/8e531ffc6b9548c79c4f1b64bb6f2f81` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:20.356560 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c4aec-9158-4087-b6c7-35ad1b6794f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e531ffc6b9548c79c4f1b64bb6f2f81)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:20.358561 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c4aec-9158-4087-b6c7-35ad1b6794f8 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:20.410732 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8d5c4aec-9158-4087-b6c7-35ad1b6794f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e531ffc6b9548c79c4f1b64bb6f2f81', 'request_id': 'req-8d5c4aec-9158-4087-b6c7-35ad1b6794f8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:20.418089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8d5c4aec-9158-4087-b6c7-35ad1b6794f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e531ffc6b9548c79c4f1b64bb6f2f81', 'request_id': 'req-8d5c4aec-9158-4087-b6c7-35ad1b6794f8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:20.424832 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8d5c4aec-9158-4087-b6c7-35ad1b6794f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e531ffc6b9548c79c4f1b64bb6f2f81', 'request_id': 'req-8d5c4aec-9158-4087-b6c7-35ad1b6794f8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:20.437863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8d5c4aec-9158-4087-b6c7-35ad1b6794f8 admin admin] The token cache is being invalidate because project 8e531ffc6b9548c79c4f1b64bb6f2f81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:10:20.438148 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8d5c4aec-9158-4087-b6c7-35ad1b6794f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:20.438786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8d5c4aec-9158-4087-b6c7-35ad1b6794f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:20.441069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1267/2547] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:10:20 2022] DELETE /identity/v3/projects/8e531ffc6b9548c79c4f1b64bb6f2f81 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:20.445530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51572566-3256-4993-bdf8-0e6911875cf7 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:20.454986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51572566-3256-4993-bdf8-0e6911875cf7 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:20.513149 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04a78c-ed4f-4f17-805b-c553669c3fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:20.513778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04a78c-ed4f-4f17-805b-c553669c3fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:20.514097 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04a78c-ed4f-4f17-805b-c553669c3fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:20.514368 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04a78c-ed4f-4f17-805b-c553669c3fc3 admin admin] PATH_INFO: `/v3/users/46b046754fb645b5b2b7e96778087255` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:20.515476 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04a78c-ed4f-4f17-805b-c553669c3fc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46b046754fb645b5b2b7e96778087255)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:20.517369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04a78c-ed4f-4f17-805b-c553669c3fc3 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:20.567162 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1c04a78c-ed4f-4f17-805b-c553669c3fc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46b046754fb645b5b2b7e96778087255'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:20.573668 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:20.576209 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1c04a78c-ed4f-4f17-805b-c553669c3fc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46b046754fb645b5b2b7e96778087255'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:20.590830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1c04a78c-ed4f-4f17-805b-c553669c3fc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46b046754fb645b5b2b7e96778087255'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:20.591518 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1c04a78c-ed4f-4f17-805b-c553669c3fc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46b046754fb645b5b2b7e96778087255'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:20.592126 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1c04a78c-ed4f-4f17-805b-c553669c3fc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46b046754fb645b5b2b7e96778087255'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:20.606224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1281/2548] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:10:20 2022] DELETE /identity/v3/users/46b046754fb645b5b2b7e96778087255 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:20.914610 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c4aec-9158-4087-b6c7-35ad1b6794f8 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:20.916457 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8d5c4aec-9158-4087-b6c7-35ad1b6794f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:20.931225 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c4aec-9158-4087-b6c7-35ad1b6794f8 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:20.994805 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab81c5-047d-458d-bf79-b33bf1e6cebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:20.995354 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab81c5-047d-458d-bf79-b33bf1e6cebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:20.995657 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab81c5-047d-458d-bf79-b33bf1e6cebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:20.995932 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab81c5-047d-458d-bf79-b33bf1e6cebe admin admin] PATH_INFO: `/v3/projects/1bf3090baea74e6dbcca0e053a817c47` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:20.997065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab81c5-047d-458d-bf79-b33bf1e6cebe admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bf3090baea74e6dbcca0e053a817c47)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:20.999099 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab81c5-047d-458d-bf79-b33bf1e6cebe admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:21.046182 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b8ab81c5-047d-458d-bf79-b33bf1e6cebe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bf3090baea74e6dbcca0e053a817c47', 'request_id': 'req-b8ab81c5-047d-458d-bf79-b33bf1e6cebe'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:21.047760 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:21.055472 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b8ab81c5-047d-458d-bf79-b33bf1e6cebe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bf3090baea74e6dbcca0e053a817c47', 'request_id': 'req-b8ab81c5-047d-458d-bf79-b33bf1e6cebe'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:21.062715 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b8ab81c5-047d-458d-bf79-b33bf1e6cebe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bf3090baea74e6dbcca0e053a817c47', 'request_id': 'req-b8ab81c5-047d-458d-bf79-b33bf1e6cebe'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:21.072978 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b8ab81c5-047d-458d-bf79-b33bf1e6cebe admin admin] The token cache is being invalidate because project 1bf3090baea74e6dbcca0e053a817c47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:10:21.073259 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b8ab81c5-047d-458d-bf79-b33bf1e6cebe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:21.073975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b8ab81c5-047d-458d-bf79-b33bf1e6cebe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:21.075438 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1268/2549] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:10:20 2022] DELETE /identity/v3/projects/1bf3090baea74e6dbcca0e053a817c47 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:21.080280 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407acd44-0b7a-48b1-881e-8001a9b85be5 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:21.081224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407acd44-0b7a-48b1-881e-8001a9b85be5 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:21.081346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407acd44-0b7a-48b1-881e-8001a9b85be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:21.101792 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-407acd44-0b7a-48b1-881e-8001a9b85be5 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:21.103087 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-407acd44-0b7a-48b1-881e-8001a9b85be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:21.161595 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1282/2550] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:21.170275 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b027c2f-a8f6-4152-b09c-6e63076d3019 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:21.170558 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b027c2f-a8f6-4152-b09c-6e63076d3019 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:21.170854 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b027c2f-a8f6-4152-b09c-6e63076d3019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:21.190975 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-7b027c2f-a8f6-4152-b09c-6e63076d3019 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:21.192163 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7b027c2f-a8f6-4152-b09c-6e63076d3019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:21.202874 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1269/2551] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:21.208915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407acd44-0b7a-48b1-881e-8001a9b85be5 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:21.218988 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407acd44-0b7a-48b1-881e-8001a9b85be5 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:21.223994 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb63122-d35c-4897-aeff-849d06479535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:21.224613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb63122-d35c-4897-aeff-849d06479535 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:21.224889 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb63122-d35c-4897-aeff-849d06479535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:21.225158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb63122-d35c-4897-aeff-849d06479535 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:21.225827 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb63122-d35c-4897-aeff-849d06479535 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:10:21.226141 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb63122-d35c-4897-aeff-849d06479535 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:21.227735 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb63122-d35c-4897-aeff-849d06479535 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:21.239791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1283/2552] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:10:21.244211 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b027c2f-a8f6-4152-b09c-6e63076d3019 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:21.253681 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b027c2f-a8f6-4152-b09c-6e63076d3019 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:21.258164 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867c718-81cd-4f73-8f9a-a0b056a4182c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:21.258741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867c718-81cd-4f73-8f9a-a0b056a4182c admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:21.259013 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867c718-81cd-4f73-8f9a-a0b056a4182c admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:21.259280 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867c718-81cd-4f73-8f9a-a0b056a4182c admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:21.259898 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d867c718-81cd-4f73-8f9a-a0b056a4182c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:21.261768 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d867c718-81cd-4f73-8f9a-a0b056a4182c admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:21.288879 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1270/2553] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:10:21 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:21.292869 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb63122-d35c-4897-aeff-849d06479535 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:21.302774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb63122-d35c-4897-aeff-849d06479535 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:21.358737 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4c776-3f72-4bb3-a263-35ad18e7e3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:21.359330 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4c776-3f72-4bb3-a263-35ad18e7e3c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:21.359606 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4c776-3f72-4bb3-a263-35ad18e7e3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:21.359877 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4c776-3f72-4bb3-a263-35ad18e7e3c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:21.360490 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4c776-3f72-4bb3-a263-35ad18e7e3c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:21.362418 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4c776-3f72-4bb3-a263-35ad18e7e3c8 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:21.383520 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1284/2554] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:10:21 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:21.387664 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867c718-81cd-4f73-8f9a-a0b056a4182c admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:21.399358 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867c718-81cd-4f73-8f9a-a0b056a4182c admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:21.411517 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76ce89-ea56-4cba-a28d-5abdc14f93c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:21.412125 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76ce89-ea56-4cba-a28d-5abdc14f93c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:21.412405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76ce89-ea56-4cba-a28d-5abdc14f93c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:21.412676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76ce89-ea56-4cba-a28d-5abdc14f93c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:21.413317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f76ce89-ea56-4cba-a28d-5abdc14f93c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:21.414986 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f76ce89-ea56-4cba-a28d-5abdc14f93c7 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:21.425119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1271/2555] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:21.429122 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4c776-3f72-4bb3-a263-35ad18e7e3c8 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:21.439032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4c776-3f72-4bb3-a263-35ad18e7e3c8 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:21.444160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd4f99-f3f8-4a3a-b153-620855039320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:21.444757 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd4f99-f3f8-4a3a-b153-620855039320 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:21.445035 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd4f99-f3f8-4a3a-b153-620855039320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:21.445308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd4f99-f3f8-4a3a-b153-620855039320 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:21.445970 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd4f99-f3f8-4a3a-b153-620855039320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:21.447546 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd4f99-f3f8-4a3a-b153-620855039320 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:21.458543 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1285/2556] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:21.462448 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76ce89-ea56-4cba-a28d-5abdc14f93c7 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:21.472239 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76ce89-ea56-4cba-a28d-5abdc14f93c7 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:21.476853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87991bd-c67e-45ff-a650-d2efdd0d8ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:21.477482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87991bd-c67e-45ff-a650-d2efdd0d8ede admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:21.477761 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87991bd-c67e-45ff-a650-d2efdd0d8ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:21.478070 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87991bd-c67e-45ff-a650-d2efdd0d8ede admin admin] PATH_INFO: `/v3/projects/fa02b6f367e9428583fa4e1c84fdb3d6/users/f22c9e9a3ced42d78d6c03bb9241229f/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:21.492227 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87991bd-c67e-45ff-a650-d2efdd0d8ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa02b6f367e9428583fa4e1c84fdb3d6, user_id=f22c9e9a3ced42d78d6c03bb9241229f, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:21.494903 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87991bd-c67e-45ff-a650-d2efdd0d8ede admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:21.508527 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1272/2557] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:10:21 2022] PUT /identity/v3/projects/fa02b6f367e9428583fa4e1c84fdb3d6/users/f22c9e9a3ced42d78d6c03bb9241229f/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:21.519259 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6efe03-10d0-438d-97de-c834e954e826 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:21.519542 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6efe03-10d0-438d-97de-c834e954e826 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:21.519810 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6efe03-10d0-438d-97de-c834e954e826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:21.546979 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-7e6efe03-10d0-438d-97de-c834e954e826 None None] MFA Rules not processed for user `f22c9e9a3ced42d78d6c03bb9241229f`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:21.548171 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7e6efe03-10d0-438d-97de-c834e954e826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:21.573502 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:21.613255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1286/2558] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:21.617736 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87991bd-c67e-45ff-a650-d2efdd0d8ede admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:21.679025 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87991bd-c67e-45ff-a650-d2efdd0d8ede admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:21.683590 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13daf05-8446-435c-b01d-130003053982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:21.684178 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13daf05-8446-435c-b01d-130003053982 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:21.684462 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13daf05-8446-435c-b01d-130003053982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:21.684733 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13daf05-8446-435c-b01d-130003053982 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:21.685346 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13daf05-8446-435c-b01d-130003053982 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:21.687301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13daf05-8446-435c-b01d-130003053982 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:21.713540 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1273/2559] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:10:21 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:21.717470 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6efe03-10d0-438d-97de-c834e954e826 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:21.728444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6efe03-10d0-438d-97de-c834e954e826 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:21.782978 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6b8c5-4022-46ff-9515-b285012092bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:21.784111 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6b8c5-4022-46ff-9515-b285012092bc admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:21.784388 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6b8c5-4022-46ff-9515-b285012092bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:21.784654 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6b8c5-4022-46ff-9515-b285012092bc admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:21.785264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6b8c5-4022-46ff-9515-b285012092bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:21.787168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6b8c5-4022-46ff-9515-b285012092bc admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:21.808014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1287/2560] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:10:21 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:21.812006 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13daf05-8446-435c-b01d-130003053982 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:21.822136 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13daf05-8446-435c-b01d-130003053982 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:21.826702 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990d63b-c029-4a87-92d6-fd8904850f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:21.827290 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990d63b-c029-4a87-92d6-fd8904850f16 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:21.827584 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990d63b-c029-4a87-92d6-fd8904850f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:21.827831 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990d63b-c029-4a87-92d6-fd8904850f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:21.828461 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990d63b-c029-4a87-92d6-fd8904850f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:21.830085 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990d63b-c029-4a87-92d6-fd8904850f16 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:21.840788 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1274/2561] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:21.844679 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6b8c5-4022-46ff-9515-b285012092bc admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:21.855532 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6b8c5-4022-46ff-9515-b285012092bc admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:21.861529 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c3115-3d0a-482e-bb79-9ab833f39596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:21.862725 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c3115-3d0a-482e-bb79-9ab833f39596 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:21.863003 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c3115-3d0a-482e-bb79-9ab833f39596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:21.863272 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c3115-3d0a-482e-bb79-9ab833f39596 admin admin] PATH_INFO: `/v3/projects/53338ee6a92f44caadee8f26f154aa98/users/7b237a6a89554e979d3ac1c595f97687/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:21.878217 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c3115-3d0a-482e-bb79-9ab833f39596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53338ee6a92f44caadee8f26f154aa98, user_id=7b237a6a89554e979d3ac1c595f97687, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:21.880823 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c3115-3d0a-482e-bb79-9ab833f39596 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:21.892954 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1288/2562] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:10:21 2022] PUT /identity/v3/projects/53338ee6a92f44caadee8f26f154aa98/users/7b237a6a89554e979d3ac1c595f97687/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:21.896942 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990d63b-c029-4a87-92d6-fd8904850f16 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:21.906791 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990d63b-c029-4a87-92d6-fd8904850f16 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:21.953591 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:21.968117 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6064972-f6a6-4b47-8772-86d25efd1966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:21.968728 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6064972-f6a6-4b47-8772-86d25efd1966 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:21.969012 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6064972-f6a6-4b47-8772-86d25efd1966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:21.969408 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6064972-f6a6-4b47-8772-86d25efd1966 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:21.972833 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6064972-f6a6-4b47-8772-86d25efd1966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:21.974522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6064972-f6a6-4b47-8772-86d25efd1966 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:21.984569 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1275/2563] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:21.989094 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c3115-3d0a-482e-bb79-9ab833f39596 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:22.000427 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c3115-3d0a-482e-bb79-9ab833f39596 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:22.005169 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c562b-29f7-49a4-a7a9-1278bc597b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:22.005890 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c562b-29f7-49a4-a7a9-1278bc597b82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:22.006167 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c562b-29f7-49a4-a7a9-1278bc597b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:22.006437 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c562b-29f7-49a4-a7a9-1278bc597b82 admin admin] PATH_INFO: `/v3/projects/53338ee6a92f44caadee8f26f154aa98/users/7b237a6a89554e979d3ac1c595f97687/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:22.008409 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c562b-29f7-49a4-a7a9-1278bc597b82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53338ee6a92f44caadee8f26f154aa98, user_id=7b237a6a89554e979d3ac1c595f97687, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:22.011081 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c562b-29f7-49a4-a7a9-1278bc597b82 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:22.021688 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1289/2564] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:10:21 2022] PUT /identity/v3/projects/53338ee6a92f44caadee8f26f154aa98/users/7b237a6a89554e979d3ac1c595f97687/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:22.033136 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ede17-9be3-448b-99b6-e242e937e430 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:22.033368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ede17-9be3-448b-99b6-e242e937e430 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:22.034209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ede17-9be3-448b-99b6-e242e937e430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:22.062728 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-da6ede17-9be3-448b-99b6-e242e937e430 None None] MFA Rules not processed for user `7b237a6a89554e979d3ac1c595f97687`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:22.063936 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-da6ede17-9be3-448b-99b6-e242e937e430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:22.134670 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1276/2565] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:22 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:22.145294 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c562b-29f7-49a4-a7a9-1278bc597b82 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:22.147147 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-dc1c562b-29f7-49a4-a7a9-1278bc597b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:22.210741 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c562b-29f7-49a4-a7a9-1278bc597b82 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:22.215330 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2414f7-e2ee-4b42-9a87-3d48c8613357 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:22.216064 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2414f7-e2ee-4b42-9a87-3d48c8613357 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:22.216384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2414f7-e2ee-4b42-9a87-3d48c8613357 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:22.216735 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2414f7-e2ee-4b42-9a87-3d48c8613357 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:22.226817 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2414f7-e2ee-4b42-9a87-3d48c8613357 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:22.228926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2414f7-e2ee-4b42-9a87-3d48c8613357 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:22.242180 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1290/2566] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:22 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:10:22.711405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ede17-9be3-448b-99b6-e242e937e430 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:22.772562 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ede17-9be3-448b-99b6-e242e937e430 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:22.777281 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8b723-1d17-4370-adb0-6b91d86cd267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:22.777933 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8b723-1d17-4370-adb0-6b91d86cd267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:22.778207 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8b723-1d17-4370-adb0-6b91d86cd267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:22.778479 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8b723-1d17-4370-adb0-6b91d86cd267 admin admin] PATH_INFO: `/v3/users/f22c9e9a3ced42d78d6c03bb9241229f` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:22.779700 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8b723-1d17-4370-adb0-6b91d86cd267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f22c9e9a3ced42d78d6c03bb9241229f)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:22.781589 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8b723-1d17-4370-adb0-6b91d86cd267 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:22.826253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-dfb8b723-1d17-4370-adb0-6b91d86cd267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f22c9e9a3ced42d78d6c03bb9241229f'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:22.826820 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-dfb8b723-1d17-4370-adb0-6b91d86cd267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f22c9e9a3ced42d78d6c03bb9241229f'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:22.834723 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-dfb8b723-1d17-4370-adb0-6b91d86cd267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f22c9e9a3ced42d78d6c03bb9241229f'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:22.845365 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:22.847354 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-dfb8b723-1d17-4370-adb0-6b91d86cd267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f22c9e9a3ced42d78d6c03bb9241229f'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:22.848121 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-dfb8b723-1d17-4370-adb0-6b91d86cd267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f22c9e9a3ced42d78d6c03bb9241229f'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:22.867914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1277/2567] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:10:22 2022] DELETE /identity/v3/users/f22c9e9a3ced42d78d6c03bb9241229f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:22.872570 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362de2c-aa79-44c4-9fe5-0e053b8751f9 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:22.873008 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362de2c-aa79-44c4-9fe5-0e053b8751f9 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:22.873458 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362de2c-aa79-44c4-9fe5-0e053b8751f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:22.893468 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-c362de2c-aa79-44c4-9fe5-0e053b8751f9 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:22.894707 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c362de2c-aa79-44c4-9fe5-0e053b8751f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:22.911737 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:22.953001 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1291/2568] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:22.970733 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8b723-1d17-4370-adb0-6b91d86cd267 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:22.972946 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-dfb8b723-1d17-4370-adb0-6b91d86cd267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:23.032921 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8b723-1d17-4370-adb0-6b91d86cd267 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:23.036595 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fc88a-75db-4004-b915-41b70cfeddc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:23.037184 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fc88a-75db-4004-b915-41b70cfeddc8 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:23.037455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fc88a-75db-4004-b915-41b70cfeddc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:23.037718 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fc88a-75db-4004-b915-41b70cfeddc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:23.046449 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fc88a-75db-4004-b915-41b70cfeddc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:23.047857 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fc88a-75db-4004-b915-41b70cfeddc8 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:23.056943 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1278/2569] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 01:10:23.322483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362de2c-aa79-44c4-9fe5-0e053b8751f9 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:23.325759 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c362de2c-aa79-44c4-9fe5-0e053b8751f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:23.338631 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362de2c-aa79-44c4-9fe5-0e053b8751f9 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:23.344294 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09887929-d9f7-4d9f-847d-6bbdeb8a4d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:23.344926 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09887929-d9f7-4d9f-847d-6bbdeb8a4d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:23.345200 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09887929-d9f7-4d9f-847d-6bbdeb8a4d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:23.345646 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09887929-d9f7-4d9f-847d-6bbdeb8a4d4e admin admin] PATH_INFO: `/v3/projects/fa02b6f367e9428583fa4e1c84fdb3d6` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:23.347296 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09887929-d9f7-4d9f-847d-6bbdeb8a4d4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa02b6f367e9428583fa4e1c84fdb3d6)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:23.349236 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09887929-d9f7-4d9f-847d-6bbdeb8a4d4e admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:23.399655 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-09887929-d9f7-4d9f-847d-6bbdeb8a4d4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa02b6f367e9428583fa4e1c84fdb3d6', 'request_id': 'req-09887929-d9f7-4d9f-847d-6bbdeb8a4d4e'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:23.407790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-09887929-d9f7-4d9f-847d-6bbdeb8a4d4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa02b6f367e9428583fa4e1c84fdb3d6', 'request_id': 'req-09887929-d9f7-4d9f-847d-6bbdeb8a4d4e'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:23.416596 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-09887929-d9f7-4d9f-847d-6bbdeb8a4d4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa02b6f367e9428583fa4e1c84fdb3d6', 'request_id': 'req-09887929-d9f7-4d9f-847d-6bbdeb8a4d4e'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:23.427616 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-09887929-d9f7-4d9f-847d-6bbdeb8a4d4e admin admin] The token cache is being invalidate because project fa02b6f367e9428583fa4e1c84fdb3d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:10:23.427906 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-09887929-d9f7-4d9f-847d-6bbdeb8a4d4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:23.428653 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-09887929-d9f7-4d9f-847d-6bbdeb8a4d4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:23.430506 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1292/2570] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:10:23 2022] DELETE /identity/v3/projects/fa02b6f367e9428583fa4e1c84fdb3d6 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:23.434279 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fc88a-75db-4004-b915-41b70cfeddc8 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:23.444660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fc88a-75db-4004-b915-41b70cfeddc8 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:23.500475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53e9c5-7020-418f-9844-91bbff78d3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:23.501124 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53e9c5-7020-418f-9844-91bbff78d3ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:23.501396 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53e9c5-7020-418f-9844-91bbff78d3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:23.501662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53e9c5-7020-418f-9844-91bbff78d3ad admin admin] PATH_INFO: `/v3/users/7b237a6a89554e979d3ac1c595f97687` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:23.503323 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53e9c5-7020-418f-9844-91bbff78d3ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b237a6a89554e979d3ac1c595f97687)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:23.505210 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53e9c5-7020-418f-9844-91bbff78d3ad admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:23.560587 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9f53e9c5-7020-418f-9844-91bbff78d3ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b237a6a89554e979d3ac1c595f97687'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:23.561231 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9f53e9c5-7020-418f-9844-91bbff78d3ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b237a6a89554e979d3ac1c595f97687'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:23.573105 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9f53e9c5-7020-418f-9844-91bbff78d3ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b237a6a89554e979d3ac1c595f97687'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:23.589161 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9f53e9c5-7020-418f-9844-91bbff78d3ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b237a6a89554e979d3ac1c595f97687'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:23.589943 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9f53e9c5-7020-418f-9844-91bbff78d3ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b237a6a89554e979d3ac1c595f97687'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:23.604513 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1279/2571] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:10:23 2022] DELETE /identity/v3/users/7b237a6a89554e979d3ac1c595f97687 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:23.876101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09887929-d9f7-4d9f-847d-6bbdeb8a4d4e admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:23.878561 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-09887929-d9f7-4d9f-847d-6bbdeb8a4d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:23.892906 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09887929-d9f7-4d9f-847d-6bbdeb8a4d4e admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:23.950171 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59e4a5-d877-4fab-a57b-5f134254ebbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:23.950792 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59e4a5-d877-4fab-a57b-5f134254ebbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:23.951067 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59e4a5-d877-4fab-a57b-5f134254ebbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:23.951336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59e4a5-d877-4fab-a57b-5f134254ebbc admin admin] PATH_INFO: `/v3/projects/53338ee6a92f44caadee8f26f154aa98` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:23.952423 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59e4a5-d877-4fab-a57b-5f134254ebbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=53338ee6a92f44caadee8f26f154aa98)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:23.954391 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59e4a5-d877-4fab-a57b-5f134254ebbc admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:24.000473 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:24.001960 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0a59e4a5-d877-4fab-a57b-5f134254ebbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53338ee6a92f44caadee8f26f154aa98', 'request_id': 'req-0a59e4a5-d877-4fab-a57b-5f134254ebbc'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:24.010583 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0a59e4a5-d877-4fab-a57b-5f134254ebbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53338ee6a92f44caadee8f26f154aa98', 'request_id': 'req-0a59e4a5-d877-4fab-a57b-5f134254ebbc'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:24.017474 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0a59e4a5-d877-4fab-a57b-5f134254ebbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53338ee6a92f44caadee8f26f154aa98', 'request_id': 'req-0a59e4a5-d877-4fab-a57b-5f134254ebbc'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:24.027920 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0a59e4a5-d877-4fab-a57b-5f134254ebbc admin admin] The token cache is being invalidate because project 53338ee6a92f44caadee8f26f154aa98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:10:24.028207 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0a59e4a5-d877-4fab-a57b-5f134254ebbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:24.028831 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0a59e4a5-d877-4fab-a57b-5f134254ebbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:24.030333 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1293/2572] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:10:23 2022] DELETE /identity/v3/projects/53338ee6a92f44caadee8f26f154aa98 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:24.035212 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62d3b1-f5bd-469a-a2bc-15cd2cf2b43e None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:24.035692 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62d3b1-f5bd-469a-a2bc-15cd2cf2b43e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:24.035797 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62d3b1-f5bd-469a-a2bc-15cd2cf2b43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:24.055238 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-ae62d3b1-f5bd-469a-a2bc-15cd2cf2b43e None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:24.056417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ae62d3b1-f5bd-469a-a2bc-15cd2cf2b43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:24.061501 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:24.116997 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1280/2573] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:24.125191 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ef570-1e2a-4fbd-ab8c-a63f0ee8207d None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:24.125474 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ef570-1e2a-4fbd-ab8c-a63f0ee8207d None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:24.125744 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ef570-1e2a-4fbd-ab8c-a63f0ee8207d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:24.146124 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-4c7ef570-1e2a-4fbd-ab8c-a63f0ee8207d None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:24.147316 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4c7ef570-1e2a-4fbd-ab8c-a63f0ee8207d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:24.155330 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1294/2574] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:24.159555 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62d3b1-f5bd-469a-a2bc-15cd2cf2b43e None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:24.169080 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62d3b1-f5bd-469a-a2bc-15cd2cf2b43e None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:24.173589 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8216744-68b4-4f8f-997f-1aa2c11d3fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:24.174740 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8216744-68b4-4f8f-997f-1aa2c11d3fde admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:24.175014 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8216744-68b4-4f8f-997f-1aa2c11d3fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:24.175282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8216744-68b4-4f8f-997f-1aa2c11d3fde admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:24.175907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8216744-68b4-4f8f-997f-1aa2c11d3fde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:10:24.176208 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8216744-68b4-4f8f-997f-1aa2c11d3fde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:24.177787 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8216744-68b4-4f8f-997f-1aa2c11d3fde admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:24.190252 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1281/2575] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:10:24.195733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ef570-1e2a-4fbd-ab8c-a63f0ee8207d None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:24.205521 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ef570-1e2a-4fbd-ab8c-a63f0ee8207d None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:24.212226 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6be053-7fd4-48ad-a7c5-7cfc2ffb346b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:24.212913 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6be053-7fd4-48ad-a7c5-7cfc2ffb346b admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:24.213195 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6be053-7fd4-48ad-a7c5-7cfc2ffb346b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:24.213469 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6be053-7fd4-48ad-a7c5-7cfc2ffb346b admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:24.214139 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6be053-7fd4-48ad-a7c5-7cfc2ffb346b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:24.216048 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6be053-7fd4-48ad-a7c5-7cfc2ffb346b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:24.243767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1295/2576] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:10:24 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:24.248038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8216744-68b4-4f8f-997f-1aa2c11d3fde admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:24.257776 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8216744-68b4-4f8f-997f-1aa2c11d3fde admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:24.313525 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa5023-8727-485c-83db-a29bb7b308e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:24.314152 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa5023-8727-485c-83db-a29bb7b308e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:24.314455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa5023-8727-485c-83db-a29bb7b308e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:24.314777 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa5023-8727-485c-83db-a29bb7b308e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:24.315395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa5023-8727-485c-83db-a29bb7b308e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:24.317302 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa5023-8727-485c-83db-a29bb7b308e6 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:24.337117 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1282/2577] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:10:24 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:24.341611 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6be053-7fd4-48ad-a7c5-7cfc2ffb346b admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:24.352987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6be053-7fd4-48ad-a7c5-7cfc2ffb346b admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:24.357765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e6469-50f6-49d1-b53e-d0ed6cebd9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:24.358386 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e6469-50f6-49d1-b53e-d0ed6cebd9ed admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:24.358663 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e6469-50f6-49d1-b53e-d0ed6cebd9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:24.358934 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e6469-50f6-49d1-b53e-d0ed6cebd9ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:24.359569 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e6469-50f6-49d1-b53e-d0ed6cebd9ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:24.361154 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e6469-50f6-49d1-b53e-d0ed6cebd9ed admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:24.371711 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1296/2578] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:24.375528 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa5023-8727-485c-83db-a29bb7b308e6 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:24.385100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa5023-8727-485c-83db-a29bb7b308e6 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:24.389564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb9fdc-b9f8-4f64-a6bb-627a55b95345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:24.390171 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb9fdc-b9f8-4f64-a6bb-627a55b95345 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:24.390445 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb9fdc-b9f8-4f64-a6bb-627a55b95345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:24.390712 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb9fdc-b9f8-4f64-a6bb-627a55b95345 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:24.391335 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb9fdc-b9f8-4f64-a6bb-627a55b95345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:24.392932 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb9fdc-b9f8-4f64-a6bb-627a55b95345 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:24.403326 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1283/2579] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:24.407139 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e6469-50f6-49d1-b53e-d0ed6cebd9ed admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:24.417593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e6469-50f6-49d1-b53e-d0ed6cebd9ed admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:24.422194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d753b-01f0-45f4-b357-a1f869e006e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:24.422824 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d753b-01f0-45f4-b357-a1f869e006e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:24.423101 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d753b-01f0-45f4-b357-a1f869e006e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:24.423386 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d753b-01f0-45f4-b357-a1f869e006e5 admin admin] PATH_INFO: `/v3/projects/2a541e902b5e4b86bc086722492f557d/users/fa348a47e6af4d4da380067fad5c4331/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:24.438286 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d753b-01f0-45f4-b357-a1f869e006e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a541e902b5e4b86bc086722492f557d, user_id=fa348a47e6af4d4da380067fad5c4331, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:24.440890 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d753b-01f0-45f4-b357-a1f869e006e5 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:24.454041 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1297/2580] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:10:24 2022] PUT /identity/v3/projects/2a541e902b5e4b86bc086722492f557d/users/fa348a47e6af4d4da380067fad5c4331/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:24.463969 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86149031-dcb5-4c2c-a707-989b19440e51 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:24.464222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86149031-dcb5-4c2c-a707-989b19440e51 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:24.464499 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86149031-dcb5-4c2c-a707-989b19440e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:24.492825 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-86149031-dcb5-4c2c-a707-989b19440e51 None None] MFA Rules not processed for user `fa348a47e6af4d4da380067fad5c4331`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:24.494091 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-86149031-dcb5-4c2c-a707-989b19440e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:24.557651 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1284/2581] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:24.562127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d753b-01f0-45f4-b357-a1f869e006e5 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:24.628896 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d753b-01f0-45f4-b357-a1f869e006e5 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:24.633541 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e43e21-2752-4d15-bc4f-9fbd219ed53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:24.634180 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e43e21-2752-4d15-bc4f-9fbd219ed53d admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:24.634464 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e43e21-2752-4d15-bc4f-9fbd219ed53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:24.634736 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e43e21-2752-4d15-bc4f-9fbd219ed53d admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:24.635369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e43e21-2752-4d15-bc4f-9fbd219ed53d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:24.637244 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e43e21-2752-4d15-bc4f-9fbd219ed53d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:24.667965 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1298/2582] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:10:24 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:24.669066 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86149031-dcb5-4c2c-a707-989b19440e51 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:24.680240 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86149031-dcb5-4c2c-a707-989b19440e51 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:24.683923 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:24.745548 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e63fe-289d-4a0f-8795-e3fcf848dec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:24.746178 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e63fe-289d-4a0f-8795-e3fcf848dec2 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:24.746504 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e63fe-289d-4a0f-8795-e3fcf848dec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:24.746771 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e63fe-289d-4a0f-8795-e3fcf848dec2 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:24.747398 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e63fe-289d-4a0f-8795-e3fcf848dec2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:24.749386 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e63fe-289d-4a0f-8795-e3fcf848dec2 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:24.771782 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1285/2583] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:10:24 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:10:24.776172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e43e21-2752-4d15-bc4f-9fbd219ed53d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:24.787354 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e43e21-2752-4d15-bc4f-9fbd219ed53d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:24.792737 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ecc99-8c7d-427a-84e2-f4e2b6ac35e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:24.793340 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ecc99-8c7d-427a-84e2-f4e2b6ac35e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:24.793617 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ecc99-8c7d-427a-84e2-f4e2b6ac35e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:24.793920 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ecc99-8c7d-427a-84e2-f4e2b6ac35e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:24.794702 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ecc99-8c7d-427a-84e2-f4e2b6ac35e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:24.796304 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ecc99-8c7d-427a-84e2-f4e2b6ac35e0 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:24.810226 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1299/2584] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:24.814288 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e63fe-289d-4a0f-8795-e3fcf848dec2 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:24.824204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e63fe-289d-4a0f-8795-e3fcf848dec2 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:24.828831 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f7307-f647-4932-abe1-42fbbb51f63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:24.829475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f7307-f647-4932-abe1-42fbbb51f63f admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:24.829729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f7307-f647-4932-abe1-42fbbb51f63f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:24.830028 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f7307-f647-4932-abe1-42fbbb51f63f admin admin] PATH_INFO: `/v3/projects/6aca8c885ac14d45a6a58eab8e376c54/users/4dbfc19e479d42c09da91ba393435b7e/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:24.847332 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f7307-f647-4932-abe1-42fbbb51f63f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aca8c885ac14d45a6a58eab8e376c54, user_id=4dbfc19e479d42c09da91ba393435b7e, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:24.850198 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f7307-f647-4932-abe1-42fbbb51f63f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:24.866154 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1286/2585] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:10:24 2022] PUT /identity/v3/projects/6aca8c885ac14d45a6a58eab8e376c54/users/4dbfc19e479d42c09da91ba393435b7e/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:24.870104 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ecc99-8c7d-427a-84e2-f4e2b6ac35e0 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:24.879996 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ecc99-8c7d-427a-84e2-f4e2b6ac35e0 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:24.924891 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:24.941386 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd15917-d797-465a-bdb4-638d773c931b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:24.942014 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd15917-d797-465a-bdb4-638d773c931b admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:24.942289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd15917-d797-465a-bdb4-638d773c931b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:24.942553 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd15917-d797-465a-bdb4-638d773c931b admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:24.943247 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd15917-d797-465a-bdb4-638d773c931b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:24.944884 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd15917-d797-465a-bdb4-638d773c931b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:24.954815 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1300/2586] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:24.959675 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f7307-f647-4932-abe1-42fbbb51f63f admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:24.969903 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f7307-f647-4932-abe1-42fbbb51f63f admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:24.974740 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d371dc-fb3f-4f52-a1fb-3ea541004578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:24.975427 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d371dc-fb3f-4f52-a1fb-3ea541004578 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:24.975702 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d371dc-fb3f-4f52-a1fb-3ea541004578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:24.975969 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d371dc-fb3f-4f52-a1fb-3ea541004578 admin admin] PATH_INFO: `/v3/projects/6aca8c885ac14d45a6a58eab8e376c54/users/4dbfc19e479d42c09da91ba393435b7e/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:24.977943 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d371dc-fb3f-4f52-a1fb-3ea541004578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aca8c885ac14d45a6a58eab8e376c54, user_id=4dbfc19e479d42c09da91ba393435b7e, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:24.980733 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d371dc-fb3f-4f52-a1fb-3ea541004578 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:24.991661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1287/2587] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:10:24 2022] PUT /identity/v3/projects/6aca8c885ac14d45a6a58eab8e376c54/users/4dbfc19e479d42c09da91ba393435b7e/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:25.004129 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03526d9a-8694-4bcb-8653-32aa16f9b537 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:25.004416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03526d9a-8694-4bcb-8653-32aa16f9b537 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:25.004689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03526d9a-8694-4bcb-8653-32aa16f9b537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:25.036256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-03526d9a-8694-4bcb-8653-32aa16f9b537 None None] MFA Rules not processed for user `4dbfc19e479d42c09da91ba393435b7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:25.037561 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-03526d9a-8694-4bcb-8653-32aa16f9b537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:25.115605 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1301/2588] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:10:25.126404 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d371dc-fb3f-4f52-a1fb-3ea541004578 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:25.128594 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-71d371dc-fb3f-4f52-a1fb-3ea541004578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:25.187508 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d371dc-fb3f-4f52-a1fb-3ea541004578 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:25.191629 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7797e-a830-473d-8d0d-a97d20eca0c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:25.192215 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7797e-a830-473d-8d0d-a97d20eca0c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:25.192482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7797e-a830-473d-8d0d-a97d20eca0c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:25.192743 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7797e-a830-473d-8d0d-a97d20eca0c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:25.247275 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7797e-a830-473d-8d0d-a97d20eca0c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:25.248695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7797e-a830-473d-8d0d-a97d20eca0c8 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:25.257876 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1288/2589] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:10:29.472174 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03526d9a-8694-4bcb-8653-32aa16f9b537 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:29.481675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03526d9a-8694-4bcb-8653-32aa16f9b537 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:29.485116 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b6ca2-cba5-43b9-b530-24a2808e3cab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:29.485697 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b6ca2-cba5-43b9-b530-24a2808e3cab service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:29.486016 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b6ca2-cba5-43b9-b530-24a2808e3cab service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:29.486315 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b6ca2-cba5-43b9-b530-24a2808e3cab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:29.495469 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b6ca2-cba5-43b9-b530-24a2808e3cab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:29.496873 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b6ca2-cba5-43b9-b530-24a2808e3cab service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:29.505991 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1302/2590] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:10:34.405470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7797e-a830-473d-8d0d-a97d20eca0c8 service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:34.418076 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:34.467860 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7797e-a830-473d-8d0d-a97d20eca0c8 service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:34.472660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e791306-aa5e-48c8-9c43-79937dff208d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:34.473365 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e791306-aa5e-48c8-9c43-79937dff208d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:34.473675 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e791306-aa5e-48c8-9c43-79937dff208d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:34.473973 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e791306-aa5e-48c8-9c43-79937dff208d admin admin] PATH_INFO: `/v3/users/fa348a47e6af4d4da380067fad5c4331` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:34.475081 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e791306-aa5e-48c8-9c43-79937dff208d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa348a47e6af4d4da380067fad5c4331)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:34.476997 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e791306-aa5e-48c8-9c43-79937dff208d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:34.522649 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8e791306-aa5e-48c8-9c43-79937dff208d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa348a47e6af4d4da380067fad5c4331'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:34.523271 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8e791306-aa5e-48c8-9c43-79937dff208d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa348a47e6af4d4da380067fad5c4331'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:34.530457 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8e791306-aa5e-48c8-9c43-79937dff208d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa348a47e6af4d4da380067fad5c4331'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:34.542501 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8e791306-aa5e-48c8-9c43-79937dff208d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa348a47e6af4d4da380067fad5c4331'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:34.543143 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8e791306-aa5e-48c8-9c43-79937dff208d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa348a47e6af4d4da380067fad5c4331'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:34.556379 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1289/2591] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:10:34 2022] DELETE /identity/v3/users/fa348a47e6af4d4da380067fad5c4331 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:34.560934 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b88bd1-a7d4-44c7-92e7-be6e721016df None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:34.561419 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b88bd1-a7d4-44c7-92e7-be6e721016df None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:34.561529 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b88bd1-a7d4-44c7-92e7-be6e721016df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:34.580571 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-c2b88bd1-a7d4-44c7-92e7-be6e721016df None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:34.581767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c2b88bd1-a7d4-44c7-92e7-be6e721016df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:34.639126 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1303/2592] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:34.649424 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e791306-aa5e-48c8-9c43-79937dff208d admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:34.651105 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8e791306-aa5e-48c8-9c43-79937dff208d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:34.709776 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e791306-aa5e-48c8-9c43-79937dff208d admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:34.713385 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155824b-e5a7-411d-8807-5014869f71a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:34.714005 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155824b-e5a7-411d-8807-5014869f71a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:34.714285 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155824b-e5a7-411d-8807-5014869f71a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:34.714553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155824b-e5a7-411d-8807-5014869f71a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:34.724165 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155824b-e5a7-411d-8807-5014869f71a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:34.725621 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155824b-e5a7-411d-8807-5014869f71a5 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:34.735610 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1290/2593] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:10:35.029357 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b88bd1-a7d4-44c7-92e7-be6e721016df None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:35.030872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c2b88bd1-a7d4-44c7-92e7-be6e721016df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:35.044606 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b88bd1-a7d4-44c7-92e7-be6e721016df None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:35.050709 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0043696-f46a-4b0e-b22d-66bfd18a5af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:35.051344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0043696-f46a-4b0e-b22d-66bfd18a5af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:35.051619 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0043696-f46a-4b0e-b22d-66bfd18a5af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:35.051887 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0043696-f46a-4b0e-b22d-66bfd18a5af8 admin admin] PATH_INFO: `/v3/projects/2a541e902b5e4b86bc086722492f557d` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:35.053239 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0043696-f46a-4b0e-b22d-66bfd18a5af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a541e902b5e4b86bc086722492f557d)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:35.055091 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0043696-f46a-4b0e-b22d-66bfd18a5af8 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:35.103438 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f0043696-f46a-4b0e-b22d-66bfd18a5af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a541e902b5e4b86bc086722492f557d', 'request_id': 'req-f0043696-f46a-4b0e-b22d-66bfd18a5af8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:35.105041 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:35.111055 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f0043696-f46a-4b0e-b22d-66bfd18a5af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a541e902b5e4b86bc086722492f557d', 'request_id': 'req-f0043696-f46a-4b0e-b22d-66bfd18a5af8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:35.118917 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f0043696-f46a-4b0e-b22d-66bfd18a5af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a541e902b5e4b86bc086722492f557d', 'request_id': 'req-f0043696-f46a-4b0e-b22d-66bfd18a5af8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:35.130922 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f0043696-f46a-4b0e-b22d-66bfd18a5af8 admin admin] The token cache is being invalidate because project 2a541e902b5e4b86bc086722492f557d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:10:35.131207 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f0043696-f46a-4b0e-b22d-66bfd18a5af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:35.131851 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f0043696-f46a-4b0e-b22d-66bfd18a5af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:35.133351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1304/2594] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:10:35 2022] DELETE /identity/v3/projects/2a541e902b5e4b86bc086722492f557d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:35.137686 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155824b-e5a7-411d-8807-5014869f71a5 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:35.148543 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155824b-e5a7-411d-8807-5014869f71a5 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:35.182604 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:35.215540 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6504a-4316-4350-b35f-1d706b8a64ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:35.216572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6504a-4316-4350-b35f-1d706b8a64ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:35.217056 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6504a-4316-4350-b35f-1d706b8a64ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:35.217341 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6504a-4316-4350-b35f-1d706b8a64ee admin admin] PATH_INFO: `/v3/users/4dbfc19e479d42c09da91ba393435b7e` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:35.218508 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6504a-4316-4350-b35f-1d706b8a64ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dbfc19e479d42c09da91ba393435b7e)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:35.221237 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6504a-4316-4350-b35f-1d706b8a64ee admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:35.269691 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4fe6504a-4316-4350-b35f-1d706b8a64ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dbfc19e479d42c09da91ba393435b7e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:35.270440 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4fe6504a-4316-4350-b35f-1d706b8a64ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dbfc19e479d42c09da91ba393435b7e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:35.278406 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4fe6504a-4316-4350-b35f-1d706b8a64ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dbfc19e479d42c09da91ba393435b7e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:35.291234 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4fe6504a-4316-4350-b35f-1d706b8a64ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dbfc19e479d42c09da91ba393435b7e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:35.291898 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4fe6504a-4316-4350-b35f-1d706b8a64ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dbfc19e479d42c09da91ba393435b7e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:35.304317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1291/2595] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:10:35 2022] DELETE /identity/v3/users/4dbfc19e479d42c09da91ba393435b7e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:35.591272 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0043696-f46a-4b0e-b22d-66bfd18a5af8 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:35.592819 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f0043696-f46a-4b0e-b22d-66bfd18a5af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:35.606320 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0043696-f46a-4b0e-b22d-66bfd18a5af8 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:35.664172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd7e1c-d260-40ab-a897-f6b61307611f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:35.664715 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd7e1c-d260-40ab-a897-f6b61307611f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:35.664993 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd7e1c-d260-40ab-a897-f6b61307611f admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:35.665264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd7e1c-d260-40ab-a897-f6b61307611f admin admin] PATH_INFO: `/v3/projects/6aca8c885ac14d45a6a58eab8e376c54` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:35.666395 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd7e1c-d260-40ab-a897-f6b61307611f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aca8c885ac14d45a6a58eab8e376c54)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:35.668294 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd7e1c-d260-40ab-a897-f6b61307611f admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:35.714504 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e8bd7e1c-d260-40ab-a897-f6b61307611f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aca8c885ac14d45a6a58eab8e376c54', 'request_id': 'req-e8bd7e1c-d260-40ab-a897-f6b61307611f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:35.721902 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e8bd7e1c-d260-40ab-a897-f6b61307611f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aca8c885ac14d45a6a58eab8e376c54', 'request_id': 'req-e8bd7e1c-d260-40ab-a897-f6b61307611f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:35.728169 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e8bd7e1c-d260-40ab-a897-f6b61307611f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aca8c885ac14d45a6a58eab8e376c54', 'request_id': 'req-e8bd7e1c-d260-40ab-a897-f6b61307611f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:35.738443 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e8bd7e1c-d260-40ab-a897-f6b61307611f admin admin] The token cache is being invalidate because project 6aca8c885ac14d45a6a58eab8e376c54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:10:35.738738 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e8bd7e1c-d260-40ab-a897-f6b61307611f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:35.739398 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e8bd7e1c-d260-40ab-a897-f6b61307611f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:35.740877 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1305/2596] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:10:35 2022] DELETE /identity/v3/projects/6aca8c885ac14d45a6a58eab8e376c54 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:35.746926 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1adc8-e9b3-46e7-be45-bc40441d4909 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:35.747441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1adc8-e9b3-46e7-be45-bc40441d4909 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:35.747536 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1adc8-e9b3-46e7-be45-bc40441d4909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:35.768626 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-3ec1adc8-e9b3-46e7-be45-bc40441d4909 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:35.769911 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3ec1adc8-e9b3-46e7-be45-bc40441d4909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:35.831667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1292/2597] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:35.839928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65659a9-af02-483d-8cdc-bb024a00b57c None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:35.840215 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65659a9-af02-483d-8cdc-bb024a00b57c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:35.840492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65659a9-af02-483d-8cdc-bb024a00b57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:35.861697 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-c65659a9-af02-483d-8cdc-bb024a00b57c None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:35.862960 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c65659a9-af02-483d-8cdc-bb024a00b57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:35.870855 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1306/2598] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:35.875029 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1adc8-e9b3-46e7-be45-bc40441d4909 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:35.885528 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1adc8-e9b3-46e7-be45-bc40441d4909 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:35.890335 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a5945-b04e-4760-9c5d-782b67d5089b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:35.890914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a5945-b04e-4760-9c5d-782b67d5089b admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:35.891188 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a5945-b04e-4760-9c5d-782b67d5089b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:35.891457 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a5945-b04e-4760-9c5d-782b67d5089b admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:35.892115 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a5945-b04e-4760-9c5d-782b67d5089b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:10:35.892442 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a5945-b04e-4760-9c5d-782b67d5089b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:35.894085 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a5945-b04e-4760-9c5d-782b67d5089b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:35.905588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1293/2599] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:10:35.909709 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65659a9-af02-483d-8cdc-bb024a00b57c None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:35.918814 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65659a9-af02-483d-8cdc-bb024a00b57c None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:35.923322 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7697e1-ccdc-4e73-af0c-a7141ec7a552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:35.924422 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7697e1-ccdc-4e73-af0c-a7141ec7a552 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:35.924701 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7697e1-ccdc-4e73-af0c-a7141ec7a552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:35.924973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7697e1-ccdc-4e73-af0c-a7141ec7a552 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:35.925587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7697e1-ccdc-4e73-af0c-a7141ec7a552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:35.927501 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7697e1-ccdc-4e73-af0c-a7141ec7a552 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:35.954871 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1307/2600] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:10:35 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:35.958972 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a5945-b04e-4760-9c5d-782b67d5089b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:35.969033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a5945-b04e-4760-9c5d-782b67d5089b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:36.009177 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:36.029033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d4905-f2c0-43c3-b8a2-26aead1b79d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:36.029670 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d4905-f2c0-43c3-b8a2-26aead1b79d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:36.029984 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d4905-f2c0-43c3-b8a2-26aead1b79d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:36.030252 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d4905-f2c0-43c3-b8a2-26aead1b79d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:36.030875 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d4905-f2c0-43c3-b8a2-26aead1b79d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:36.032779 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d4905-f2c0-43c3-b8a2-26aead1b79d0 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:36.060043 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1294/2601] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:10:35 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:36.063949 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7697e1-ccdc-4e73-af0c-a7141ec7a552 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:36.080542 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7697e1-ccdc-4e73-af0c-a7141ec7a552 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:36.098677 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1748e1e-de3b-4c78-b7ac-537d098bb3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:36.099470 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1748e1e-de3b-4c78-b7ac-537d098bb3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:36.099762 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1748e1e-de3b-4c78-b7ac-537d098bb3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:36.100031 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1748e1e-de3b-4c78-b7ac-537d098bb3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:36.101952 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1748e1e-de3b-4c78-b7ac-537d098bb3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:36.103737 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1748e1e-de3b-4c78-b7ac-537d098bb3b7 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:36.116842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1308/2602] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:36.120415 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d4905-f2c0-43c3-b8a2-26aead1b79d0 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:36.135496 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d4905-f2c0-43c3-b8a2-26aead1b79d0 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:36.138454 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bfae5f-7b27-4e06-b845-88a4299112b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:36.143588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfae5f-7b27-4e06-b845-88a4299112b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:36.143977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfae5f-7b27-4e06-b845-88a4299112b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:36.144330 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfae5f-7b27-4e06-b845-88a4299112b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:36.145117 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bfae5f-7b27-4e06-b845-88a4299112b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:36.146831 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bfae5f-7b27-4e06-b845-88a4299112b7 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:36.162553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1295/2603] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:36.163743 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1748e1e-de3b-4c78-b7ac-537d098bb3b7 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:36.176031 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1748e1e-de3b-4c78-b7ac-537d098bb3b7 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:36.184059 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e4dcf-6c0c-40b3-9d37-f694ad129a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:36.184801 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e4dcf-6c0c-40b3-9d37-f694ad129a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:36.185146 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e4dcf-6c0c-40b3-9d37-f694ad129a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:36.185834 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e4dcf-6c0c-40b3-9d37-f694ad129a9e admin admin] PATH_INFO: `/v3/projects/dc205bc73be149dca7978aefdd67593f/users/f3618ff5b1bc40c489ec1c35f0a31bd2/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:36.203911 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e4dcf-6c0c-40b3-9d37-f694ad129a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc205bc73be149dca7978aefdd67593f, user_id=f3618ff5b1bc40c489ec1c35f0a31bd2, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:36.207647 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e4dcf-6c0c-40b3-9d37-f694ad129a9e admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:36.226041 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1309/2604] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:10:36 2022] PUT /identity/v3/projects/dc205bc73be149dca7978aefdd67593f/users/f3618ff5b1bc40c489ec1c35f0a31bd2/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:36.238908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef1037-8abe-4c9d-8826-55307f355826 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:36.239192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef1037-8abe-4c9d-8826-55307f355826 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:36.239474 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef1037-8abe-4c9d-8826-55307f355826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:36.275967 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-b8ef1037-8abe-4c9d-8826-55307f355826 None None] MFA Rules not processed for user `f3618ff5b1bc40c489ec1c35f0a31bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:36.277203 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b8ef1037-8abe-4c9d-8826-55307f355826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:36.366402 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e4dcf-6c0c-40b3-9d37-f694ad129a9e admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:36.369282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1296/2605] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:36.373959 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:36.450257 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e4dcf-6c0c-40b3-9d37-f694ad129a9e admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:36.457579 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49019b6f-40f7-41c7-9832-635b68e1830f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:36.458243 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49019b6f-40f7-41c7-9832-635b68e1830f admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:36.458606 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49019b6f-40f7-41c7-9832-635b68e1830f admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:36.458959 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49019b6f-40f7-41c7-9832-635b68e1830f admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:36.459568 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49019b6f-40f7-41c7-9832-635b68e1830f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:36.462293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49019b6f-40f7-41c7-9832-635b68e1830f admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:36.506288 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1310/2606] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:10:36 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:36.510611 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef1037-8abe-4c9d-8826-55307f355826 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:36.526930 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef1037-8abe-4c9d-8826-55307f355826 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:36.629550 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e1649-1208-4ce2-b042-b0dda9a4225e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:36.630217 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e1649-1208-4ce2-b042-b0dda9a4225e admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:36.630492 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e1649-1208-4ce2-b042-b0dda9a4225e admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:36.630762 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e1649-1208-4ce2-b042-b0dda9a4225e admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:36.631400 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e1649-1208-4ce2-b042-b0dda9a4225e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:36.633362 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e1649-1208-4ce2-b042-b0dda9a4225e admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:36.657279 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1297/2607] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:10:36 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:36.663891 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49019b6f-40f7-41c7-9832-635b68e1830f admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:36.674748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49019b6f-40f7-41c7-9832-635b68e1830f admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:36.679393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5566ec4-74c8-4dd7-844c-c382be427523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:36.679934 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5566ec4-74c8-4dd7-844c-c382be427523 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:36.680211 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5566ec4-74c8-4dd7-844c-c382be427523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:36.680494 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5566ec4-74c8-4dd7-844c-c382be427523 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:36.681169 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5566ec4-74c8-4dd7-844c-c382be427523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:36.682860 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5566ec4-74c8-4dd7-844c-c382be427523 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:36.694144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1311/2608] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:36.698434 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e1649-1208-4ce2-b042-b0dda9a4225e admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:36.711003 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e1649-1208-4ce2-b042-b0dda9a4225e admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:36.716245 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac19e0-8894-4047-b120-7271382cc163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:36.716885 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac19e0-8894-4047-b120-7271382cc163 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:36.717158 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac19e0-8894-4047-b120-7271382cc163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:36.717448 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac19e0-8894-4047-b120-7271382cc163 admin admin] PATH_INFO: `/v3/projects/605f6b49354447da9dd30246c2f5b5fc/users/d4d038d67aef48fbbe2f594ebfd1acd1/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:36.733575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac19e0-8894-4047-b120-7271382cc163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=605f6b49354447da9dd30246c2f5b5fc, user_id=d4d038d67aef48fbbe2f594ebfd1acd1, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:36.736837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac19e0-8894-4047-b120-7271382cc163 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:36.749442 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1298/2609] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:10:36 2022] PUT /identity/v3/projects/605f6b49354447da9dd30246c2f5b5fc/users/d4d038d67aef48fbbe2f594ebfd1acd1/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:36.754031 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5566ec4-74c8-4dd7-844c-c382be427523 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:36.763766 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5566ec4-74c8-4dd7-844c-c382be427523 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:36.818756 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558249c7-7599-4a8f-a322-922429164e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:36.819351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558249c7-7599-4a8f-a322-922429164e3b admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:36.819629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558249c7-7599-4a8f-a322-922429164e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:36.819899 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558249c7-7599-4a8f-a322-922429164e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:36.820570 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558249c7-7599-4a8f-a322-922429164e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:36.822171 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558249c7-7599-4a8f-a322-922429164e3b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:36.831749 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1312/2610] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:36.836117 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac19e0-8894-4047-b120-7271382cc163 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:36.846136 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac19e0-8894-4047-b120-7271382cc163 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:36.850631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accef7c7-57e1-44a0-a5d4-f2e7ca893fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:36.851259 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accef7c7-57e1-44a0-a5d4-f2e7ca893fda admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:36.851533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accef7c7-57e1-44a0-a5d4-f2e7ca893fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:36.851800 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accef7c7-57e1-44a0-a5d4-f2e7ca893fda admin admin] PATH_INFO: `/v3/projects/605f6b49354447da9dd30246c2f5b5fc/users/d4d038d67aef48fbbe2f594ebfd1acd1/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:36.853660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accef7c7-57e1-44a0-a5d4-f2e7ca893fda admin admin] RBAC: Authorizing `identity:create_grant(project_id=605f6b49354447da9dd30246c2f5b5fc, user_id=d4d038d67aef48fbbe2f594ebfd1acd1, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:36.856293 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accef7c7-57e1-44a0-a5d4-f2e7ca893fda admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:36.866782 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1299/2611] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:10:36 2022] PUT /identity/v3/projects/605f6b49354447da9dd30246c2f5b5fc/users/d4d038d67aef48fbbe2f594ebfd1acd1/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:10:36.877312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf5c58-04c7-4b21-9948-2d6a43edba40 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:36.877608 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf5c58-04c7-4b21-9948-2d6a43edba40 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:36.877920 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf5c58-04c7-4b21-9948-2d6a43edba40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:36.905947 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-d3bf5c58-04c7-4b21-9948-2d6a43edba40 None None] MFA Rules not processed for user `d4d038d67aef48fbbe2f594ebfd1acd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:36.907156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d3bf5c58-04c7-4b21-9948-2d6a43edba40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:36.969446 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:36.973773 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1313/2612] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:36.984619 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accef7c7-57e1-44a0-a5d4-f2e7ca893fda admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:36.986921 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-accef7c7-57e1-44a0-a5d4-f2e7ca893fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:36.992113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:37.045560 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accef7c7-57e1-44a0-a5d4-f2e7ca893fda admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:37.049907 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c0a03-a90b-447f-b659-a10c6d39fcd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:37.050511 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c0a03-a90b-447f-b659-a10c6d39fcd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:37.050787 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c0a03-a90b-447f-b659-a10c6d39fcd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:37.051062 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c0a03-a90b-447f-b659-a10c6d39fcd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:37.107515 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c0a03-a90b-447f-b659-a10c6d39fcd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:37.108947 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c0a03-a90b-447f-b659-a10c6d39fcd2 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:37.118286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1300/2613] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:10:38.556971 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf5c58-04c7-4b21-9948-2d6a43edba40 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:38.558839 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d3bf5c58-04c7-4b21-9948-2d6a43edba40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:38.673773 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf5c58-04c7-4b21-9948-2d6a43edba40 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:38.680016 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0925a3-545b-473d-90de-217f31af7766 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:38.681627 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0925a3-545b-473d-90de-217f31af7766 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:38.682092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0925a3-545b-473d-90de-217f31af7766 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:38.682547 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0925a3-545b-473d-90de-217f31af7766 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:38.684657 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-9f0925a3-545b-473d-90de-217f31af7766 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:38.702288 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0925a3-545b-473d-90de-217f31af7766 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:38.704454 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0925a3-545b-473d-90de-217f31af7766 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:38.727604 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1314/2614] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:10:39.746555 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c0a03-a90b-447f-b659-a10c6d39fcd2 service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:39.807835 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c0a03-a90b-447f-b659-a10c6d39fcd2 service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:39.812290 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefb9f6-887a-4161-859e-ebe6e5134f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:39.812900 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefb9f6-887a-4161-859e-ebe6e5134f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:39.813177 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefb9f6-887a-4161-859e-ebe6e5134f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:39.813445 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefb9f6-887a-4161-859e-ebe6e5134f72 admin admin] PATH_INFO: `/v3/users/f3618ff5b1bc40c489ec1c35f0a31bd2` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:39.815204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eefb9f6-887a-4161-859e-ebe6e5134f72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3618ff5b1bc40c489ec1c35f0a31bd2)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:39.817114 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eefb9f6-887a-4161-859e-ebe6e5134f72 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:39.861577 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3eefb9f6-887a-4161-859e-ebe6e5134f72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3618ff5b1bc40c489ec1c35f0a31bd2'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:39.862256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3eefb9f6-887a-4161-859e-ebe6e5134f72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3618ff5b1bc40c489ec1c35f0a31bd2'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:39.869139 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3eefb9f6-887a-4161-859e-ebe6e5134f72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3618ff5b1bc40c489ec1c35f0a31bd2'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:39.871028 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:39.883087 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3eefb9f6-887a-4161-859e-ebe6e5134f72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3618ff5b1bc40c489ec1c35f0a31bd2'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:39.883764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3eefb9f6-887a-4161-859e-ebe6e5134f72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3618ff5b1bc40c489ec1c35f0a31bd2'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:39.896506 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1301/2615] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:10:39 2022] DELETE /identity/v3/users/f3618ff5b1bc40c489ec1c35f0a31bd2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:39.901324 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4f3d2-6ff5-4881-ad4a-e26407540c64 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:39.901778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4f3d2-6ff5-4881-ad4a-e26407540c64 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:39.901898 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4f3d2-6ff5-4881-ad4a-e26407540c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:39.920638 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-5ed4f3d2-6ff5-4881-ad4a-e26407540c64 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:39.921839 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5ed4f3d2-6ff5-4881-ad4a-e26407540c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:39.983969 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1315/2616] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:40.001656 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefb9f6-887a-4161-859e-ebe6e5134f72 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:40.003215 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3eefb9f6-887a-4161-859e-ebe6e5134f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:40.063479 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefb9f6-887a-4161-859e-ebe6e5134f72 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:40.067101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837011e-9005-4fa3-acae-5d7f4d6b8f5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:40.067700 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837011e-9005-4fa3-acae-5d7f4d6b8f5e service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:40.067976 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837011e-9005-4fa3-acae-5d7f4d6b8f5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:40.068244 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837011e-9005-4fa3-acae-5d7f4d6b8f5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:40.077230 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837011e-9005-4fa3-acae-5d7f4d6b8f5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:40.078798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837011e-9005-4fa3-acae-5d7f4d6b8f5e service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:40.088304 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1302/2617] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:10:40.418595 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4f3d2-6ff5-4881-ad4a-e26407540c64 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:40.421710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5ed4f3d2-6ff5-4881-ad4a-e26407540c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:40.465584 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4f3d2-6ff5-4881-ad4a-e26407540c64 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:40.473114 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481d387-8434-44ff-8878-79dbb31149fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:40.474072 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481d387-8434-44ff-8878-79dbb31149fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:40.474444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481d387-8434-44ff-8878-79dbb31149fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:40.474814 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481d387-8434-44ff-8878-79dbb31149fb admin admin] PATH_INFO: `/v3/projects/dc205bc73be149dca7978aefdd67593f` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:40.476538 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481d387-8434-44ff-8878-79dbb31149fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc205bc73be149dca7978aefdd67593f)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:40.479011 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481d387-8434-44ff-8878-79dbb31149fb admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:40.540081 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5481d387-8434-44ff-8878-79dbb31149fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc205bc73be149dca7978aefdd67593f', 'request_id': 'req-5481d387-8434-44ff-8878-79dbb31149fb'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:40.555429 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5481d387-8434-44ff-8878-79dbb31149fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc205bc73be149dca7978aefdd67593f', 'request_id': 'req-5481d387-8434-44ff-8878-79dbb31149fb'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:40.567727 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5481d387-8434-44ff-8878-79dbb31149fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc205bc73be149dca7978aefdd67593f', 'request_id': 'req-5481d387-8434-44ff-8878-79dbb31149fb'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:40.582725 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5481d387-8434-44ff-8878-79dbb31149fb admin admin] The token cache is being invalidate because project dc205bc73be149dca7978aefdd67593f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:10:40.583193 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5481d387-8434-44ff-8878-79dbb31149fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:40.584159 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5481d387-8434-44ff-8878-79dbb31149fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:40.586856 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1316/2618] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:10:40 2022] DELETE /identity/v3/projects/dc205bc73be149dca7978aefdd67593f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:10:40.591418 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837011e-9005-4fa3-acae-5d7f4d6b8f5e service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:40.604972 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837011e-9005-4fa3-acae-5d7f4d6b8f5e service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:40.688824 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccba46-0897-4f67-a021-2f6d24c1127f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:40.689702 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccba46-0897-4f67-a021-2f6d24c1127f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:40.690100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccba46-0897-4f67-a021-2f6d24c1127f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:40.690577 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccba46-0897-4f67-a021-2f6d24c1127f admin admin] PATH_INFO: `/v3/users/d4d038d67aef48fbbe2f594ebfd1acd1` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:40.691964 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ccba46-0897-4f67-a021-2f6d24c1127f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4d038d67aef48fbbe2f594ebfd1acd1)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:40.694106 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ccba46-0897-4f67-a021-2f6d24c1127f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:40.751215 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c1ccba46-0897-4f67-a021-2f6d24c1127f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4d038d67aef48fbbe2f594ebfd1acd1'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:40.751863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c1ccba46-0897-4f67-a021-2f6d24c1127f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4d038d67aef48fbbe2f594ebfd1acd1'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:40.758909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c1ccba46-0897-4f67-a021-2f6d24c1127f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4d038d67aef48fbbe2f594ebfd1acd1'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:40.772362 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c1ccba46-0897-4f67-a021-2f6d24c1127f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4d038d67aef48fbbe2f594ebfd1acd1'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:40.773273 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c1ccba46-0897-4f67-a021-2f6d24c1127f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4d038d67aef48fbbe2f594ebfd1acd1'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:40.782826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:40.791516 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1303/2619] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:10:40 2022] DELETE /identity/v3/users/d4d038d67aef48fbbe2f594ebfd1acd1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:41.078585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481d387-8434-44ff-8878-79dbb31149fb admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:41.080733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5481d387-8434-44ff-8878-79dbb31149fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:41.096332 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481d387-8434-44ff-8878-79dbb31149fb admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:41.101293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:41.154555 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3938487-363f-465f-a5d7-c53b5d0dbb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:41.155183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3938487-363f-465f-a5d7-c53b5d0dbb37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:41.155462 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3938487-363f-465f-a5d7-c53b5d0dbb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:41.155735 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3938487-363f-465f-a5d7-c53b5d0dbb37 admin admin] PATH_INFO: `/v3/projects/605f6b49354447da9dd30246c2f5b5fc` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:41.156840 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3938487-363f-465f-a5d7-c53b5d0dbb37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=605f6b49354447da9dd30246c2f5b5fc)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:41.159465 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3938487-363f-465f-a5d7-c53b5d0dbb37 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:41.203227 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d3938487-363f-465f-a5d7-c53b5d0dbb37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '605f6b49354447da9dd30246c2f5b5fc', 'request_id': 'req-d3938487-363f-465f-a5d7-c53b5d0dbb37'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:41.210069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d3938487-363f-465f-a5d7-c53b5d0dbb37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '605f6b49354447da9dd30246c2f5b5fc', 'request_id': 'req-d3938487-363f-465f-a5d7-c53b5d0dbb37'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:41.216125 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d3938487-363f-465f-a5d7-c53b5d0dbb37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '605f6b49354447da9dd30246c2f5b5fc', 'request_id': 'req-d3938487-363f-465f-a5d7-c53b5d0dbb37'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:41.226796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d3938487-363f-465f-a5d7-c53b5d0dbb37 admin admin] The token cache is being invalidate because project 605f6b49354447da9dd30246c2f5b5fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:10:41.227086 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d3938487-363f-465f-a5d7-c53b5d0dbb37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:41.227720 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d3938487-363f-465f-a5d7-c53b5d0dbb37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:41.229211 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1317/2620] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:10:41 2022] DELETE /identity/v3/projects/605f6b49354447da9dd30246c2f5b5fc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:41.234603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2f3a2-949c-460a-a613-72ad68b62786 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:41.234891 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2f3a2-949c-460a-a613-72ad68b62786 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:41.235190 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2f3a2-949c-460a-a613-72ad68b62786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:41.256789 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-45f2f3a2-949c-460a-a613-72ad68b62786 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:41.258060 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-45f2f3a2-949c-460a-a613-72ad68b62786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:41.315756 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1304/2621] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:41.323535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fbc1d-d565-43aa-93a0-5e93595a7ffb None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:41.323824 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fbc1d-d565-43aa-93a0-5e93595a7ffb None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:41.324102 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fbc1d-d565-43aa-93a0-5e93595a7ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:41.345231 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-444fbc1d-d565-43aa-93a0-5e93595a7ffb None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:41.346473 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-444fbc1d-d565-43aa-93a0-5e93595a7ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:41.354319 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1318/2622] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:41.358545 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2f3a2-949c-460a-a613-72ad68b62786 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:41.368745 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2f3a2-949c-460a-a613-72ad68b62786 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:41.373366 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0beb54-0f1a-4cb6-a965-85128a0124c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:41.373980 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0beb54-0f1a-4cb6-a965-85128a0124c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:41.374254 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0beb54-0f1a-4cb6-a965-85128a0124c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:41.374518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0beb54-0f1a-4cb6-a965-85128a0124c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:41.375149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0beb54-0f1a-4cb6-a965-85128a0124c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:10:41.375446 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0beb54-0f1a-4cb6-a965-85128a0124c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:41.377667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0beb54-0f1a-4cb6-a965-85128a0124c4 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:41.389153 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1305/2623] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:10:41.393539 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fbc1d-d565-43aa-93a0-5e93595a7ffb None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:41.403011 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fbc1d-d565-43aa-93a0-5e93595a7ffb None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:41.408105 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332a94e-ad76-4bec-a9af-1a900a1098ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:41.408977 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332a94e-ad76-4bec-a9af-1a900a1098ce admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:41.410047 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332a94e-ad76-4bec-a9af-1a900a1098ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:41.410195 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332a94e-ad76-4bec-a9af-1a900a1098ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:41.410987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332a94e-ad76-4bec-a9af-1a900a1098ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:41.413406 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332a94e-ad76-4bec-a9af-1a900a1098ce admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:41.441919 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1319/2624] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:10:41 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:41.446119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0beb54-0f1a-4cb6-a965-85128a0124c4 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:41.455835 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0beb54-0f1a-4cb6-a965-85128a0124c4 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:41.509781 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19fdcd-286e-4781-83b0-cc5dc15c2220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:41.510331 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19fdcd-286e-4781-83b0-cc5dc15c2220 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:41.510602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19fdcd-286e-4781-83b0-cc5dc15c2220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:41.510867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19fdcd-286e-4781-83b0-cc5dc15c2220 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:41.511493 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19fdcd-286e-4781-83b0-cc5dc15c2220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:41.513365 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19fdcd-286e-4781-83b0-cc5dc15c2220 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:41.534869 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1306/2625] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:10:41 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:10:41.538999 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332a94e-ad76-4bec-a9af-1a900a1098ce admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:41.550049 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332a94e-ad76-4bec-a9af-1a900a1098ce admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:41.554822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df96cc0-8804-4278-b52f-a2d24002727a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:41.555418 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df96cc0-8804-4278-b52f-a2d24002727a admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:41.555696 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df96cc0-8804-4278-b52f-a2d24002727a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:41.555969 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df96cc0-8804-4278-b52f-a2d24002727a admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:41.556600 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df96cc0-8804-4278-b52f-a2d24002727a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:41.558229 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df96cc0-8804-4278-b52f-a2d24002727a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:41.568508 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1320/2626] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:41.572130 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19fdcd-286e-4781-83b0-cc5dc15c2220 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:41.581898 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19fdcd-286e-4781-83b0-cc5dc15c2220 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:41.586451 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fabff3-9d6e-47a9-990c-c248bf939839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:41.587028 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fabff3-9d6e-47a9-990c-c248bf939839 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:41.587306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fabff3-9d6e-47a9-990c-c248bf939839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:41.587576 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fabff3-9d6e-47a9-990c-c248bf939839 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:41.588205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fabff3-9d6e-47a9-990c-c248bf939839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:41.589778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fabff3-9d6e-47a9-990c-c248bf939839 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:41.600593 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1307/2627] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:41.604382 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df96cc0-8804-4278-b52f-a2d24002727a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:41.614818 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df96cc0-8804-4278-b52f-a2d24002727a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:41.619439 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d9d5f-c67f-457c-9c9b-0260623fe4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:41.620069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d9d5f-c67f-457c-9c9b-0260623fe4ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:41.620349 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d9d5f-c67f-457c-9c9b-0260623fe4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:41.620674 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d9d5f-c67f-457c-9c9b-0260623fe4ba admin admin] PATH_INFO: `/v3/projects/57f92cc47a4540bb88497846ca0ee158/users/6dcdcefc078b406d99420a5bab1776c5/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:41.635587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d9d5f-c67f-457c-9c9b-0260623fe4ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=57f92cc47a4540bb88497846ca0ee158, user_id=6dcdcefc078b406d99420a5bab1776c5, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:41.638279 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d9d5f-c67f-457c-9c9b-0260623fe4ba admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:41.651083 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1321/2628] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:10:41 2022] PUT /identity/v3/projects/57f92cc47a4540bb88497846ca0ee158/users/6dcdcefc078b406d99420a5bab1776c5/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:10:41.656101 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d552d98-ac65-47fc-83f4-f52547857241 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:41.656405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d552d98-ac65-47fc-83f4-f52547857241 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:41.656673 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d552d98-ac65-47fc-83f4-f52547857241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:41.676715 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-6d552d98-ac65-47fc-83f4-f52547857241 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:41.677941 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6d552d98-ac65-47fc-83f4-f52547857241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:41.749841 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1308/2629] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:41.760356 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d9d5f-c67f-457c-9c9b-0260623fe4ba admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:41.762123 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-443d9d5f-c67f-457c-9c9b-0260623fe4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:41.803523 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:41.823819 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d9d5f-c67f-457c-9c9b-0260623fe4ba admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:41.827869 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c662c4-5196-4d02-b0c2-e3e09c081d74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:41.828469 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c662c4-5196-4d02-b0c2-e3e09c081d74 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:41.828775 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c662c4-5196-4d02-b0c2-e3e09c081d74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:41.829042 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c662c4-5196-4d02-b0c2-e3e09c081d74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:41.839742 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c662c4-5196-4d02-b0c2-e3e09c081d74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:41.841363 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c662c4-5196-4d02-b0c2-e3e09c081d74 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:41.851582 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1322/2630] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:10:43.205635 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d552d98-ac65-47fc-83f4-f52547857241 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:43.212062 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:43.224127 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d552d98-ac65-47fc-83f4-f52547857241 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:43.257670 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad80ed9-e969-4483-b5ae-33849383a60e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:43.259276 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad80ed9-e969-4483-b5ae-33849383a60e service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:43.259603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad80ed9-e969-4483-b5ae-33849383a60e service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:43.259880 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad80ed9-e969-4483-b5ae-33849383a60e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:43.261870 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6ad80ed9-e969-4483-b5ae-33849383a60e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:43.280403 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad80ed9-e969-4483-b5ae-33849383a60e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:43.285461 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad80ed9-e969-4483-b5ae-33849383a60e service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:43.302660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1309/2631] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:10:46.668328 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c662c4-5196-4d02-b0c2-e3e09c081d74 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:46.670238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-21c662c4-5196-4d02-b0c2-e3e09c081d74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:46.684900 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecc35c-9e4d-47fb-87c3-26a2c2ee53ec None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:46.685775 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecc35c-9e4d-47fb-87c3-26a2c2ee53ec None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:46.686239 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecc35c-9e4d-47fb-87c3-26a2c2ee53ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:46.687792 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c662c4-5196-4d02-b0c2-e3e09c081d74 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:46.692906 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb83a4-d0ba-4866-b797-abea683b367b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:46.693523 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb83a4-d0ba-4866-b797-abea683b367b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:46.693848 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb83a4-d0ba-4866-b797-abea683b367b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:46.694105 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb83a4-d0ba-4866-b797-abea683b367b admin admin] PATH_INFO: `/v3/users/bccfd9b0b71c42d389abcf028b7483d5` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:46.695224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb83a4-d0ba-4866-b797-abea683b367b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bccfd9b0b71c42d389abcf028b7483d5)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:46.697265 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb83a4-d0ba-4866-b797-abea683b367b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:46.720804 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-8fecc35c-9e4d-47fb-87c3-26a2c2ee53ec None None] MFA Rules not processed for user `6dcdcefc078b406d99420a5bab1776c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:46.722052 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8fecc35c-9e4d-47fb-87c3-26a2c2ee53ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:46.750416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-9edb83a4-d0ba-4866-b797-abea683b367b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bccfd9b0b71c42d389abcf028b7483d5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:46.758109 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-9edb83a4-d0ba-4866-b797-abea683b367b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bccfd9b0b71c42d389abcf028b7483d5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:46.781054 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-9edb83a4-d0ba-4866-b797-abea683b367b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bccfd9b0b71c42d389abcf028b7483d5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:46.781998 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-9edb83a4-d0ba-4866-b797-abea683b367b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bccfd9b0b71c42d389abcf028b7483d5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:46.783238 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-9edb83a4-d0ba-4866-b797-abea683b367b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bccfd9b0b71c42d389abcf028b7483d5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:46.837641 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1323/2632] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:10:46 2022] DELETE /identity/v3/users/bccfd9b0b71c42d389abcf028b7483d5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:46.845239 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c457c-c2bb-45fa-b86d-b2c421d76d89 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:46.845899 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c457c-c2bb-45fa-b86d-b2c421d76d89 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:46.846640 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c457c-c2bb-45fa-b86d-b2c421d76d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:46.850227 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1310/2633] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:10:46.854755 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecc35c-9e4d-47fb-87c3-26a2c2ee53ec None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:46.856372 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8fecc35c-9e4d-47fb-87c3-26a2c2ee53ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:46.886034 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecc35c-9e4d-47fb-87c3-26a2c2ee53ec None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:46.923000 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-865c457c-c2bb-45fa-b86d-b2c421d76d89 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:46.924476 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-865c457c-c2bb-45fa-b86d-b2c421d76d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:47.006928 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57af387-e460-4f4c-af0e-0a0b1e6c5746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:47.007552 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57af387-e460-4f4c-af0e-0a0b1e6c5746 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:47.007828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57af387-e460-4f4c-af0e-0a0b1e6c5746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:47.010039 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57af387-e460-4f4c-af0e-0a0b1e6c5746 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:47.011191 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57af387-e460-4f4c-af0e-0a0b1e6c5746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:47.016320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57af387-e460-4f4c-af0e-0a0b1e6c5746 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:47.088559 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1311/2634] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:10:46 2022] POST /identity/v3/projects => generated 381 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:47.092159 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57af387-e460-4f4c-af0e-0a0b1e6c5746 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:47.095287 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1324/2635] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:47.109584 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c457c-c2bb-45fa-b86d-b2c421d76d89 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:47.112062 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-865c457c-c2bb-45fa-b86d-b2c421d76d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:47.211524 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57af387-e460-4f4c-af0e-0a0b1e6c5746 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:47.221283 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2552c-e494-40d0-983d-03cb65e80f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:47.222826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2552c-e494-40d0-983d-03cb65e80f6c admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:47.223205 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2552c-e494-40d0-983d-03cb65e80f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:47.223635 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2552c-e494-40d0-983d-03cb65e80f6c admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:47.224401 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2552c-e494-40d0-983d-03cb65e80f6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:47.226881 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2552c-e494-40d0-983d-03cb65e80f6c admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:47.234722 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c457c-c2bb-45fa-b86d-b2c421d76d89 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:47.239909 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:47.242292 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:47.268522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1312/2636] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:10:47 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:47.270464 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2552c-e494-40d0-983d-03cb65e80f6c admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:47.286642 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2552c-e494-40d0-983d-03cb65e80f6c admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:47.291624 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973dce0-b1f6-45c1-8c4d-72a182332d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:47.292232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973dce0-b1f6-45c1-8c4d-72a182332d1a admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:47.292507 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973dce0-b1f6-45c1-8c4d-72a182332d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:47.292775 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973dce0-b1f6-45c1-8c4d-72a182332d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:47.293412 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973dce0-b1f6-45c1-8c4d-72a182332d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:47.295197 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973dce0-b1f6-45c1-8c4d-72a182332d1a admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:47.309934 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1313/2637] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:47.310789 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973dce0-b1f6-45c1-8c4d-72a182332d1a admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:47.313300 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2f0bd-2c36-4619-a3ad-144edc2710dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:47.314440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2f0bd-2c36-4619-a3ad-144edc2710dd service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:47.314791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2f0bd-2c36-4619-a3ad-144edc2710dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:47.315130 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2f0bd-2c36-4619-a3ad-144edc2710dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:47.322702 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973dce0-b1f6-45c1-8c4d-72a182332d1a admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:47.327195 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2f0bd-2c36-4619-a3ad-144edc2710dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:47.327782 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c9785-e1d8-44e3-86ad-3254ccdee53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:47.328447 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c9785-e1d8-44e3-86ad-3254ccdee53a admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:47.328721 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c9785-e1d8-44e3-86ad-3254ccdee53a admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:47.329144 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c9785-e1d8-44e3-86ad-3254ccdee53a admin admin] PATH_INFO: `/v3/projects/ffd56d0f22b64ce2a5218e1b1a291c74/users/e68299983e9e47909354e502acaf39de/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:47.330058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2f0bd-2c36-4619-a3ad-144edc2710dd service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:47.344179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1325/2638] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:10:47.346768 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c9785-e1d8-44e3-86ad-3254ccdee53a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd56d0f22b64ce2a5218e1b1a291c74, user_id=e68299983e9e47909354e502acaf39de, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:47.349586 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c9785-e1d8-44e3-86ad-3254ccdee53a admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:47.369330 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1314/2639] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:10:47 2022] PUT /identity/v3/projects/ffd56d0f22b64ce2a5218e1b1a291c74/users/e68299983e9e47909354e502acaf39de/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:47.370929 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2f0bd-2c36-4619-a3ad-144edc2710dd service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:47.386134 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2f0bd-2c36-4619-a3ad-144edc2710dd service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:47.544816 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17218eb9-50fd-41ca-9e57-cd71330bc077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:47.545492 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17218eb9-50fd-41ca-9e57-cd71330bc077 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:47.545770 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17218eb9-50fd-41ca-9e57-cd71330bc077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:47.546453 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17218eb9-50fd-41ca-9e57-cd71330bc077 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:47.547161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17218eb9-50fd-41ca-9e57-cd71330bc077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:47.550369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17218eb9-50fd-41ca-9e57-cd71330bc077 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:47.564592 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1326/2640] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:47.568778 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c9785-e1d8-44e3-86ad-3254ccdee53a admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:47.587812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c9785-e1d8-44e3-86ad-3254ccdee53a admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:47.593006 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279f81e-b969-45f4-82ad-15d4414b2683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:47.593818 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279f81e-b969-45f4-82ad-15d4414b2683 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:47.594335 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279f81e-b969-45f4-82ad-15d4414b2683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:47.594680 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279f81e-b969-45f4-82ad-15d4414b2683 admin admin] PATH_INFO: `/v3/projects/ffd56d0f22b64ce2a5218e1b1a291c74/users/e68299983e9e47909354e502acaf39de/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:47.599238 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279f81e-b969-45f4-82ad-15d4414b2683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd56d0f22b64ce2a5218e1b1a291c74, user_id=e68299983e9e47909354e502acaf39de, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:47.608806 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279f81e-b969-45f4-82ad-15d4414b2683 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:47.638181 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1315/2641] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:10:47 2022] PUT /identity/v3/projects/ffd56d0f22b64ce2a5218e1b1a291c74/users/e68299983e9e47909354e502acaf39de/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:47.836839 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17218eb9-50fd-41ca-9e57-cd71330bc077 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:47.842720 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-17218eb9-50fd-41ca-9e57-cd71330bc077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:47.885852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17218eb9-50fd-41ca-9e57-cd71330bc077 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:47.913344 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279f81e-b969-45f4-82ad-15d4414b2683 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:47.915175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-2279f81e-b969-45f4-82ad-15d4414b2683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:48.045454 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44d26b-743d-4a2b-abc9-8b7e5cf1ef90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:48.047125 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44d26b-743d-4a2b-abc9-8b7e5cf1ef90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:48.047417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44d26b-743d-4a2b-abc9-8b7e5cf1ef90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:48.047699 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44d26b-743d-4a2b-abc9-8b7e5cf1ef90 admin admin] PATH_INFO: `/v3/projects/a1ba8fe9047842fe9752462a56bc4fe6` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:48.060569 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44d26b-743d-4a2b-abc9-8b7e5cf1ef90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1ba8fe9047842fe9752462a56bc4fe6)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:48.062484 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44d26b-743d-4a2b-abc9-8b7e5cf1ef90 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:48.088342 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279f81e-b969-45f4-82ad-15d4414b2683 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:48.095365 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74830275-d626-4b1f-b8db-bc3d58819b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:48.096311 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74830275-d626-4b1f-b8db-bc3d58819b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:48.096828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74830275-d626-4b1f-b8db-bc3d58819b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:48.097456 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74830275-d626-4b1f-b8db-bc3d58819b2a admin admin] PATH_INFO: `/v3/users/bfd8052af6ab43beae0e8d6bb3af5bb0` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:48.099340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74830275-d626-4b1f-b8db-bc3d58819b2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfd8052af6ab43beae0e8d6bb3af5bb0)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:48.101920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74830275-d626-4b1f-b8db-bc3d58819b2a admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:48.147594 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:48.150923 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-cf44d26b-743d-4a2b-abc9-8b7e5cf1ef90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1ba8fe9047842fe9752462a56bc4fe6', 'request_id': 'req-cf44d26b-743d-4a2b-abc9-8b7e5cf1ef90'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:48.163390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-cf44d26b-743d-4a2b-abc9-8b7e5cf1ef90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1ba8fe9047842fe9752462a56bc4fe6', 'request_id': 'req-cf44d26b-743d-4a2b-abc9-8b7e5cf1ef90'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:48.172594 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-cf44d26b-743d-4a2b-abc9-8b7e5cf1ef90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1ba8fe9047842fe9752462a56bc4fe6', 'request_id': 'req-cf44d26b-743d-4a2b-abc9-8b7e5cf1ef90'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:48.196965 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-74830275-d626-4b1f-b8db-bc3d58819b2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfd8052af6ab43beae0e8d6bb3af5bb0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:48.197655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-74830275-d626-4b1f-b8db-bc3d58819b2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfd8052af6ab43beae0e8d6bb3af5bb0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:48.199862 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-cf44d26b-743d-4a2b-abc9-8b7e5cf1ef90 admin admin] The token cache is being invalidate because project a1ba8fe9047842fe9752462a56bc4fe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:10:48.200323 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-cf44d26b-743d-4a2b-abc9-8b7e5cf1ef90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:48.200821 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-cf44d26b-743d-4a2b-abc9-8b7e5cf1ef90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:48.203152 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1327/2642] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:10:47 2022] DELETE /identity/v3/projects/a1ba8fe9047842fe9752462a56bc4fe6 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:48.206645 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44d26b-743d-4a2b-abc9-8b7e5cf1ef90 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:48.208564 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-cf44d26b-743d-4a2b-abc9-8b7e5cf1ef90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:48.209481 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-74830275-d626-4b1f-b8db-bc3d58819b2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfd8052af6ab43beae0e8d6bb3af5bb0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:48.227414 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-74830275-d626-4b1f-b8db-bc3d58819b2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfd8052af6ab43beae0e8d6bb3af5bb0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:48.228158 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-74830275-d626-4b1f-b8db-bc3d58819b2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfd8052af6ab43beae0e8d6bb3af5bb0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:48.254561 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1316/2643] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:10:47 2022] DELETE /identity/v3/users/bfd8052af6ab43beae0e8d6bb3af5bb0 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:48.308694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44d26b-743d-4a2b-abc9-8b7e5cf1ef90 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:48.391382 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf029c-a2b1-48af-970b-001e28619f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:48.392399 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf029c-a2b1-48af-970b-001e28619f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:48.393233 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf029c-a2b1-48af-970b-001e28619f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:48.393605 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf029c-a2b1-48af-970b-001e28619f99 admin admin] PATH_INFO: `/v3/users/f3fc7ed2ced54938a20ff18c650158ab` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:48.394949 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf029c-a2b1-48af-970b-001e28619f99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3fc7ed2ced54938a20ff18c650158ab)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:48.397580 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf029c-a2b1-48af-970b-001e28619f99 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:48.462837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74830275-d626-4b1f-b8db-bc3d58819b2a admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:48.464565 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-74830275-d626-4b1f-b8db-bc3d58819b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:48.482988 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-abcf029c-a2b1-48af-970b-001e28619f99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3fc7ed2ced54938a20ff18c650158ab'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:48.487026 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74830275-d626-4b1f-b8db-bc3d58819b2a admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:48.499705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f8d86-c7d3-4b83-87db-e107836ca9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:48.500482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f8d86-c7d3-4b83-87db-e107836ca9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:48.501287 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f8d86-c7d3-4b83-87db-e107836ca9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:48.501287 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f8d86-c7d3-4b83-87db-e107836ca9f2 admin admin] PATH_INFO: `/v3/projects/bed53281565444618feb8a98df16f5a7` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:48.502263 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f8d86-c7d3-4b83-87db-e107836ca9f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bed53281565444618feb8a98df16f5a7)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:48.505023 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f8d86-c7d3-4b83-87db-e107836ca9f2 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:48.505228 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-abcf029c-a2b1-48af-970b-001e28619f99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3fc7ed2ced54938a20ff18c650158ab'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:48.524625 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-abcf029c-a2b1-48af-970b-001e28619f99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3fc7ed2ced54938a20ff18c650158ab'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:48.525769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-abcf029c-a2b1-48af-970b-001e28619f99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3fc7ed2ced54938a20ff18c650158ab'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:48.526637 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-abcf029c-a2b1-48af-970b-001e28619f99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3fc7ed2ced54938a20ff18c650158ab'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:48.531553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:48.551017 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1328/2644] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:10:48 2022] DELETE /identity/v3/users/f3fc7ed2ced54938a20ff18c650158ab => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:48.563031 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3a6f8d86-c7d3-4b83-87db-e107836ca9f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bed53281565444618feb8a98df16f5a7', 'request_id': 'req-3a6f8d86-c7d3-4b83-87db-e107836ca9f2'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:48.575377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3a6f8d86-c7d3-4b83-87db-e107836ca9f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bed53281565444618feb8a98df16f5a7', 'request_id': 'req-3a6f8d86-c7d3-4b83-87db-e107836ca9f2'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:48.585237 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3a6f8d86-c7d3-4b83-87db-e107836ca9f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bed53281565444618feb8a98df16f5a7', 'request_id': 'req-3a6f8d86-c7d3-4b83-87db-e107836ca9f2'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:48.600723 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3a6f8d86-c7d3-4b83-87db-e107836ca9f2 admin admin] The token cache is being invalidate because project bed53281565444618feb8a98df16f5a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:10:48.601062 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3a6f8d86-c7d3-4b83-87db-e107836ca9f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:48.601764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3a6f8d86-c7d3-4b83-87db-e107836ca9f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:48.607055 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1317/2645] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:10:48 2022] DELETE /identity/v3/projects/bed53281565444618feb8a98df16f5a7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:10:48.609373 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd858a42-bf1a-4dfb-b8f4-26161c886392 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:48.609662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd858a42-bf1a-4dfb-b8f4-26161c886392 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:48.609974 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd858a42-bf1a-4dfb-b8f4-26161c886392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:48.620454 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:48.642981 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-cd858a42-bf1a-4dfb-b8f4-26161c886392 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:48.644442 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-cd858a42-bf1a-4dfb-b8f4-26161c886392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:48.762674 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1329/2646] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:48.772628 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d573405-fc5d-4744-8df2-e751d85ee648 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:48.773046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d573405-fc5d-4744-8df2-e751d85ee648 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:48.773422 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d573405-fc5d-4744-8df2-e751d85ee648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:48.809489 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-4d573405-fc5d-4744-8df2-e751d85ee648 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:48.810889 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4d573405-fc5d-4744-8df2-e751d85ee648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:48.831538 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1318/2647] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:48.837004 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd858a42-bf1a-4dfb-b8f4-26161c886392 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:48.865042 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd858a42-bf1a-4dfb-b8f4-26161c886392 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:48.886639 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d44426-dd18-44e0-a714-cd995d0594e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:48.889267 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d44426-dd18-44e0-a714-cd995d0594e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:48.889644 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d44426-dd18-44e0-a714-cd995d0594e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:48.890051 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d44426-dd18-44e0-a714-cd995d0594e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:48.890965 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d44426-dd18-44e0-a714-cd995d0594e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:10:48.891397 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d44426-dd18-44e0-a714-cd995d0594e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:48.894340 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d44426-dd18-44e0-a714-cd995d0594e3 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:48.907249 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d573405-fc5d-4744-8df2-e751d85ee648 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:48.909259 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4d573405-fc5d-4744-8df2-e751d85ee648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:48.922881 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1330/2648] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:10:48.924245 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d44426-dd18-44e0-a714-cd995d0594e3 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:48.928428 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d573405-fc5d-4744-8df2-e751d85ee648 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:48.943328 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d44426-dd18-44e0-a714-cd995d0594e3 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:48.946239 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749772d-ea41-4b01-8e99-cd6c16b63253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:48.946906 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749772d-ea41-4b01-8e99-cd6c16b63253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:48.947192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749772d-ea41-4b01-8e99-cd6c16b63253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:48.947457 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749772d-ea41-4b01-8e99-cd6c16b63253 admin admin] PATH_INFO: `/v3/projects/80567a5d0d854959aa3bcf0c75534440` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:48.948784 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749772d-ea41-4b01-8e99-cd6c16b63253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80567a5d0d854959aa3bcf0c75534440)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:48.951295 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749772d-ea41-4b01-8e99-cd6c16b63253 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:48.960085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae5186-0668-4f57-a046-24ac4f975ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:48.960727 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae5186-0668-4f57-a046-24ac4f975ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:48.961416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae5186-0668-4f57-a046-24ac4f975ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:48.961416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae5186-0668-4f57-a046-24ac4f975ad0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:48.961928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae5186-0668-4f57-a046-24ac4f975ad0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:48.969513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae5186-0668-4f57-a046-24ac4f975ad0 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:49.023643 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4749772d-ea41-4b01-8e99-cd6c16b63253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80567a5d0d854959aa3bcf0c75534440', 'request_id': 'req-4749772d-ea41-4b01-8e99-cd6c16b63253'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:49.037787 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1331/2649] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:10:48 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:49.041252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae5186-0668-4f57-a046-24ac4f975ad0 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:49.046142 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4749772d-ea41-4b01-8e99-cd6c16b63253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80567a5d0d854959aa3bcf0c75534440', 'request_id': 'req-4749772d-ea41-4b01-8e99-cd6c16b63253'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:49.054861 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4749772d-ea41-4b01-8e99-cd6c16b63253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80567a5d0d854959aa3bcf0c75534440', 'request_id': 'req-4749772d-ea41-4b01-8e99-cd6c16b63253'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:49.081263 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4749772d-ea41-4b01-8e99-cd6c16b63253 admin admin] The token cache is being invalidate because project 80567a5d0d854959aa3bcf0c75534440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:10:49.081553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4749772d-ea41-4b01-8e99-cd6c16b63253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:49.082248 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4749772d-ea41-4b01-8e99-cd6c16b63253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:49.083761 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1319/2650] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:10:48 2022] DELETE /identity/v3/projects/80567a5d0d854959aa3bcf0c75534440 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:49.088443 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4702b28-ae27-44f7-b138-9471e8188888 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:49.090830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4702b28-ae27-44f7-b138-9471e8188888 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:49.091281 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4702b28-ae27-44f7-b138-9471e8188888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:49.124741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-d4702b28-ae27-44f7-b138-9471e8188888 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:49.127000 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d4702b28-ae27-44f7-b138-9471e8188888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:49.143764 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae5186-0668-4f57-a046-24ac4f975ad0 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:49.149517 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c714d-e53a-4083-b2a3-c69e578747e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:49.150907 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c714d-e53a-4083-b2a3-c69e578747e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:49.151197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c714d-e53a-4083-b2a3-c69e578747e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:49.151617 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c714d-e53a-4083-b2a3-c69e578747e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:49.152316 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c714d-e53a-4083-b2a3-c69e578747e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:49.155066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c714d-e53a-4083-b2a3-c69e578747e5 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:49.193752 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1332/2651] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:10:49 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:49.198201 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c714d-e53a-4083-b2a3-c69e578747e5 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:49.208484 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-de6c714d-e53a-4083-b2a3-c69e578747e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:49.236918 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c714d-e53a-4083-b2a3-c69e578747e5 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:49.249744 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78a63f-24b2-4b82-a1d9-841f4661b53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:49.250598 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78a63f-24b2-4b82-a1d9-841f4661b53b admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:49.250940 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78a63f-24b2-4b82-a1d9-841f4661b53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:49.251402 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78a63f-24b2-4b82-a1d9-841f4661b53b admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:49.252130 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78a63f-24b2-4b82-a1d9-841f4661b53b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:49.256725 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78a63f-24b2-4b82-a1d9-841f4661b53b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:49.273743 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1320/2652] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:49.275802 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2c1a6-1532-4f9e-ada9-1b8f01192995 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:49.276093 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2c1a6-1532-4f9e-ada9-1b8f01192995 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:49.276368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2c1a6-1532-4f9e-ada9-1b8f01192995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:49.283679 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1333/2653] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:49.288968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78a63f-24b2-4b82-a1d9-841f4661b53b admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:49.310314 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-70c2c1a6-1532-4f9e-ada9-1b8f01192995 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:49.311554 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-70c2c1a6-1532-4f9e-ada9-1b8f01192995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:49.324835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78a63f-24b2-4b82-a1d9-841f4661b53b admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:49.331705 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0e607-f067-495f-af55-fdbc7b6fbc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:49.332332 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0e607-f067-495f-af55-fdbc7b6fbc9a admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:49.332613 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0e607-f067-495f-af55-fdbc7b6fbc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:49.332888 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0e607-f067-495f-af55-fdbc7b6fbc9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:49.336794 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0e607-f067-495f-af55-fdbc7b6fbc9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:49.336794 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0e607-f067-495f-af55-fdbc7b6fbc9a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:49.339020 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1321/2654] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:49.341291 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2c1a6-1532-4f9e-ada9-1b8f01192995 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:49.360827 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2c1a6-1532-4f9e-ada9-1b8f01192995 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:49.368458 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec691130-ff11-4b4f-87ba-8a35ea0e9ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:49.369252 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1334/2655] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:49.370292 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec691130-ff11-4b4f-87ba-8a35ea0e9ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:49.370420 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0e607-f067-495f-af55-fdbc7b6fbc9a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:49.370962 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec691130-ff11-4b4f-87ba-8a35ea0e9ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:49.372045 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec691130-ff11-4b4f-87ba-8a35ea0e9ff7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:49.372890 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec691130-ff11-4b4f-87ba-8a35ea0e9ff7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:10:49.373469 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec691130-ff11-4b4f-87ba-8a35ea0e9ff7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:49.375430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec691130-ff11-4b4f-87ba-8a35ea0e9ff7 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:49.388052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0e607-f067-495f-af55-fdbc7b6fbc9a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:49.396076 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1322/2656] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:10:49.401596 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63649f1-b1f8-4000-a956-1a77c56cb5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:49.402268 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec691130-ff11-4b4f-87ba-8a35ea0e9ff7 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:49.408649 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63649f1-b1f8-4000-a956-1a77c56cb5f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:49.408912 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63649f1-b1f8-4000-a956-1a77c56cb5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:49.409185 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63649f1-b1f8-4000-a956-1a77c56cb5f6 admin admin] PATH_INFO: `/v3/projects/c7c272d384b547dab72c1f42f431970b/users/827f496a660c4ea7be6a827f9f27d09d/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:49.435400 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec691130-ff11-4b4f-87ba-8a35ea0e9ff7 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:49.443248 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63649f1-b1f8-4000-a956-1a77c56cb5f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7c272d384b547dab72c1f42f431970b, user_id=827f496a660c4ea7be6a827f9f27d09d, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:49.447936 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63649f1-b1f8-4000-a956-1a77c56cb5f6 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:49.448786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c4c9b-8d42-47b6-85ac-605b5c1cf57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:49.449578 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c4c9b-8d42-47b6-85ac-605b5c1cf57c admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:49.450055 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c4c9b-8d42-47b6-85ac-605b5c1cf57c admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:49.450491 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c4c9b-8d42-47b6-85ac-605b5c1cf57c admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:49.454919 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c4c9b-8d42-47b6-85ac-605b5c1cf57c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:49.457044 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c4c9b-8d42-47b6-85ac-605b5c1cf57c admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:49.472617 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:49.479585 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1335/2657] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:10:49 2022] PUT /identity/v3/projects/c7c272d384b547dab72c1f42f431970b/users/827f496a660c4ea7be6a827f9f27d09d/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:10:49.486661 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc2fc5-28fb-439d-814a-ab7069c48165 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:49.487182 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc2fc5-28fb-439d-814a-ab7069c48165 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:49.487740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc2fc5-28fb-439d-814a-ab7069c48165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:49.527325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1323/2658] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:10:49 2022] POST /identity/v3/projects => generated 361 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:49.529639 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-babc2fc5-28fb-439d-814a-ab7069c48165 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:49.531120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c4c9b-8d42-47b6-85ac-605b5c1cf57c admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:49.537514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-babc2fc5-28fb-439d-814a-ab7069c48165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:49.551094 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:49.635621 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1336/2659] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:49.641324 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc2fc5-28fb-439d-814a-ab7069c48165 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:49.644320 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-babc2fc5-28fb-439d-814a-ab7069c48165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:49.652310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c4c9b-8d42-47b6-85ac-605b5c1cf57c admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:49.663301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583daaa-f5a5-4e25-8d8e-90448d04061d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:49.663933 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583daaa-f5a5-4e25-8d8e-90448d04061d admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:49.664209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583daaa-f5a5-4e25-8d8e-90448d04061d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:49.664463 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583daaa-f5a5-4e25-8d8e-90448d04061d admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:49.665215 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583daaa-f5a5-4e25-8d8e-90448d04061d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:49.667550 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583daaa-f5a5-4e25-8d8e-90448d04061d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:49.713238 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1324/2660] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:10:49 2022] POST /identity/v3/users => generated 281 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:49.717143 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583daaa-f5a5-4e25-8d8e-90448d04061d admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:49.737038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583daaa-f5a5-4e25-8d8e-90448d04061d admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:49.742452 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc2fc5-28fb-439d-814a-ab7069c48165 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:49.746558 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f22e2d-cad9-40c7-a2e8-a982189468b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:49.747190 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f22e2d-cad9-40c7-a2e8-a982189468b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:49.747471 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f22e2d-cad9-40c7-a2e8-a982189468b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:49.748227 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f22e2d-cad9-40c7-a2e8-a982189468b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:49.751673 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d6171-f183-4936-a0c4-3416a6a2d085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:49.752448 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d6171-f183-4936-a0c4-3416a6a2d085 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:49.752725 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d6171-f183-4936-a0c4-3416a6a2d085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:49.752991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d6171-f183-4936-a0c4-3416a6a2d085 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:49.753866 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d6171-f183-4936-a0c4-3416a6a2d085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:49.755809 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d6171-f183-4936-a0c4-3416a6a2d085 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:49.761368 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f22e2d-cad9-40c7-a2e8-a982189468b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:49.764097 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f22e2d-cad9-40c7-a2e8-a982189468b4 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:49.770178 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1325/2661] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:49.771306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d6171-f183-4936-a0c4-3416a6a2d085 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:49.783474 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d6171-f183-4936-a0c4-3416a6a2d085 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:49.787089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1337/2662] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 01:10:49.802427 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779872fe-88f9-4bca-af88-2b12f0a45d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:49.803226 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779872fe-88f9-4bca-af88-2b12f0a45d78 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:49.803501 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779872fe-88f9-4bca-af88-2b12f0a45d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:49.803768 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779872fe-88f9-4bca-af88-2b12f0a45d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:49.804413 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779872fe-88f9-4bca-af88-2b12f0a45d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:49.808747 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779872fe-88f9-4bca-af88-2b12f0a45d78 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:49.837298 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1326/2663] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:49.839093 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f22e2d-cad9-40c7-a2e8-a982189468b4 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:49.854968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f22e2d-cad9-40c7-a2e8-a982189468b4 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:49.863557 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a92b81-86b5-494d-9973-1192c7bf899b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:49.866040 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a92b81-86b5-494d-9973-1192c7bf899b admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:49.866325 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a92b81-86b5-494d-9973-1192c7bf899b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:49.866690 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a92b81-86b5-494d-9973-1192c7bf899b admin admin] PATH_INFO: `/v3/projects/657b67d3f5154ee3ab9fd48d2c69d444/users/d59de2a077064d5b915baff03f930b8d/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:49.914498 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a92b81-86b5-494d-9973-1192c7bf899b admin admin] RBAC: Authorizing `identity:create_grant(project_id=657b67d3f5154ee3ab9fd48d2c69d444, user_id=d59de2a077064d5b915baff03f930b8d, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:49.923874 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a92b81-86b5-494d-9973-1192c7bf899b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:49.953853 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1338/2664] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:10:49 2022] PUT /identity/v3/projects/657b67d3f5154ee3ab9fd48d2c69d444/users/d59de2a077064d5b915baff03f930b8d/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:49.964321 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2490c6-f889-4c27-8942-7a1e9015d6f3 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:49.965448 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2490c6-f889-4c27-8942-7a1e9015d6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:49.966936 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2490c6-f889-4c27-8942-7a1e9015d6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:50.029273 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-6e2490c6-f889-4c27-8942-7a1e9015d6f3 None None] MFA Rules not processed for user `d59de2a077064d5b915baff03f930b8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:50.031705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6e2490c6-f889-4c27-8942-7a1e9015d6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:50.144662 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1327/2665] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:50.148946 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a92b81-86b5-494d-9973-1192c7bf899b admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:50.279059 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a92b81-86b5-494d-9973-1192c7bf899b admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:50.284718 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758f328-bd32-4a8d-a98a-12c6b02d9c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:50.286168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758f328-bd32-4a8d-a98a-12c6b02d9c20 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:50.286604 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758f328-bd32-4a8d-a98a-12c6b02d9c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:50.287452 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758f328-bd32-4a8d-a98a-12c6b02d9c20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:50.288348 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758f328-bd32-4a8d-a98a-12c6b02d9c20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:50.291644 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758f328-bd32-4a8d-a98a-12c6b02d9c20 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:50.339540 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1339/2666] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:10:50 2022] POST /identity/v3/projects => generated 365 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:50.343459 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2490c6-f889-4c27-8942-7a1e9015d6f3 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:50.361682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2490c6-f889-4c27-8942-7a1e9015d6f3 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:50.495225 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:50.529376 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9dde4-ab69-46db-9691-6be23c5ba524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:50.530022 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9dde4-ab69-46db-9691-6be23c5ba524 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:50.530297 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9dde4-ab69-46db-9691-6be23c5ba524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:50.530566 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9dde4-ab69-46db-9691-6be23c5ba524 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:50.531587 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9dde4-ab69-46db-9691-6be23c5ba524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:50.535530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9dde4-ab69-46db-9691-6be23c5ba524 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:50.577538 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1328/2667] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:10:50 2022] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:50.581850 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758f328-bd32-4a8d-a98a-12c6b02d9c20 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:50.614501 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758f328-bd32-4a8d-a98a-12c6b02d9c20 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:50.620424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cb307-6854-4f18-8fa3-00e6fb92bd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:50.621326 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cb307-6854-4f18-8fa3-00e6fb92bd20 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:50.621923 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cb307-6854-4f18-8fa3-00e6fb92bd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:50.622390 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cb307-6854-4f18-8fa3-00e6fb92bd20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:50.623339 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cb307-6854-4f18-8fa3-00e6fb92bd20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:50.625147 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cb307-6854-4f18-8fa3-00e6fb92bd20 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:50.641300 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1340/2668] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 01:10:50.643655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9dde4-ab69-46db-9691-6be23c5ba524 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:50.664257 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9dde4-ab69-46db-9691-6be23c5ba524 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:50.669877 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a286de-f1ee-46d0-b3fe-338b79a868b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:50.670634 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a286de-f1ee-46d0-b3fe-338b79a868b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:50.670974 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a286de-f1ee-46d0-b3fe-338b79a868b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:50.671332 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a286de-f1ee-46d0-b3fe-338b79a868b8 admin admin] PATH_INFO: `/v3/projects/16a0a97ff8a34767ae51e3a8e42877b3/users/79560050193b46b9a2cbf10caf525bee/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:50.693727 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a286de-f1ee-46d0-b3fe-338b79a868b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16a0a97ff8a34767ae51e3a8e42877b3, user_id=79560050193b46b9a2cbf10caf525bee, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:50.698147 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a286de-f1ee-46d0-b3fe-338b79a868b8 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:50.717445 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1329/2669] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:10:50 2022] PUT /identity/v3/projects/16a0a97ff8a34767ae51e3a8e42877b3/users/79560050193b46b9a2cbf10caf525bee/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:10:50.718680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cb307-6854-4f18-8fa3-00e6fb92bd20 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:50.732302 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:50.741026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cb307-6854-4f18-8fa3-00e6fb92bd20 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:50.900604 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59b7c1-e843-4f02-9542-fbedda32240c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:50.901293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59b7c1-e843-4f02-9542-fbedda32240c admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:50.901496 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59b7c1-e843-4f02-9542-fbedda32240c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:50.901764 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59b7c1-e843-4f02-9542-fbedda32240c admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:50.902438 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59b7c1-e843-4f02-9542-fbedda32240c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:50.904292 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59b7c1-e843-4f02-9542-fbedda32240c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:50.931441 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1341/2670] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:50.936009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a286de-f1ee-46d0-b3fe-338b79a868b8 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:50.957265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a286de-f1ee-46d0-b3fe-338b79a868b8 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:50.966196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af27d04-721c-413e-887e-ca156dbb31fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:50.967626 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af27d04-721c-413e-887e-ca156dbb31fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:50.967873 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af27d04-721c-413e-887e-ca156dbb31fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:50.968621 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af27d04-721c-413e-887e-ca156dbb31fc admin admin] PATH_INFO: `/v3/projects/16a0a97ff8a34767ae51e3a8e42877b3/users/79560050193b46b9a2cbf10caf525bee/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:50.971767 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af27d04-721c-413e-887e-ca156dbb31fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=16a0a97ff8a34767ae51e3a8e42877b3, user_id=79560050193b46b9a2cbf10caf525bee, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:50.975380 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af27d04-721c-413e-887e-ca156dbb31fc admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:50.988944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1330/2671] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:10:50 2022] PUT /identity/v3/projects/16a0a97ff8a34767ae51e3a8e42877b3/users/79560050193b46b9a2cbf10caf525bee/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:10:51.001508 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7c662-0d0f-466f-9bca-cc5b47cfc4fe None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:51.001763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7c662-0d0f-466f-9bca-cc5b47cfc4fe None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:51.002040 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7c662-0d0f-466f-9bca-cc5b47cfc4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:51.099430 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-daf7c662-0d0f-466f-9bca-cc5b47cfc4fe None None] MFA Rules not processed for user `79560050193b46b9a2cbf10caf525bee`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:51.101002 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-daf7c662-0d0f-466f-9bca-cc5b47cfc4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:51.231172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1342/2672] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:51.244459 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af27d04-721c-413e-887e-ca156dbb31fc admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:51.246277 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9af27d04-721c-413e-887e-ca156dbb31fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:51.383436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af27d04-721c-413e-887e-ca156dbb31fc admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:51.392668 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f52a07-f10c-48f6-8ce2-8ec5ddb0d027 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:51.393390 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f52a07-f10c-48f6-8ce2-8ec5ddb0d027 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:51.393699 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f52a07-f10c-48f6-8ce2-8ec5ddb0d027 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:51.395253 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f52a07-f10c-48f6-8ce2-8ec5ddb0d027 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:51.416256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f52a07-f10c-48f6-8ce2-8ec5ddb0d027 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:51.420303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f52a07-f10c-48f6-8ce2-8ec5ddb0d027 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:51.447267 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1331/2673] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:51 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:10:51.572159 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7c662-0d0f-466f-9bca-cc5b47cfc4fe None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:51.594151 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7c662-0d0f-466f-9bca-cc5b47cfc4fe None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:51.606004 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e43e59-b44c-4146-ab18-4f1fe4a6620f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:51.606645 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e43e59-b44c-4146-ab18-4f1fe4a6620f service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:51.606928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e43e59-b44c-4146-ab18-4f1fe4a6620f service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:51.607197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e43e59-b44c-4146-ab18-4f1fe4a6620f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:51.700482 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e43e59-b44c-4146-ab18-4f1fe4a6620f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:51.702495 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e43e59-b44c-4146-ab18-4f1fe4a6620f service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:51.720263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1343/2674] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:10:54.099417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183ab92-f13f-483c-97d5-902a510650d9 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:54.100004 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183ab92-f13f-483c-97d5-902a510650d9 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:54.100004 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183ab92-f13f-483c-97d5-902a510650d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:54.135633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-c183ab92-f13f-483c-97d5-902a510650d9 None None] MFA Rules not processed for user `e68299983e9e47909354e502acaf39de`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:54.137281 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c183ab92-f13f-483c-97d5-902a510650d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:54.294344 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1332/2675] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:54 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:54.308530 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e43e59-b44c-4146-ab18-4f1fe4a6620f service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:54.311286 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-05e43e59-b44c-4146-ab18-4f1fe4a6620f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:54.371984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:54.468579 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e43e59-b44c-4146-ab18-4f1fe4a6620f service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:54.472748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8bc01-d86a-4602-ad83-6cd6dccc76aa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee54ed3a092e4eef9082c4e86bd918a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:54.473607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8bc01-d86a-4602-ad83-6cd6dccc76aa service glance] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:54.474091 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8bc01-d86a-4602-ad83-6cd6dccc76aa service glance] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:54.475023 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8bc01-d86a-4602-ad83-6cd6dccc76aa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:54.477381 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ece8bc01-d86a-4602-ad83-6cd6dccc76aa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:54.596490 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8bc01-d86a-4602-ad83-6cd6dccc76aa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:54.598274 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8bc01-d86a-4602-ad83-6cd6dccc76aa service glance] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:54.608696 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1344/2676] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:10:54.822023 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c2d0a-8005-4bd1-8dc6-c705d8f64105 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:54.822306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c2d0a-8005-4bd1-8dc6-c705d8f64105 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:54.822582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c2d0a-8005-4bd1-8dc6-c705d8f64105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:54.872206 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-da9c2d0a-8005-4bd1-8dc6-c705d8f64105 None None] MFA Rules not processed for user `eb9d1149a417436bbf1577d61407c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:54.875493 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-da9c2d0a-8005-4bd1-8dc6-c705d8f64105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:54.920848 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:55.012188 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8bc01-d86a-4602-ad83-6cd6dccc76aa service glance] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:55.022802 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1333/2677] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 14 01:10:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:10:55.064030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c2d0a-8005-4bd1-8dc6-c705d8f64105 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:55.065733 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-da9c2d0a-8005-4bd1-8dc6-c705d8f64105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:55.163679 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8bc01-d86a-4602-ad83-6cd6dccc76aa service glance] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:55.169254 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c8748-f62d-49d4-8731-328883f4283a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:55.170085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c8748-f62d-49d4-8731-328883f4283a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:55.171640 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c8748-f62d-49d4-8731-328883f4283a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:55.171640 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c8748-f62d-49d4-8731-328883f4283a admin admin] PATH_INFO: `/v3/users/d59de2a077064d5b915baff03f930b8d` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:55.172071 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c8748-f62d-49d4-8731-328883f4283a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d59de2a077064d5b915baff03f930b8d)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:55.174255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c8748-f62d-49d4-8731-328883f4283a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:55.287368 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fe4c8748-f62d-49d4-8731-328883f4283a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd59de2a077064d5b915baff03f930b8d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:55.306493 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fe4c8748-f62d-49d4-8731-328883f4283a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd59de2a077064d5b915baff03f930b8d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:55.339210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fe4c8748-f62d-49d4-8731-328883f4283a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd59de2a077064d5b915baff03f930b8d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:55.340158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fe4c8748-f62d-49d4-8731-328883f4283a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd59de2a077064d5b915baff03f930b8d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:55.340781 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fe4c8748-f62d-49d4-8731-328883f4283a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd59de2a077064d5b915baff03f930b8d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:55.365239 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:55.383197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1345/2678] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:10:55 2022] DELETE /identity/v3/users/d59de2a077064d5b915baff03f930b8d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:10:55.391774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef315a11-1e87-4ada-8f53-03f2a973fee4 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:55.391774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef315a11-1e87-4ada-8f53-03f2a973fee4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:55.391774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef315a11-1e87-4ada-8f53-03f2a973fee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:55.457220 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ef315a11-1e87-4ada-8f53-03f2a973fee4 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:55.459289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ef315a11-1e87-4ada-8f53-03f2a973fee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:55.549859 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c2d0a-8005-4bd1-8dc6-c705d8f64105 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:55.636039 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1346/2679] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:55.650821 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef315a11-1e87-4ada-8f53-03f2a973fee4 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:55.652934 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ef315a11-1e87-4ada-8f53-03f2a973fee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:55.707249 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1becef7-5816-48eb-8403-58c71c039af5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d05652bfe542d5a2cfa39fbf7a83c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:55.708147 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1becef7-5816-48eb-8403-58c71c039af5 service swift] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:55.708488 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1becef7-5816-48eb-8403-58c71c039af5 service swift] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:55.708787 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1becef7-5816-48eb-8403-58c71c039af5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:55.715084 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c1becef7-5816-48eb-8403-58c71c039af5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:55.788757 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef315a11-1e87-4ada-8f53-03f2a973fee4 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:55.794463 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8d43d-2ffb-4e57-ad83-1c73b1f252d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:55.795428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8d43d-2ffb-4e57-ad83-1c73b1f252d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:55.796730 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8d43d-2ffb-4e57-ad83-1c73b1f252d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:55.797242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8d43d-2ffb-4e57-ad83-1c73b1f252d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:55.809912 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8d43d-2ffb-4e57-ad83-1c73b1f252d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:55.811733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8d43d-2ffb-4e57-ad83-1c73b1f252d5 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:55.823967 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1becef7-5816-48eb-8403-58c71c039af5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:55.825312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1347/2680] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 01:10:55.826016 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1becef7-5816-48eb-8403-58c71c039af5 service swift] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:55.836581 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1334/2681] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 14 01:10:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 774 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 14 01:10:56.460776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8d43d-2ffb-4e57-ad83-1c73b1f252d5 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:56.463055 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1bc8d43d-2ffb-4e57-ad83-1c73b1f252d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:56.501225 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8d43d-2ffb-4e57-ad83-1c73b1f252d5 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:56.514331 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf770334-804e-413a-961b-32880d94b8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:56.514988 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf770334-804e-413a-961b-32880d94b8f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:56.515397 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf770334-804e-413a-961b-32880d94b8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:56.519036 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf770334-804e-413a-961b-32880d94b8f7 admin admin] PATH_INFO: `/v3/projects/657b67d3f5154ee3ab9fd48d2c69d444` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:56.529778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf770334-804e-413a-961b-32880d94b8f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=657b67d3f5154ee3ab9fd48d2c69d444)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:56.531966 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf770334-804e-413a-961b-32880d94b8f7 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:56.670882 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-bf770334-804e-413a-961b-32880d94b8f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '657b67d3f5154ee3ab9fd48d2c69d444', 'request_id': 'req-bf770334-804e-413a-961b-32880d94b8f7'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:56.698891 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-bf770334-804e-413a-961b-32880d94b8f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '657b67d3f5154ee3ab9fd48d2c69d444', 'request_id': 'req-bf770334-804e-413a-961b-32880d94b8f7'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:56.707106 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-bf770334-804e-413a-961b-32880d94b8f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '657b67d3f5154ee3ab9fd48d2c69d444', 'request_id': 'req-bf770334-804e-413a-961b-32880d94b8f7'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:56.744921 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-bf770334-804e-413a-961b-32880d94b8f7 admin admin] The token cache is being invalidate because project 657b67d3f5154ee3ab9fd48d2c69d444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:10:56.745214 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-bf770334-804e-413a-961b-32880d94b8f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:56.746156 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-bf770334-804e-413a-961b-32880d94b8f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:56.752641 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1348/2682] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:10:56 2022] DELETE /identity/v3/projects/657b67d3f5154ee3ab9fd48d2c69d444 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:56.754454 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1becef7-5816-48eb-8403-58c71c039af5 service swift] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:56.776307 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1becef7-5816-48eb-8403-58c71c039af5 service swift] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:56.807271 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:56.815211 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d0e44-9483-4a25-bb63-032e364da563 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:56.815514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d0e44-9483-4a25-bb63-032e364da563 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:56.815786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d0e44-9483-4a25-bb63-032e364da563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:56.913563 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-791d0e44-9483-4a25-bb63-032e364da563 None None] MFA Rules not processed for user `827f496a660c4ea7be6a827f9f27d09d`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:56.915138 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-791d0e44-9483-4a25-bb63-032e364da563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:56.942960 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b30c7a-739a-471a-b7d0-fc395a8e74f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:56.943681 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b30c7a-739a-471a-b7d0-fc395a8e74f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:56.944028 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b30c7a-739a-471a-b7d0-fc395a8e74f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:56.944882 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b30c7a-739a-471a-b7d0-fc395a8e74f9 admin admin] PATH_INFO: `/v3/users/79560050193b46b9a2cbf10caf525bee` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:56.946316 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b30c7a-739a-471a-b7d0-fc395a8e74f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79560050193b46b9a2cbf10caf525bee)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:56.949114 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b30c7a-739a-471a-b7d0-fc395a8e74f9 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:56.969186 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:57.106441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-66b30c7a-739a-471a-b7d0-fc395a8e74f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79560050193b46b9a2cbf10caf525bee'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:57.107499 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-66b30c7a-739a-471a-b7d0-fc395a8e74f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79560050193b46b9a2cbf10caf525bee'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:57.117158 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-66b30c7a-739a-471a-b7d0-fc395a8e74f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79560050193b46b9a2cbf10caf525bee'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:57.134983 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-66b30c7a-739a-471a-b7d0-fc395a8e74f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79560050193b46b9a2cbf10caf525bee'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:57.135943 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-66b30c7a-739a-471a-b7d0-fc395a8e74f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79560050193b46b9a2cbf10caf525bee'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:57.142287 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1349/2683] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:10:57.170694 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d0e44-9483-4a25-bb63-032e364da563 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:57.173922 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1335/2684] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:10:56 2022] DELETE /identity/v3/users/79560050193b46b9a2cbf10caf525bee => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:57.174899 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-791d0e44-9483-4a25-bb63-032e364da563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:57.389494 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d0e44-9483-4a25-bb63-032e364da563 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:57.545442 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb35111-3585-42a1-98c5-064ce0628a5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:57.546350 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb35111-3585-42a1-98c5-064ce0628a5a service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:57.546741 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb35111-3585-42a1-98c5-064ce0628a5a service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:57.547418 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb35111-3585-42a1-98c5-064ce0628a5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:57.655755 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:57.687524 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb35111-3585-42a1-98c5-064ce0628a5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:57.690090 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb35111-3585-42a1-98c5-064ce0628a5a service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:57.699990 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b30c7a-739a-471a-b7d0-fc395a8e74f9 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:57.701571 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-66b30c7a-739a-471a-b7d0-fc395a8e74f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:57.702264 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1350/2685] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:10:57.811392 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b30c7a-739a-471a-b7d0-fc395a8e74f9 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:57.820340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ed543-1379-41a7-9ab1-740e7a260fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:57.821044 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ed543-1379-41a7-9ab1-740e7a260fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:57.821321 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ed543-1379-41a7-9ab1-740e7a260fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:57.821755 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ed543-1379-41a7-9ab1-740e7a260fde admin admin] PATH_INFO: `/v3/projects/16a0a97ff8a34767ae51e3a8e42877b3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:57.824077 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ed543-1379-41a7-9ab1-740e7a260fde admin admin] RBAC: Authorizing `identity:delete_project(project_id=16a0a97ff8a34767ae51e3a8e42877b3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:57.826828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ed543-1379-41a7-9ab1-740e7a260fde admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:57.893720 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:57.929966 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a51ed543-1379-41a7-9ab1-740e7a260fde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16a0a97ff8a34767ae51e3a8e42877b3', 'request_id': 'req-a51ed543-1379-41a7-9ab1-740e7a260fde'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:57.942012 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a51ed543-1379-41a7-9ab1-740e7a260fde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16a0a97ff8a34767ae51e3a8e42877b3', 'request_id': 'req-a51ed543-1379-41a7-9ab1-740e7a260fde'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:57.966673 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a51ed543-1379-41a7-9ab1-740e7a260fde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16a0a97ff8a34767ae51e3a8e42877b3', 'request_id': 'req-a51ed543-1379-41a7-9ab1-740e7a260fde'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:58.012906 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a51ed543-1379-41a7-9ab1-740e7a260fde admin admin] The token cache is being invalidate because project 16a0a97ff8a34767ae51e3a8e42877b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:10:58.013708 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a51ed543-1379-41a7-9ab1-740e7a260fde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:58.014628 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a51ed543-1379-41a7-9ab1-740e7a260fde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:10:58.016949 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1336/2686] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:10:57 2022] DELETE /identity/v3/projects/16a0a97ff8a34767ae51e3a8e42877b3 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:10:58.022002 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83c5cb-60bb-4e96-89fa-c1ef7ec7be85 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:58.022298 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83c5cb-60bb-4e96-89fa-c1ef7ec7be85 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:58.022950 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83c5cb-60bb-4e96-89fa-c1ef7ec7be85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:58.061735 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-3f83c5cb-60bb-4e96-89fa-c1ef7ec7be85 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:58.067140 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3f83c5cb-60bb-4e96-89fa-c1ef7ec7be85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:58.189843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1351/2687] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:58.190919 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09689765-2aec-4a39-9269-b65fa1030fc4 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:58.191207 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09689765-2aec-4a39-9269-b65fa1030fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:58.191477 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09689765-2aec-4a39-9269-b65fa1030fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:58.229283 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-09689765-2aec-4a39-9269-b65fa1030fc4 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:58.230948 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-09689765-2aec-4a39-9269-b65fa1030fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:58.239862 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1337/2688] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:10:58.244753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83c5cb-60bb-4e96-89fa-c1ef7ec7be85 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:58.262161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83c5cb-60bb-4e96-89fa-c1ef7ec7be85 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:58.274491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce38875-c498-413c-9481-fc0136d25d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:58.275744 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce38875-c498-413c-9481-fc0136d25d6b admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:58.276261 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce38875-c498-413c-9481-fc0136d25d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:58.276753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce38875-c498-413c-9481-fc0136d25d6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:58.277712 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce38875-c498-413c-9481-fc0136d25d6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:10:58.278131 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce38875-c498-413c-9481-fc0136d25d6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:58.280263 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce38875-c498-413c-9481-fc0136d25d6b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:58.312259 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1352/2689] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:10:58.318399 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09689765-2aec-4a39-9269-b65fa1030fc4 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:58.340901 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09689765-2aec-4a39-9269-b65fa1030fc4 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:58.347487 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56975b3d-e274-4764-810c-02daf65c5cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:58.348575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56975b3d-e274-4764-810c-02daf65c5cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:58.349594 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56975b3d-e274-4764-810c-02daf65c5cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:58.350316 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56975b3d-e274-4764-810c-02daf65c5cf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:58.351927 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56975b3d-e274-4764-810c-02daf65c5cf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:58.357178 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56975b3d-e274-4764-810c-02daf65c5cf5 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:58.441058 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1338/2690] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:10:58 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:58.446283 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce38875-c498-413c-9481-fc0136d25d6b admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:58.463533 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce38875-c498-413c-9481-fc0136d25d6b admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:58.582901 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27384d6-c863-4e6c-a90d-06c4edc25fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:58.583950 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27384d6-c863-4e6c-a90d-06c4edc25fcb admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:58.584331 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27384d6-c863-4e6c-a90d-06c4edc25fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:58.584702 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27384d6-c863-4e6c-a90d-06c4edc25fcb admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:58.585579 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27384d6-c863-4e6c-a90d-06c4edc25fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:58.587667 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27384d6-c863-4e6c-a90d-06c4edc25fcb admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:58.621070 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1353/2691] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:10:58 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:58.624828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56975b3d-e274-4764-810c-02daf65c5cf5 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:58.640893 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56975b3d-e274-4764-810c-02daf65c5cf5 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:58.660785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c7108-66d2-481f-a45d-644ba4108760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:58.662031 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c7108-66d2-481f-a45d-644ba4108760 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:58.662508 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c7108-66d2-481f-a45d-644ba4108760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:58.662954 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c7108-66d2-481f-a45d-644ba4108760 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:58.663831 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c7108-66d2-481f-a45d-644ba4108760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:58.666265 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c7108-66d2-481f-a45d-644ba4108760 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:58.684645 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1339/2692] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:58.694524 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27384d6-c863-4e6c-a90d-06c4edc25fcb admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:58.709162 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27384d6-c863-4e6c-a90d-06c4edc25fcb admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:58.720113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88dee5-f7f7-483b-a429-814f8704e70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:58.721168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88dee5-f7f7-483b-a429-814f8704e70a admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:58.721461 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88dee5-f7f7-483b-a429-814f8704e70a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:58.721733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88dee5-f7f7-483b-a429-814f8704e70a admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:58.722422 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88dee5-f7f7-483b-a429-814f8704e70a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:58.724036 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88dee5-f7f7-483b-a429-814f8704e70a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:58.745747 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1354/2693] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:58.747379 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c7108-66d2-481f-a45d-644ba4108760 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:58.761934 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c7108-66d2-481f-a45d-644ba4108760 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:58.774074 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42752c-de90-42bc-9dda-a797d595c56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:58.774864 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42752c-de90-42bc-9dda-a797d595c56e admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:58.775395 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42752c-de90-42bc-9dda-a797d595c56e admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:58.775668 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42752c-de90-42bc-9dda-a797d595c56e admin admin] PATH_INFO: `/v3/projects/84e0db0d83f040c093853d7ad0379b9d/users/f46086446dfa4237a0646c0f53ab3eed/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:58.810764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42752c-de90-42bc-9dda-a797d595c56e admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e0db0d83f040c093853d7ad0379b9d, user_id=f46086446dfa4237a0646c0f53ab3eed, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:58.814340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42752c-de90-42bc-9dda-a797d595c56e admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:58.842139 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1340/2694] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:10:58 2022] PUT /identity/v3/projects/84e0db0d83f040c093853d7ad0379b9d/users/f46086446dfa4237a0646c0f53ab3eed/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:10:58.856169 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc72c3d-929b-43bc-abeb-72e8f5f36c66 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:58.856457 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc72c3d-929b-43bc-abeb-72e8f5f36c66 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:58.856756 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc72c3d-929b-43bc-abeb-72e8f5f36c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:58.917202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-5cc72c3d-929b-43bc-abeb-72e8f5f36c66 None None] MFA Rules not processed for user `f46086446dfa4237a0646c0f53ab3eed`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:58.919059 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5cc72c3d-929b-43bc-abeb-72e8f5f36c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:59.027832 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:59.098332 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1355/2695] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:59.102978 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42752c-de90-42bc-9dda-a797d595c56e admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:59.231637 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42752c-de90-42bc-9dda-a797d595c56e admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:59.238806 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36127d70-80ce-4660-b655-8893b3e2a9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:59.239505 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36127d70-80ce-4660-b655-8893b3e2a9ed admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:59.240276 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36127d70-80ce-4660-b655-8893b3e2a9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:59.240712 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36127d70-80ce-4660-b655-8893b3e2a9ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:59.241438 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36127d70-80ce-4660-b655-8893b3e2a9ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:59.243699 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36127d70-80ce-4660-b655-8893b3e2a9ed admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:59.300155 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1341/2696] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:10:59 2022] POST /identity/v3/projects => generated 377 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:59.304366 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc72c3d-929b-43bc-abeb-72e8f5f36c66 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:59.321955 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc72c3d-929b-43bc-abeb-72e8f5f36c66 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:59.432920 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fc2f3-959c-4d55-a329-3c899929deaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:59.434184 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fc2f3-959c-4d55-a329-3c899929deaa admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:59.435074 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fc2f3-959c-4d55-a329-3c899929deaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:59.435561 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fc2f3-959c-4d55-a329-3c899929deaa admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:59.436389 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334fc2f3-959c-4d55-a329-3c899929deaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:59.439680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334fc2f3-959c-4d55-a329-3c899929deaa admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:59.480097 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1356/2697] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:10:59 2022] POST /identity/v3/users => generated 295 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:10:59.483722 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36127d70-80ce-4660-b655-8893b3e2a9ed admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:59.498800 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36127d70-80ce-4660-b655-8893b3e2a9ed admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:59.505180 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab1555-be65-421f-96b1-aa5ba7ea5afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:59.505180 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab1555-be65-421f-96b1-aa5ba7ea5afa admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:59.505180 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab1555-be65-421f-96b1-aa5ba7ea5afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:59.505505 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab1555-be65-421f-96b1-aa5ba7ea5afa admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:59.506218 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab1555-be65-421f-96b1-aa5ba7ea5afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:59.507748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab1555-be65-421f-96b1-aa5ba7ea5afa admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:59.531463 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fc2f3-959c-4d55-a329-3c899929deaa admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:59.537962 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1342/2698] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:59.543574 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fc2f3-959c-4d55-a329-3c899929deaa admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:59.565374 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c6027-b0e8-4f3f-9913-5454efe90ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:59.568890 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c6027-b0e8-4f3f-9913-5454efe90ae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:59.571456 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c6027-b0e8-4f3f-9913-5454efe90ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:59.571754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c6027-b0e8-4f3f-9913-5454efe90ae3 admin admin] PATH_INFO: `/v3/projects/a1a3db89602f4318879aed44ad96e4a2/users/e6b3e5eebe254da4870d65398d92ac65/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:59.595932 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c6027-b0e8-4f3f-9913-5454efe90ae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a3db89602f4318879aed44ad96e4a2, user_id=e6b3e5eebe254da4870d65398d92ac65, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:59.598837 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c6027-b0e8-4f3f-9913-5454efe90ae3 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:59.618542 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1357/2699] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:10:59 2022] PUT /identity/v3/projects/a1a3db89602f4318879aed44ad96e4a2/users/e6b3e5eebe254da4870d65398d92ac65/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:10:59.622464 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab1555-be65-421f-96b1-aa5ba7ea5afa admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:59.634391 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab1555-be65-421f-96b1-aa5ba7ea5afa admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:59.679511 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:59.719930 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0117b4-d96d-4b03-afe1-8761116e2e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:59.721117 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0117b4-d96d-4b03-afe1-8761116e2e19 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:59.721582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0117b4-d96d-4b03-afe1-8761116e2e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:59.722067 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0117b4-d96d-4b03-afe1-8761116e2e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:59.722937 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0117b4-d96d-4b03-afe1-8761116e2e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:59.724842 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0117b4-d96d-4b03-afe1-8761116e2e19 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:59.742129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1343/2700] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:10:59.746010 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c6027-b0e8-4f3f-9913-5454efe90ae3 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:59.770697 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c6027-b0e8-4f3f-9913-5454efe90ae3 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:10:59.780128 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459218d-3e65-40ff-9f38-51b83329a16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:10:59.781026 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459218d-3e65-40ff-9f38-51b83329a16c admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:59.781407 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459218d-3e65-40ff-9f38-51b83329a16c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:59.781924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459218d-3e65-40ff-9f38-51b83329a16c admin admin] PATH_INFO: `/v3/projects/a1a3db89602f4318879aed44ad96e4a2/users/e6b3e5eebe254da4870d65398d92ac65/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:59.784193 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459218d-3e65-40ff-9f38-51b83329a16c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a3db89602f4318879aed44ad96e4a2, user_id=e6b3e5eebe254da4870d65398d92ac65, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:10:59.787279 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459218d-3e65-40ff-9f38-51b83329a16c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:10:59.800773 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1358/2701] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:10:59 2022] PUT /identity/v3/projects/a1a3db89602f4318879aed44ad96e4a2/users/e6b3e5eebe254da4870d65398d92ac65/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:10:59.801189 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ccc37-1f20-40a0-ab5f-e9b6f8aa444e None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:59.801482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ccc37-1f20-40a0-ab5f-e9b6f8aa444e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:59.801826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ccc37-1f20-40a0-ab5f-e9b6f8aa444e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:59.812034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577c380-5e61-4b73-accc-7fe1870eb869 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:10:59.812384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577c380-5e61-4b73-accc-7fe1870eb869 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:10:59.812725 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577c380-5e61-4b73-accc-7fe1870eb869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:10:59.834270 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-911ccc37-1f20-40a0-ab5f-e9b6f8aa444e None None] MFA Rules not processed for user `827f496a660c4ea7be6a827f9f27d09d`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:59.835510 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-911ccc37-1f20-40a0-ab5f-e9b6f8aa444e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:59.866740 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-2577c380-5e61-4b73-accc-7fe1870eb869 None None] MFA Rules not processed for user `e6b3e5eebe254da4870d65398d92ac65`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:10:59.868308 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2577c380-5e61-4b73-accc-7fe1870eb869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:10:59.930204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1344/2702] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:10:59.969483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1359/2703] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:10:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:10:59.977158 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ccc37-1f20-40a0-ab5f-e9b6f8aa444e None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:10:59.979030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-911ccc37-1f20-40a0-ab5f-e9b6f8aa444e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:00.069697 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ccc37-1f20-40a0-ab5f-e9b6f8aa444e None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:00.073773 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c96fc-21bd-414b-97c2-041830361b62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:00.074702 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c96fc-21bd-414b-97c2-041830361b62 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:00.075048 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c96fc-21bd-414b-97c2-041830361b62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:00.075402 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c96fc-21bd-414b-97c2-041830361b62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:00.147139 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c96fc-21bd-414b-97c2-041830361b62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:00.148887 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c96fc-21bd-414b-97c2-041830361b62 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:00.160034 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1345/2704] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:10:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:11:00.443031 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577c380-5e61-4b73-accc-7fe1870eb869 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:00.445025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2577c380-5e61-4b73-accc-7fe1870eb869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:00.488577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:00.540229 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577c380-5e61-4b73-accc-7fe1870eb869 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:00.548942 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7f25a-6ddd-4584-903b-c60bfd16e2c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:00.550346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7f25a-6ddd-4584-903b-c60bfd16e2c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:00.550754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7f25a-6ddd-4584-903b-c60bfd16e2c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:00.551102 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7f25a-6ddd-4584-903b-c60bfd16e2c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:00.558974 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f9c7f25a-6ddd-4584-903b-c60bfd16e2c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:00.574695 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7f25a-6ddd-4584-903b-c60bfd16e2c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:00.599936 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7f25a-6ddd-4584-903b-c60bfd16e2c2 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:00.628962 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1360/2705] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:11:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:11:01.306341 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c96fc-21bd-414b-97c2-041830361b62 service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:01.309181 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ad1c96fc-21bd-414b-97c2-041830361b62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:01.377204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:01.469331 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c96fc-21bd-414b-97c2-041830361b62 service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:01.492257 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8848755-a430-430b-95ea-1702e618e17d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abf9ab5fafe94afdb3ebe98536b5cc3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:01.493138 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8848755-a430-430b-95ea-1702e618e17d service placement] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:01.493654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8848755-a430-430b-95ea-1702e618e17d service placement] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:01.494096 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8848755-a430-430b-95ea-1702e618e17d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:01.498046 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a8848755-a430-430b-95ea-1702e618e17d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:01.529425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8848755-a430-430b-95ea-1702e618e17d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:01.532071 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8848755-a430-430b-95ea-1702e618e17d service placement] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:01.551794 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1346/2706] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:11:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:11:03.286457 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7f25a-6ddd-4584-903b-c60bfd16e2c2 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:03.307771 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7f25a-6ddd-4584-903b-c60bfd16e2c2 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:03.344475 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12093ae4-0bf6-4626-b2c8-a816dc49edf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:03.355757 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12093ae4-0bf6-4626-b2c8-a816dc49edf4 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:03.356179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12093ae4-0bf6-4626-b2c8-a816dc49edf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:03.358760 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12093ae4-0bf6-4626-b2c8-a816dc49edf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:03.387801 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12093ae4-0bf6-4626-b2c8-a816dc49edf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:03.390506 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12093ae4-0bf6-4626-b2c8-a816dc49edf4 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:03.420044 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1361/2707] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:11:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:11:04.546595 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8848755-a430-430b-95ea-1702e618e17d service placement] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:04.548573 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a8848755-a430-430b-95ea-1702e618e17d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:04.566148 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8848755-a430-430b-95ea-1702e618e17d service placement] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:04.573538 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa73605-8ad3-4a2e-a988-4216e991e831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:04.574470 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa73605-8ad3-4a2e-a988-4216e991e831 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:04.576595 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa73605-8ad3-4a2e-a988-4216e991e831 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:04.577049 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa73605-8ad3-4a2e-a988-4216e991e831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:04.579751 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9aa73605-8ad3-4a2e-a988-4216e991e831 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:04.590654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa73605-8ad3-4a2e-a988-4216e991e831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:04.592192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa73605-8ad3-4a2e-a988-4216e991e831 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:04.602018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1347/2708] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:11:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:11:09.627505 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89977188-31b8-4f8a-af69-36a45c2dea03 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:09.628013 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89977188-31b8-4f8a-af69-36a45c2dea03 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:09.628112 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89977188-31b8-4f8a-af69-36a45c2dea03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:09.647864 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-89977188-31b8-4f8a-af69-36a45c2dea03 None None] MFA Rules not processed for user `6dcdcefc078b406d99420a5bab1776c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:11:09.649194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-89977188-31b8-4f8a-af69-36a45c2dea03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:09.705104 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1362/2709] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:11:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:11:09.953223 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa73605-8ad3-4a2e-a988-4216e991e831 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:09.955360 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9aa73605-8ad3-4a2e-a988-4216e991e831 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:10.001233 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89977188-31b8-4f8a-af69-36a45c2dea03 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:10.012982 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89977188-31b8-4f8a-af69-36a45c2dea03 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:10.017735 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ba894-e29d-4b12-a54a-189452cf6932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:10.018915 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ba894-e29d-4b12-a54a-189452cf6932 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:10.019249 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ba894-e29d-4b12-a54a-189452cf6932 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:10.019524 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ba894-e29d-4b12-a54a-189452cf6932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:10.022078 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-cc8ba894-e29d-4b12-a54a-189452cf6932 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:10.038000 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ba894-e29d-4b12-a54a-189452cf6932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:10.039597 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ba894-e29d-4b12-a54a-189452cf6932 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:10.049644 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1363/2710] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:11:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 01:11:10.051175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa73605-8ad3-4a2e-a988-4216e991e831 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:10.056528 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66b262-bdb8-4360-9cf8-43289d1b0c9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:10.057122 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66b262-bdb8-4360-9cf8-43289d1b0c9f service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:10.057509 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66b262-bdb8-4360-9cf8-43289d1b0c9f service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:10.057659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66b262-bdb8-4360-9cf8-43289d1b0c9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:10.059426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7e66b262-bdb8-4360-9cf8-43289d1b0c9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:10.072045 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66b262-bdb8-4360-9cf8-43289d1b0c9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:10.073611 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66b262-bdb8-4360-9cf8-43289d1b0c9f service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:10.084578 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1348/2711] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:11:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:11:12.341120 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409fc7c-620b-450e-b7e5-bf15d2253c9b None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:12.341654 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409fc7c-620b-450e-b7e5-bf15d2253c9b None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:12.341654 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409fc7c-620b-450e-b7e5-bf15d2253c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:12.360825 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-2409fc7c-620b-450e-b7e5-bf15d2253c9b None None] MFA Rules not processed for user `eb9d1149a417436bbf1577d61407c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:11:12.362093 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2409fc7c-620b-450e-b7e5-bf15d2253c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:12.435029 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1364/2712] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 14 01:11:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:11:12.451664 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66b262-bdb8-4360-9cf8-43289d1b0c9f service nova] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:12.453410 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7e66b262-bdb8-4360-9cf8-43289d1b0c9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:12.534385 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66b262-bdb8-4360-9cf8-43289d1b0c9f service nova] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:12.540261 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cf03d-e8da-43e0-aeb9-831d1bcffad5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d05652bfe542d5a2cfa39fbf7a83c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:12.541003 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cf03d-e8da-43e0-aeb9-831d1bcffad5 service swift] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:12.541237 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cf03d-e8da-43e0-aeb9-831d1bcffad5 service swift] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:12.541559 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cf03d-e8da-43e0-aeb9-831d1bcffad5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:12.561317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937cf03d-e8da-43e0-aeb9-831d1bcffad5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:12.563403 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937cf03d-e8da-43e0-aeb9-831d1bcffad5 service swift] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:12.573713 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1349/2713] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 14 01:11:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 01:11:14.198902 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409fc7c-620b-450e-b7e5-bf15d2253c9b None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:14.220663 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409fc7c-620b-450e-b7e5-bf15d2253c9b None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:14.255675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588eeece-0b80-4153-91ef-609a353ef757 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:14.256471 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588eeece-0b80-4153-91ef-609a353ef757 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:14.256852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588eeece-0b80-4153-91ef-609a353ef757 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:14.257242 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588eeece-0b80-4153-91ef-609a353ef757 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:14.259131 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-588eeece-0b80-4153-91ef-609a353ef757 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:14.287516 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588eeece-0b80-4153-91ef-609a353ef757 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:14.289365 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588eeece-0b80-4153-91ef-609a353ef757 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:14.314227 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1365/2714] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:11:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:11:17.399186 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cf03d-e8da-43e0-aeb9-831d1bcffad5 service swift] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:17.421415 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:17.479493 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cf03d-e8da-43e0-aeb9-831d1bcffad5 service swift] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:17.484042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823a24c-e2db-40c4-9709-5334df449e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:17.484708 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823a24c-e2db-40c4-9709-5334df449e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:17.484987 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823a24c-e2db-40c4-9709-5334df449e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:17.485258 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823a24c-e2db-40c4-9709-5334df449e1b admin admin] PATH_INFO: `/v3/users/f46086446dfa4237a0646c0f53ab3eed` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:17.486402 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823a24c-e2db-40c4-9709-5334df449e1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f46086446dfa4237a0646c0f53ab3eed)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:17.488349 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823a24c-e2db-40c4-9709-5334df449e1b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:17.553602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4823a24c-e2db-40c4-9709-5334df449e1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f46086446dfa4237a0646c0f53ab3eed'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:17.554296 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4823a24c-e2db-40c4-9709-5334df449e1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f46086446dfa4237a0646c0f53ab3eed'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:17.561465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4823a24c-e2db-40c4-9709-5334df449e1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f46086446dfa4237a0646c0f53ab3eed'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:17.575141 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4823a24c-e2db-40c4-9709-5334df449e1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f46086446dfa4237a0646c0f53ab3eed'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:17.575939 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4823a24c-e2db-40c4-9709-5334df449e1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f46086446dfa4237a0646c0f53ab3eed'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:17.590965 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1350/2715] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:11:17 2022] DELETE /identity/v3/users/f46086446dfa4237a0646c0f53ab3eed => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:11:17.596190 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cf0a4-9097-4b14-af34-d1c87376d217 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:17.597205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cf0a4-9097-4b14-af34-d1c87376d217 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:17.597744 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cf0a4-9097-4b14-af34-d1c87376d217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:17.618983 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ad5cf0a4-9097-4b14-af34-d1c87376d217 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:11:17.620294 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ad5cf0a4-9097-4b14-af34-d1c87376d217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:17.652265 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:17.692736 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1366/2716] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:11:17.702578 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823a24c-e2db-40c4-9709-5334df449e1b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:17.704758 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4823a24c-e2db-40c4-9709-5334df449e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:17.763816 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823a24c-e2db-40c4-9709-5334df449e1b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:17.768339 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe6dbd-285b-4cc7-839e-b23bc4f58a43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:17.769172 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe6dbd-285b-4cc7-839e-b23bc4f58a43 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:17.769459 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe6dbd-285b-4cc7-839e-b23bc4f58a43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:17.769732 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe6dbd-285b-4cc7-839e-b23bc4f58a43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:17.781318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe6dbd-285b-4cc7-839e-b23bc4f58a43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:17.782823 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe6dbd-285b-4cc7-839e-b23bc4f58a43 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:17.794954 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1351/2717] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:11:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:11:18.204199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5cf0a4-9097-4b14-af34-d1c87376d217 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:18.205649 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ad5cf0a4-9097-4b14-af34-d1c87376d217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:18.218908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5cf0a4-9097-4b14-af34-d1c87376d217 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:18.228735 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e972ca-c8a7-4026-97a5-9eaa54f129ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:18.229468 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e972ca-c8a7-4026-97a5-9eaa54f129ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:18.229775 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e972ca-c8a7-4026-97a5-9eaa54f129ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:18.230072 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e972ca-c8a7-4026-97a5-9eaa54f129ba admin admin] PATH_INFO: `/v3/projects/84e0db0d83f040c093853d7ad0379b9d` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:18.231352 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e972ca-c8a7-4026-97a5-9eaa54f129ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=84e0db0d83f040c093853d7ad0379b9d)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:18.233586 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e972ca-c8a7-4026-97a5-9eaa54f129ba admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:18.287254 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b9e972ca-c8a7-4026-97a5-9eaa54f129ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84e0db0d83f040c093853d7ad0379b9d', 'request_id': 'req-b9e972ca-c8a7-4026-97a5-9eaa54f129ba'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:18.295508 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b9e972ca-c8a7-4026-97a5-9eaa54f129ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84e0db0d83f040c093853d7ad0379b9d', 'request_id': 'req-b9e972ca-c8a7-4026-97a5-9eaa54f129ba'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:18.312281 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b9e972ca-c8a7-4026-97a5-9eaa54f129ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84e0db0d83f040c093853d7ad0379b9d', 'request_id': 'req-b9e972ca-c8a7-4026-97a5-9eaa54f129ba'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:18.320664 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b9e972ca-c8a7-4026-97a5-9eaa54f129ba admin admin] The token cache is being invalidate because project 84e0db0d83f040c093853d7ad0379b9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:11:18.321074 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b9e972ca-c8a7-4026-97a5-9eaa54f129ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:18.321728 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b9e972ca-c8a7-4026-97a5-9eaa54f129ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:18.326183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1367/2718] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:11:18 2022] DELETE /identity/v3/projects/84e0db0d83f040c093853d7ad0379b9d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:11:18.327698 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe6dbd-285b-4cc7-839e-b23bc4f58a43 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:18.338278 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe6dbd-285b-4cc7-839e-b23bc4f58a43 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:18.382003 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:18.404530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940e037-aea1-4f73-a247-2c980a1ad4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:18.405305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940e037-aea1-4f73-a247-2c980a1ad4a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:18.405586 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940e037-aea1-4f73-a247-2c980a1ad4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:18.405883 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940e037-aea1-4f73-a247-2c980a1ad4a3 admin admin] PATH_INFO: `/v3/users/e6b3e5eebe254da4870d65398d92ac65` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:18.407079 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8940e037-aea1-4f73-a247-2c980a1ad4a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6b3e5eebe254da4870d65398d92ac65)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:18.409006 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8940e037-aea1-4f73-a247-2c980a1ad4a3 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:18.462553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8940e037-aea1-4f73-a247-2c980a1ad4a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6b3e5eebe254da4870d65398d92ac65'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:18.463144 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8940e037-aea1-4f73-a247-2c980a1ad4a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6b3e5eebe254da4870d65398d92ac65'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:18.470963 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8940e037-aea1-4f73-a247-2c980a1ad4a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6b3e5eebe254da4870d65398d92ac65'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:18.483487 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8940e037-aea1-4f73-a247-2c980a1ad4a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6b3e5eebe254da4870d65398d92ac65'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:18.484207 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8940e037-aea1-4f73-a247-2c980a1ad4a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6b3e5eebe254da4870d65398d92ac65'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:18.501266 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1352/2719] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:11:18 2022] DELETE /identity/v3/users/e6b3e5eebe254da4870d65398d92ac65 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:11:18.856162 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e972ca-c8a7-4026-97a5-9eaa54f129ba admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:18.858300 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b9e972ca-c8a7-4026-97a5-9eaa54f129ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:18.877316 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e972ca-c8a7-4026-97a5-9eaa54f129ba admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:18.959962 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252a16d-81f8-47fc-ae9c-3811968d04cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:18.960764 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252a16d-81f8-47fc-ae9c-3811968d04cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:18.961210 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252a16d-81f8-47fc-ae9c-3811968d04cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:18.961586 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252a16d-81f8-47fc-ae9c-3811968d04cd admin admin] PATH_INFO: `/v3/projects/a1a3db89602f4318879aed44ad96e4a2` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:18.963062 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252a16d-81f8-47fc-ae9c-3811968d04cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1a3db89602f4318879aed44ad96e4a2)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:18.965309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252a16d-81f8-47fc-ae9c-3811968d04cd admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:19.022311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4252a16d-81f8-47fc-ae9c-3811968d04cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1a3db89602f4318879aed44ad96e4a2', 'request_id': 'req-4252a16d-81f8-47fc-ae9c-3811968d04cd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:19.031090 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4252a16d-81f8-47fc-ae9c-3811968d04cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1a3db89602f4318879aed44ad96e4a2', 'request_id': 'req-4252a16d-81f8-47fc-ae9c-3811968d04cd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:19.038168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4252a16d-81f8-47fc-ae9c-3811968d04cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1a3db89602f4318879aed44ad96e4a2', 'request_id': 'req-4252a16d-81f8-47fc-ae9c-3811968d04cd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:19.039917 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:19.053453 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4252a16d-81f8-47fc-ae9c-3811968d04cd admin admin] The token cache is being invalidate because project a1a3db89602f4318879aed44ad96e4a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:11:19.053871 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4252a16d-81f8-47fc-ae9c-3811968d04cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:19.054588 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4252a16d-81f8-47fc-ae9c-3811968d04cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:19.056359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1368/2720] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:11:18 2022] DELETE /identity/v3/projects/a1a3db89602f4318879aed44ad96e4a2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:11:19.061498 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c86e9-861e-4992-88d5-bd758fe83668 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:19.062015 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c86e9-861e-4992-88d5-bd758fe83668 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:19.062528 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c86e9-861e-4992-88d5-bd758fe83668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:19.084808 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-d71c86e9-861e-4992-88d5-bd758fe83668 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:11:19.086059 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d71c86e9-861e-4992-88d5-bd758fe83668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:19.161614 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1353/2721] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:11:19.171919 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70aeb4-c96a-4163-aba2-63c7d3437cb1 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:19.172377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70aeb4-c96a-4163-aba2-63c7d3437cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:19.172816 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70aeb4-c96a-4163-aba2-63c7d3437cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:19.206165 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ec70aeb4-c96a-4163-aba2-63c7d3437cb1 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:11:19.208230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ec70aeb4-c96a-4163-aba2-63c7d3437cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:19.222199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1369/2722] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:11:19.226077 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c86e9-861e-4992-88d5-bd758fe83668 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:19.236578 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c86e9-861e-4992-88d5-bd758fe83668 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:19.247921 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ecc3d-4cf5-436c-91a2-efe7ac66cb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:19.248551 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ecc3d-4cf5-436c-91a2-efe7ac66cb83 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:19.248826 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ecc3d-4cf5-436c-91a2-efe7ac66cb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:19.249094 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ecc3d-4cf5-436c-91a2-efe7ac66cb83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:19.249741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ecc3d-4cf5-436c-91a2-efe7ac66cb83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:11:19.250597 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ecc3d-4cf5-436c-91a2-efe7ac66cb83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:19.253578 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ecc3d-4cf5-436c-91a2-efe7ac66cb83 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:19.285514 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1354/2723] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:11:19.286829 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70aeb4-c96a-4163-aba2-63c7d3437cb1 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:19.297315 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70aeb4-c96a-4163-aba2-63c7d3437cb1 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:19.303984 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34250a5-c3f2-4d68-a8b1-7d25f287b89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:19.304611 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34250a5-c3f2-4d68-a8b1-7d25f287b89f admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:19.305081 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34250a5-c3f2-4d68-a8b1-7d25f287b89f admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:19.305362 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34250a5-c3f2-4d68-a8b1-7d25f287b89f admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:19.306696 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34250a5-c3f2-4d68-a8b1-7d25f287b89f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:19.308771 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34250a5-c3f2-4d68-a8b1-7d25f287b89f admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:19.342365 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1370/2724] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:11:19 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:11:19.347173 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ecc3d-4cf5-436c-91a2-efe7ac66cb83 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:19.358320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ecc3d-4cf5-436c-91a2-efe7ac66cb83 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:19.412382 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:19.428410 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501680f-a3c7-4ece-bda4-de60a973c7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:19.429017 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501680f-a3c7-4ece-bda4-de60a973c7c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:19.429319 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501680f-a3c7-4ece-bda4-de60a973c7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:19.429551 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501680f-a3c7-4ece-bda4-de60a973c7c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:19.430203 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9501680f-a3c7-4ece-bda4-de60a973c7c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:19.432096 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9501680f-a3c7-4ece-bda4-de60a973c7c3 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:19.453701 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1355/2725] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:11:19 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:11:19.457906 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34250a5-c3f2-4d68-a8b1-7d25f287b89f admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:19.469056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34250a5-c3f2-4d68-a8b1-7d25f287b89f admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:19.474404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb72d53-2392-4806-8f49-ce3d2adc1471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:19.475182 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb72d53-2392-4806-8f49-ce3d2adc1471 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:19.475469 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb72d53-2392-4806-8f49-ce3d2adc1471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:19.475766 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb72d53-2392-4806-8f49-ce3d2adc1471 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:19.476396 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb72d53-2392-4806-8f49-ce3d2adc1471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:19.478233 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb72d53-2392-4806-8f49-ce3d2adc1471 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:19.495145 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1371/2726] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:11:19.496948 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501680f-a3c7-4ece-bda4-de60a973c7c3 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:19.508508 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501680f-a3c7-4ece-bda4-de60a973c7c3 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:19.514562 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7dc3f-fbad-4afa-b96a-14ac064f17bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:19.515331 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7dc3f-fbad-4afa-b96a-14ac064f17bc admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:19.515616 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7dc3f-fbad-4afa-b96a-14ac064f17bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:19.515926 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7dc3f-fbad-4afa-b96a-14ac064f17bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:19.516623 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7dc3f-fbad-4afa-b96a-14ac064f17bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:19.519609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7dc3f-fbad-4afa-b96a-14ac064f17bc admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:19.531998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1356/2727] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:11:19.536361 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb72d53-2392-4806-8f49-ce3d2adc1471 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:19.550310 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb72d53-2392-4806-8f49-ce3d2adc1471 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:19.555062 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292a5a9-0922-4f76-a618-86e515f493cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:19.555724 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292a5a9-0922-4f76-a618-86e515f493cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:19.555998 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292a5a9-0922-4f76-a618-86e515f493cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:19.556271 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292a5a9-0922-4f76-a618-86e515f493cd admin admin] PATH_INFO: `/v3/projects/9e120772766e4456b216c06e24270249/users/fdf6ba2b7ede495fa172816e407e04e8/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:19.575398 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292a5a9-0922-4f76-a618-86e515f493cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e120772766e4456b216c06e24270249, user_id=fdf6ba2b7ede495fa172816e407e04e8, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:19.578336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292a5a9-0922-4f76-a618-86e515f493cd admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:19.615783 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1372/2728] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:11:19 2022] PUT /identity/v3/projects/9e120772766e4456b216c06e24270249/users/fdf6ba2b7ede495fa172816e407e04e8/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:11:19.616019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dceb35-b9aa-4e6e-a005-0653ff49a318 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:19.616019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dceb35-b9aa-4e6e-a005-0653ff49a318 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:19.616019 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dceb35-b9aa-4e6e-a005-0653ff49a318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:19.644403 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-f5dceb35-b9aa-4e6e-a005-0653ff49a318 None None] MFA Rules not processed for user `fdf6ba2b7ede495fa172816e407e04e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:11:19.645723 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f5dceb35-b9aa-4e6e-a005-0653ff49a318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:19.713500 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1357/2729] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:11:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:11:19.718173 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292a5a9-0922-4f76-a618-86e515f493cd admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:19.786788 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292a5a9-0922-4f76-a618-86e515f493cd admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:19.792080 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0dba09-59ea-4eaf-a429-f8e68e7cc5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:19.792886 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dba09-59ea-4eaf-a429-f8e68e7cc5eb admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:19.793222 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dba09-59ea-4eaf-a429-f8e68e7cc5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:19.793586 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dba09-59ea-4eaf-a429-f8e68e7cc5eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:19.794424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0dba09-59ea-4eaf-a429-f8e68e7cc5eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:19.796743 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0dba09-59ea-4eaf-a429-f8e68e7cc5eb admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:19.829832 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1373/2730] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:11:19 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 01:11:19.832710 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dceb35-b9aa-4e6e-a005-0653ff49a318 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:19.844477 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dceb35-b9aa-4e6e-a005-0653ff49a318 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:19.908482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70405f04-3401-46cd-b05a-931294c0bd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:19.909173 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70405f04-3401-46cd-b05a-931294c0bd94 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:19.909462 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70405f04-3401-46cd-b05a-931294c0bd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:19.909729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70405f04-3401-46cd-b05a-931294c0bd94 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:19.910399 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70405f04-3401-46cd-b05a-931294c0bd94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:19.912317 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70405f04-3401-46cd-b05a-931294c0bd94 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:19.937661 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1358/2731] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:11:19 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:11:19.941097 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0dba09-59ea-4eaf-a429-f8e68e7cc5eb admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:19.951858 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0dba09-59ea-4eaf-a429-f8e68e7cc5eb admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:19.957098 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0f434-651a-4336-b04f-e36502dd2cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:19.958146 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0f434-651a-4336-b04f-e36502dd2cdc admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:19.958759 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0f434-651a-4336-b04f-e36502dd2cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:19.959136 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0f434-651a-4336-b04f-e36502dd2cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:19.960062 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0f434-651a-4336-b04f-e36502dd2cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:19.962050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0f434-651a-4336-b04f-e36502dd2cdc admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:19.975412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1374/2732] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:11:19.980034 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70405f04-3401-46cd-b05a-931294c0bd94 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:20.003006 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70405f04-3401-46cd-b05a-931294c0bd94 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:20.009704 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a85221-d84a-4c90-a02e-204126abcaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:20.010616 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a85221-d84a-4c90-a02e-204126abcaf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:20.010999 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a85221-d84a-4c90-a02e-204126abcaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:20.011631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a85221-d84a-4c90-a02e-204126abcaf9 admin admin] PATH_INFO: `/v3/projects/48149ec88d9e4e90b1a8e2a982f441f4/users/6176b824430448258387160a3eb29171/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:20.035408 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a85221-d84a-4c90-a02e-204126abcaf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48149ec88d9e4e90b1a8e2a982f441f4, user_id=6176b824430448258387160a3eb29171, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:20.038256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a85221-d84a-4c90-a02e-204126abcaf9 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:20.052477 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1359/2733] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:11:19 2022] PUT /identity/v3/projects/48149ec88d9e4e90b1a8e2a982f441f4/users/6176b824430448258387160a3eb29171/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:11:20.056463 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0f434-651a-4336-b04f-e36502dd2cdc admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:20.067020 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0f434-651a-4336-b04f-e36502dd2cdc admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:20.144192 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2cb72c-8990-485b-b34c-4be319fdd41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:20.144850 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cb72c-8990-485b-b34c-4be319fdd41f admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:20.145131 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cb72c-8990-485b-b34c-4be319fdd41f admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:20.145404 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cb72c-8990-485b-b34c-4be319fdd41f admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:20.146087 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2cb72c-8990-485b-b34c-4be319fdd41f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:20.147719 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2cb72c-8990-485b-b34c-4be319fdd41f admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:20.149164 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:20.164763 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1375/2734] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:11:20.165624 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a85221-d84a-4c90-a02e-204126abcaf9 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:20.177850 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a85221-d84a-4c90-a02e-204126abcaf9 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:20.181300 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b446e-4a07-49e9-9b19-aa6e17306a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:20.182006 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b446e-4a07-49e9-9b19-aa6e17306a2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:20.182282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b446e-4a07-49e9-9b19-aa6e17306a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:20.182546 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b446e-4a07-49e9-9b19-aa6e17306a2f admin admin] PATH_INFO: `/v3/projects/48149ec88d9e4e90b1a8e2a982f441f4/users/6176b824430448258387160a3eb29171/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:20.184463 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b446e-4a07-49e9-9b19-aa6e17306a2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=48149ec88d9e4e90b1a8e2a982f441f4, user_id=6176b824430448258387160a3eb29171, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:20.187152 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b446e-4a07-49e9-9b19-aa6e17306a2f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:20.198742 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1360/2735] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:11:20 2022] PUT /identity/v3/projects/48149ec88d9e4e90b1a8e2a982f441f4/users/6176b824430448258387160a3eb29171/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:11:20.209960 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fa9e6-6d34-4497-94bc-54f190b74005 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:20.210336 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fa9e6-6d34-4497-94bc-54f190b74005 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:20.210682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fa9e6-6d34-4497-94bc-54f190b74005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:20.241634 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-6f8fa9e6-6d34-4497-94bc-54f190b74005 None None] MFA Rules not processed for user `6176b824430448258387160a3eb29171`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:11:20.242940 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6f8fa9e6-6d34-4497-94bc-54f190b74005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:20.315841 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1376/2736] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:11:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:11:20.326916 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b446e-4a07-49e9-9b19-aa6e17306a2f admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:20.329313 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-609b446e-4a07-49e9-9b19-aa6e17306a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:20.341950 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:20.394902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b446e-4a07-49e9-9b19-aa6e17306a2f admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:20.400517 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbca62b-2793-4dc6-8c24-5f96b90cae67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:20.401389 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbca62b-2793-4dc6-8c24-5f96b90cae67 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:20.401794 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbca62b-2793-4dc6-8c24-5f96b90cae67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:20.402097 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbca62b-2793-4dc6-8c24-5f96b90cae67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:20.412753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbca62b-2793-4dc6-8c24-5f96b90cae67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:20.414305 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbca62b-2793-4dc6-8c24-5f96b90cae67 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:20.423913 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1361/2737] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:11:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:11:20.454867 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fa9e6-6d34-4497-94bc-54f190b74005 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:20.523952 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fa9e6-6d34-4497-94bc-54f190b74005 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:20.528934 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362354b-facc-49f6-9a49-935b89727093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:20.529565 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362354b-facc-49f6-9a49-935b89727093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:20.529872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362354b-facc-49f6-9a49-935b89727093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:20.530179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362354b-facc-49f6-9a49-935b89727093 admin admin] PATH_INFO: `/v3/users/fdf6ba2b7ede495fa172816e407e04e8` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:20.531364 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362354b-facc-49f6-9a49-935b89727093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdf6ba2b7ede495fa172816e407e04e8)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:20.533295 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362354b-facc-49f6-9a49-935b89727093 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:20.580037 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7362354b-facc-49f6-9a49-935b89727093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdf6ba2b7ede495fa172816e407e04e8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:20.586801 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7362354b-facc-49f6-9a49-935b89727093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdf6ba2b7ede495fa172816e407e04e8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:20.598745 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7362354b-facc-49f6-9a49-935b89727093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdf6ba2b7ede495fa172816e407e04e8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:20.599407 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7362354b-facc-49f6-9a49-935b89727093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdf6ba2b7ede495fa172816e407e04e8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:20.600010 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7362354b-facc-49f6-9a49-935b89727093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdf6ba2b7ede495fa172816e407e04e8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:20.607871 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:20.612907 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1377/2738] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:11:20 2022] DELETE /identity/v3/users/fdf6ba2b7ede495fa172816e407e04e8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 01:11:20.617609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78c854-6b4b-46d4-af94-4614ef789c14 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:20.617930 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78c854-6b4b-46d4-af94-4614ef789c14 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:20.618232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78c854-6b4b-46d4-af94-4614ef789c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:20.637154 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-6e78c854-6b4b-46d4-af94-4614ef789c14 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:11:20.638358 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6e78c854-6b4b-46d4-af94-4614ef789c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:20.694517 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1362/2739] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:11:20.704890 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362354b-facc-49f6-9a49-935b89727093 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:20.706339 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7362354b-facc-49f6-9a49-935b89727093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:20.763422 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362354b-facc-49f6-9a49-935b89727093 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:20.767895 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab130767-a3e5-4370-8532-661e7b966678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:20.768516 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab130767-a3e5-4370-8532-661e7b966678 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:20.768793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab130767-a3e5-4370-8532-661e7b966678 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:20.769062 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab130767-a3e5-4370-8532-661e7b966678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:20.778256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab130767-a3e5-4370-8532-661e7b966678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:20.779742 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab130767-a3e5-4370-8532-661e7b966678 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:20.789537 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1378/2740] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:11:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:11:21.483564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78c854-6b4b-46d4-af94-4614ef789c14 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:21.485081 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6e78c854-6b4b-46d4-af94-4614ef789c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:21.505562 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78c854-6b4b-46d4-af94-4614ef789c14 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:21.511055 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d944d59-c808-4cd1-b27a-ebec5d2fd252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:21.511765 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d944d59-c808-4cd1-b27a-ebec5d2fd252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:21.512004 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d944d59-c808-4cd1-b27a-ebec5d2fd252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:21.512239 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d944d59-c808-4cd1-b27a-ebec5d2fd252 admin admin] PATH_INFO: `/v3/projects/9e120772766e4456b216c06e24270249` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:21.513384 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d944d59-c808-4cd1-b27a-ebec5d2fd252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e120772766e4456b216c06e24270249)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:21.515456 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d944d59-c808-4cd1-b27a-ebec5d2fd252 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:21.570228 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4d944d59-c808-4cd1-b27a-ebec5d2fd252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e120772766e4456b216c06e24270249', 'request_id': 'req-4d944d59-c808-4cd1-b27a-ebec5d2fd252'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:21.582261 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4d944d59-c808-4cd1-b27a-ebec5d2fd252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e120772766e4456b216c06e24270249', 'request_id': 'req-4d944d59-c808-4cd1-b27a-ebec5d2fd252'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:21.590274 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4d944d59-c808-4cd1-b27a-ebec5d2fd252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e120772766e4456b216c06e24270249', 'request_id': 'req-4d944d59-c808-4cd1-b27a-ebec5d2fd252'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:21.602632 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4d944d59-c808-4cd1-b27a-ebec5d2fd252 admin admin] The token cache is being invalidate because project 9e120772766e4456b216c06e24270249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:11:21.603081 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4d944d59-c808-4cd1-b27a-ebec5d2fd252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:21.603786 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4d944d59-c808-4cd1-b27a-ebec5d2fd252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:21.605895 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1363/2741] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:11:21 2022] DELETE /identity/v3/projects/9e120772766e4456b216c06e24270249 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:11:21.610158 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab130767-a3e5-4370-8532-661e7b966678 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:21.620230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab130767-a3e5-4370-8532-661e7b966678 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:21.682791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628b276-0d83-4d6f-8d8a-c21cc8db0a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:21.683426 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628b276-0d83-4d6f-8d8a-c21cc8db0a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:21.683710 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628b276-0d83-4d6f-8d8a-c21cc8db0a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:21.683986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628b276-0d83-4d6f-8d8a-c21cc8db0a7d admin admin] PATH_INFO: `/v3/users/6176b824430448258387160a3eb29171` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:21.685119 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628b276-0d83-4d6f-8d8a-c21cc8db0a7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6176b824430448258387160a3eb29171)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:21.687075 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628b276-0d83-4d6f-8d8a-c21cc8db0a7d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:21.755193 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-a628b276-0d83-4d6f-8d8a-c21cc8db0a7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6176b824430448258387160a3eb29171'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:21.762516 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-a628b276-0d83-4d6f-8d8a-c21cc8db0a7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6176b824430448258387160a3eb29171'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:21.775415 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-a628b276-0d83-4d6f-8d8a-c21cc8db0a7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6176b824430448258387160a3eb29171'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:21.776128 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-a628b276-0d83-4d6f-8d8a-c21cc8db0a7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6176b824430448258387160a3eb29171'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:21.776735 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-a628b276-0d83-4d6f-8d8a-c21cc8db0a7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6176b824430448258387160a3eb29171'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:21.790328 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1379/2742] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:11:21 2022] DELETE /identity/v3/users/6176b824430448258387160a3eb29171 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:11:22.060743 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d944d59-c808-4cd1-b27a-ebec5d2fd252 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:22.062225 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4d944d59-c808-4cd1-b27a-ebec5d2fd252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:22.075620 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d944d59-c808-4cd1-b27a-ebec5d2fd252 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:22.112837 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:22.141335 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4307dc-1e94-4d47-a598-85123b748b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:22.142001 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4307dc-1e94-4d47-a598-85123b748b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:22.142280 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4307dc-1e94-4d47-a598-85123b748b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:22.142548 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4307dc-1e94-4d47-a598-85123b748b74 admin admin] PATH_INFO: `/v3/projects/48149ec88d9e4e90b1a8e2a982f441f4` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:22.143649 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4307dc-1e94-4d47-a598-85123b748b74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48149ec88d9e4e90b1a8e2a982f441f4)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:22.145533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4307dc-1e94-4d47-a598-85123b748b74 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:22.191917 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ed4307dc-1e94-4d47-a598-85123b748b74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48149ec88d9e4e90b1a8e2a982f441f4', 'request_id': 'req-ed4307dc-1e94-4d47-a598-85123b748b74'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:22.199246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ed4307dc-1e94-4d47-a598-85123b748b74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48149ec88d9e4e90b1a8e2a982f441f4', 'request_id': 'req-ed4307dc-1e94-4d47-a598-85123b748b74'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:22.206100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ed4307dc-1e94-4d47-a598-85123b748b74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48149ec88d9e4e90b1a8e2a982f441f4', 'request_id': 'req-ed4307dc-1e94-4d47-a598-85123b748b74'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:22.216181 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ed4307dc-1e94-4d47-a598-85123b748b74 admin admin] The token cache is being invalidate because project 48149ec88d9e4e90b1a8e2a982f441f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:11:22.216465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ed4307dc-1e94-4d47-a598-85123b748b74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:22.217099 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ed4307dc-1e94-4d47-a598-85123b748b74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:22.218603 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1364/2743] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:11:22 2022] DELETE /identity/v3/projects/48149ec88d9e4e90b1a8e2a982f441f4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:11:22.223520 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8acf4-4179-4d52-b7c5-267b498811b6 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:22.223805 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8acf4-4179-4d52-b7c5-267b498811b6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:22.224081 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8acf4-4179-4d52-b7c5-267b498811b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:22.243086 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-08f8acf4-4179-4d52-b7c5-267b498811b6 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:11:22.244282 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-08f8acf4-4179-4d52-b7c5-267b498811b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:22.260985 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:22.305908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1380/2744] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:11:22.314878 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce3d50-e263-4122-aa98-06824b64c6c5 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:22.315276 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce3d50-e263-4122-aa98-06824b64c6c5 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:22.315659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce3d50-e263-4122-aa98-06824b64c6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:22.335528 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-a5ce3d50-e263-4122-aa98-06824b64c6c5 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:11:22.336721 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a5ce3d50-e263-4122-aa98-06824b64c6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:22.344468 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1365/2745] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:11:22.348665 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8acf4-4179-4d52-b7c5-267b498811b6 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:22.358391 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8acf4-4179-4d52-b7c5-267b498811b6 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:22.363396 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a90e99-2248-4c4a-bb92-001a2501cf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:22.364070 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a90e99-2248-4c4a-bb92-001a2501cf78 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:22.364355 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a90e99-2248-4c4a-bb92-001a2501cf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:22.364656 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a90e99-2248-4c4a-bb92-001a2501cf78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:22.365297 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a90e99-2248-4c4a-bb92-001a2501cf78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:11:22.365599 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a90e99-2248-4c4a-bb92-001a2501cf78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:22.367243 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a90e99-2248-4c4a-bb92-001a2501cf78 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:22.379207 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1381/2746] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:11:22.383328 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce3d50-e263-4122-aa98-06824b64c6c5 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:22.392356 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce3d50-e263-4122-aa98-06824b64c6c5 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:22.396868 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb5bf0-ffdb-40d1-83e4-df6bbdb6535f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:22.397460 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb5bf0-ffdb-40d1-83e4-df6bbdb6535f admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:22.397717 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb5bf0-ffdb-40d1-83e4-df6bbdb6535f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:22.398015 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb5bf0-ffdb-40d1-83e4-df6bbdb6535f admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:22.398714 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb5bf0-ffdb-40d1-83e4-df6bbdb6535f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:22.400841 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb5bf0-ffdb-40d1-83e4-df6bbdb6535f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:22.427743 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1366/2747] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:11:22 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:11:22.431780 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a90e99-2248-4c4a-bb92-001a2501cf78 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:22.442202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a90e99-2248-4c4a-bb92-001a2501cf78 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:22.497684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b319a-1b88-4bf3-9fb5-84dfca7b596d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:22.498309 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b319a-1b88-4bf3-9fb5-84dfca7b596d admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:22.498588 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b319a-1b88-4bf3-9fb5-84dfca7b596d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:22.498860 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b319a-1b88-4bf3-9fb5-84dfca7b596d admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:22.499481 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b319a-1b88-4bf3-9fb5-84dfca7b596d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:22.502481 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b319a-1b88-4bf3-9fb5-84dfca7b596d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:22.524387 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1382/2748] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:11:22 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:11:22.528777 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb5bf0-ffdb-40d1-83e4-df6bbdb6535f admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:22.538897 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb5bf0-ffdb-40d1-83e4-df6bbdb6535f admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:22.543518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fd939-da35-4819-bb82-c645fdf03b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:22.544102 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fd939-da35-4819-bb82-c645fdf03b28 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:22.544377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fd939-da35-4819-bb82-c645fdf03b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:22.544646 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fd939-da35-4819-bb82-c645fdf03b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:22.545271 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fd939-da35-4819-bb82-c645fdf03b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:22.547388 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fd939-da35-4819-bb82-c645fdf03b28 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:22.556990 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1367/2749] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 01:11:22.560590 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b319a-1b88-4bf3-9fb5-84dfca7b596d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:22.571103 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b319a-1b88-4bf3-9fb5-84dfca7b596d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:22.575612 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96d588-f61b-4ad4-b0c4-83a331df56f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:22.576193 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96d588-f61b-4ad4-b0c4-83a331df56f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:22.576473 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96d588-f61b-4ad4-b0c4-83a331df56f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:22.576746 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96d588-f61b-4ad4-b0c4-83a331df56f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:22.577375 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96d588-f61b-4ad4-b0c4-83a331df56f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:22.579019 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96d588-f61b-4ad4-b0c4-83a331df56f9 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:22.588607 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1383/2750] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:11:22.592677 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fd939-da35-4819-bb82-c645fdf03b28 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:22.602332 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fd939-da35-4819-bb82-c645fdf03b28 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:22.606853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4442e-71ca-4fc7-a00f-b7aab2b85348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:22.607480 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4442e-71ca-4fc7-a00f-b7aab2b85348 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:22.607753 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4442e-71ca-4fc7-a00f-b7aab2b85348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:22.608020 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4442e-71ca-4fc7-a00f-b7aab2b85348 admin admin] PATH_INFO: `/v3/projects/4019e0c424544f379499f94cae041629/users/77120cac9d17469a90cdd38b75c70e8b/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:22.622762 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4442e-71ca-4fc7-a00f-b7aab2b85348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4019e0c424544f379499f94cae041629, user_id=77120cac9d17469a90cdd38b75c70e8b, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:22.626086 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4442e-71ca-4fc7-a00f-b7aab2b85348 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:22.638138 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1368/2751] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:11:22 2022] PUT /identity/v3/projects/4019e0c424544f379499f94cae041629/users/77120cac9d17469a90cdd38b75c70e8b/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:11:22.643322 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec10cd1-ce1a-4420-af93-056ef69b89ba None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:22.643804 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec10cd1-ce1a-4420-af93-056ef69b89ba None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:22.643904 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec10cd1-ce1a-4420-af93-056ef69b89ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:22.663829 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-cec10cd1-ce1a-4420-af93-056ef69b89ba None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:11:22.665030 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-cec10cd1-ce1a-4420-af93-056ef69b89ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:22.723913 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1384/2752] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:11:22.733478 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4442e-71ca-4fc7-a00f-b7aab2b85348 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:22.735822 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3eb4442e-71ca-4fc7-a00f-b7aab2b85348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:22.793990 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4442e-71ca-4fc7-a00f-b7aab2b85348 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:22.798178 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78b565-101c-4e61-9234-5af43a1dfe2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:22.798772 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78b565-101c-4e61-9234-5af43a1dfe2e service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:22.799044 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78b565-101c-4e61-9234-5af43a1dfe2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:22.799310 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78b565-101c-4e61-9234-5af43a1dfe2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:22.808448 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78b565-101c-4e61-9234-5af43a1dfe2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:22.809899 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78b565-101c-4e61-9234-5af43a1dfe2e service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:22.819425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1369/2753] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:11:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 01:11:23.493146 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b75a7-836d-4656-9a2d-ef61d7a65d42 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:23.493438 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b75a7-836d-4656-9a2d-ef61d7a65d42 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:23.493717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b75a7-836d-4656-9a2d-ef61d7a65d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:23.522047 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-dd5b75a7-836d-4656-9a2d-ef61d7a65d42 None None] MFA Rules not processed for user `77120cac9d17469a90cdd38b75c70e8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:11:23.523202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-dd5b75a7-836d-4656-9a2d-ef61d7a65d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:23.542850 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:23.592975 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1385/2754] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:11:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:11:23.598013 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78b565-101c-4e61-9234-5af43a1dfe2e service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:23.602750 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:23.608888 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78b565-101c-4e61-9234-5af43a1dfe2e service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:23.615232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd86e6-0d63-46b5-b352-9fce1747391e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:23.615889 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd86e6-0d63-46b5-b352-9fce1747391e admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:23.616235 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd86e6-0d63-46b5-b352-9fce1747391e admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:23.616564 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd86e6-0d63-46b5-b352-9fce1747391e admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:23.617257 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd86e6-0d63-46b5-b352-9fce1747391e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:23.619262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd86e6-0d63-46b5-b352-9fce1747391e admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:23.646080 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1370/2755] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:11:23 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:11:23.650463 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b75a7-836d-4656-9a2d-ef61d7a65d42 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:23.661698 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b75a7-836d-4656-9a2d-ef61d7a65d42 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:23.717131 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2634946-73fb-48b9-b3fa-801236b6e658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:23.717901 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2634946-73fb-48b9-b3fa-801236b6e658 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:23.718185 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2634946-73fb-48b9-b3fa-801236b6e658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:23.718460 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2634946-73fb-48b9-b3fa-801236b6e658 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:23.719608 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2634946-73fb-48b9-b3fa-801236b6e658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:23.721513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2634946-73fb-48b9-b3fa-801236b6e658 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:23.742642 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1386/2756] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:11:23 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:11:23.746652 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd86e6-0d63-46b5-b352-9fce1747391e admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:23.756670 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd86e6-0d63-46b5-b352-9fce1747391e admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:23.761471 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1473e-8cc0-45ed-a6f1-793bf325fbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:23.762098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1473e-8cc0-45ed-a6f1-793bf325fbaa admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:23.762376 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1473e-8cc0-45ed-a6f1-793bf325fbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:23.762647 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1473e-8cc0-45ed-a6f1-793bf325fbaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:23.763284 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1473e-8cc0-45ed-a6f1-793bf325fbaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:23.764896 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1473e-8cc0-45ed-a6f1-793bf325fbaa admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:23.775642 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1371/2757] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:11:23.779421 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2634946-73fb-48b9-b3fa-801236b6e658 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:23.790176 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2634946-73fb-48b9-b3fa-801236b6e658 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:23.794731 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42770bc-9993-417d-a11f-fcd3f151a3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:23.795378 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42770bc-9993-417d-a11f-fcd3f151a3c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:23.795658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42770bc-9993-417d-a11f-fcd3f151a3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:23.795933 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42770bc-9993-417d-a11f-fcd3f151a3c3 admin admin] PATH_INFO: `/v3/projects/56cf90ac6b1842b392a499c153a4f1a1/users/bd7a0d89d09042ac9104823b4faae49e/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:23.811075 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42770bc-9993-417d-a11f-fcd3f151a3c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56cf90ac6b1842b392a499c153a4f1a1, user_id=bd7a0d89d09042ac9104823b4faae49e, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:23.814600 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42770bc-9993-417d-a11f-fcd3f151a3c3 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:23.827572 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1387/2758] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:11:23 2022] PUT /identity/v3/projects/56cf90ac6b1842b392a499c153a4f1a1/users/bd7a0d89d09042ac9104823b4faae49e/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:11:23.832199 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1473e-8cc0-45ed-a6f1-793bf325fbaa admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:23.842017 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1473e-8cc0-45ed-a6f1-793bf325fbaa admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:23.902594 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed6706-eaf5-4d79-b5d3-399303c4628b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:23.903156 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed6706-eaf5-4d79-b5d3-399303c4628b admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:23.903428 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed6706-eaf5-4d79-b5d3-399303c4628b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:23.903737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed6706-eaf5-4d79-b5d3-399303c4628b admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:23.904319 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed6706-eaf5-4d79-b5d3-399303c4628b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:23.905932 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed6706-eaf5-4d79-b5d3-399303c4628b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:23.916142 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1372/2759] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:11:23.920209 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42770bc-9993-417d-a11f-fcd3f151a3c3 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:23.930819 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42770bc-9993-417d-a11f-fcd3f151a3c3 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:23.935417 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3601644-cc3d-422d-a4c5-96cc24568d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:23.936057 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3601644-cc3d-422d-a4c5-96cc24568d94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:23.936333 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3601644-cc3d-422d-a4c5-96cc24568d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:23.936606 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3601644-cc3d-422d-a4c5-96cc24568d94 admin admin] PATH_INFO: `/v3/projects/56cf90ac6b1842b392a499c153a4f1a1/users/bd7a0d89d09042ac9104823b4faae49e/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:23.939160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3601644-cc3d-422d-a4c5-96cc24568d94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56cf90ac6b1842b392a499c153a4f1a1, user_id=bd7a0d89d09042ac9104823b4faae49e, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:23.941777 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3601644-cc3d-422d-a4c5-96cc24568d94 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:23.951922 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1388/2760] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:11:23 2022] PUT /identity/v3/projects/56cf90ac6b1842b392a499c153a4f1a1/users/bd7a0d89d09042ac9104823b4faae49e/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:11:24.590612 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dc5c6-2ec5-4774-86e3-ada37e2b1546 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:24.590889 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dc5c6-2ec5-4774-86e3-ada37e2b1546 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:24.591152 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dc5c6-2ec5-4774-86e3-ada37e2b1546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:24.620739 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-7c7dc5c6-2ec5-4774-86e3-ada37e2b1546 None None] MFA Rules not processed for user `bd7a0d89d09042ac9104823b4faae49e`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:11:24.622246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7c7dc5c6-2ec5-4774-86e3-ada37e2b1546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:24.693314 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1373/2761] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:11:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:11:24.760124 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e2eb8-36b0-4e0f-a955-d623a541efa6 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:24.760693 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e2eb8-36b0-4e0f-a955-d623a541efa6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:24.760792 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e2eb8-36b0-4e0f-a955-d623a541efa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:24.780226 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-888e2eb8-36b0-4e0f-a955-d623a541efa6 None None] MFA Rules not processed for user `77120cac9d17469a90cdd38b75c70e8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:11:24.781444 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-888e2eb8-36b0-4e0f-a955-d623a541efa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:24.834786 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1389/2762] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:11:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:11:24.845648 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7dc5c6-2ec5-4774-86e3-ada37e2b1546 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:24.847078 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7c7dc5c6-2ec5-4774-86e3-ada37e2b1546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:24.899143 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:24.922789 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7dc5c6-2ec5-4774-86e3-ada37e2b1546 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:24.928130 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137f56b-7bba-435a-a3b4-da345595d9e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:24.928722 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137f56b-7bba-435a-a3b4-da345595d9e7 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:24.928996 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137f56b-7bba-435a-a3b4-da345595d9e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:24.929263 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137f56b-7bba-435a-a3b4-da345595d9e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:24.936737 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137f56b-7bba-435a-a3b4-da345595d9e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:24.938934 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137f56b-7bba-435a-a3b4-da345595d9e7 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:24.947371 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1374/2763] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:11:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:11:25.649401 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e2eb8-36b0-4e0f-a955-d623a541efa6 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:25.668144 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:25.708754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e2eb8-36b0-4e0f-a955-d623a541efa6 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:25.712631 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce268a86-8b84-4143-8dd7-1f30a9eff670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:25.713302 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce268a86-8b84-4143-8dd7-1f30a9eff670 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:25.713584 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce268a86-8b84-4143-8dd7-1f30a9eff670 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:25.713872 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce268a86-8b84-4143-8dd7-1f30a9eff670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:25.715596 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ce268a86-8b84-4143-8dd7-1f30a9eff670 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:25.778389 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce268a86-8b84-4143-8dd7-1f30a9eff670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:25.779900 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce268a86-8b84-4143-8dd7-1f30a9eff670 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:25.789733 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1390/2764] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:11:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:11:32.330390 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137f56b-7bba-435a-a3b4-da345595d9e7 service nova] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:32.340023 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137f56b-7bba-435a-a3b4-da345595d9e7 service nova] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:32.344227 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf75bdf-d737-4264-aa17-96f25c06a257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:32.344816 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf75bdf-d737-4264-aa17-96f25c06a257 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:32.345088 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf75bdf-d737-4264-aa17-96f25c06a257 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:32.345352 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf75bdf-d737-4264-aa17-96f25c06a257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:32.347119 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5bf75bdf-d737-4264-aa17-96f25c06a257 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:32.410230 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf75bdf-d737-4264-aa17-96f25c06a257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:32.411570 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf75bdf-d737-4264-aa17-96f25c06a257 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:32.422042 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1375/2765] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:11:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:11:34.614512 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce268a86-8b84-4143-8dd7-1f30a9eff670 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:34.619370 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ce268a86-8b84-4143-8dd7-1f30a9eff670 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:34.638841 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce268a86-8b84-4143-8dd7-1f30a9eff670 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:34.651769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abd08d-2256-46ba-a207-94067a958d78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:34.653032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abd08d-2256-46ba-a207-94067a958d78 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:34.653729 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abd08d-2256-46ba-a207-94067a958d78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:34.654290 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abd08d-2256-46ba-a207-94067a958d78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:34.656977 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f3abd08d-2256-46ba-a207-94067a958d78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:34.724768 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3abd08d-2256-46ba-a207-94067a958d78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:34.726255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3abd08d-2256-46ba-a207-94067a958d78 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:34.740183 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1391/2766] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:11:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:11:36.342007 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf75bdf-d737-4264-aa17-96f25c06a257 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:36.344631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5bf75bdf-d737-4264-aa17-96f25c06a257 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:36.437229 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf75bdf-d737-4264-aa17-96f25c06a257 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:36.442320 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab855e-1e99-4e12-9dc6-840affcfa249 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abf9ab5fafe94afdb3ebe98536b5cc3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:36.442918 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab855e-1e99-4e12-9dc6-840affcfa249 service placement] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:36.443194 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab855e-1e99-4e12-9dc6-840affcfa249 service placement] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:36.443464 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab855e-1e99-4e12-9dc6-840affcfa249 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:36.445206 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-cdab855e-1e99-4e12-9dc6-840affcfa249 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:36.456748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab855e-1e99-4e12-9dc6-840affcfa249 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:36.458351 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab855e-1e99-4e12-9dc6-840affcfa249 service placement] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:36.469129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1376/2767] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:11:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:11:39.274593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abd08d-2256-46ba-a207-94067a958d78 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:39.276273 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f3abd08d-2256-46ba-a207-94067a958d78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:39.408917 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abd08d-2256-46ba-a207-94067a958d78 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:39.427442 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061481f-cb87-4fa1-bf54-f71e157ef1ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:39.428075 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061481f-cb87-4fa1-bf54-f71e157ef1ee service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:39.428353 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061481f-cb87-4fa1-bf54-f71e157ef1ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:39.428622 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061481f-cb87-4fa1-bf54-f71e157ef1ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:39.447056 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061481f-cb87-4fa1-bf54-f71e157ef1ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:39.448517 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061481f-cb87-4fa1-bf54-f71e157ef1ee service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:39.466322 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1392/2768] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:11:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:11:40.779894 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab855e-1e99-4e12-9dc6-840affcfa249 service placement] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:40.782023 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-cdab855e-1e99-4e12-9dc6-840affcfa249 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:40.796854 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab855e-1e99-4e12-9dc6-840affcfa249 service placement] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:40.801334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3e694-781a-4e04-b840-ad8c8ecb0490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:40.802076 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3e694-781a-4e04-b840-ad8c8ecb0490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:40.802414 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3e694-781a-4e04-b840-ad8c8ecb0490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:40.802747 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3e694-781a-4e04-b840-ad8c8ecb0490 admin admin] PATH_INFO: `/v3/users/873f4c5451bf4734bad957df7ecfee23` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:40.804040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3e694-781a-4e04-b840-ad8c8ecb0490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=873f4c5451bf4734bad957df7ecfee23)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:40.806085 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3e694-781a-4e04-b840-ad8c8ecb0490 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:40.851068 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d2c3e694-781a-4e04-b840-ad8c8ecb0490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '873f4c5451bf4734bad957df7ecfee23'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:40.851705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d2c3e694-781a-4e04-b840-ad8c8ecb0490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '873f4c5451bf4734bad957df7ecfee23'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:40.857301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:40.859994 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d2c3e694-781a-4e04-b840-ad8c8ecb0490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '873f4c5451bf4734bad957df7ecfee23'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:40.875557 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d2c3e694-781a-4e04-b840-ad8c8ecb0490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '873f4c5451bf4734bad957df7ecfee23'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:40.876156 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d2c3e694-781a-4e04-b840-ad8c8ecb0490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '873f4c5451bf4734bad957df7ecfee23'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:40.889141 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1377/2769] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:11:40 2022] DELETE /identity/v3/users/873f4c5451bf4734bad957df7ecfee23 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:11:41.068389 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061481f-cb87-4fa1-bf54-f71e157ef1ee service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:41.080646 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061481f-cb87-4fa1-bf54-f71e157ef1ee service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:41.084780 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:41.137886 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be187f-1576-400f-bd7b-9f354a05b16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:41.138408 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be187f-1576-400f-bd7b-9f354a05b16a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:41.138682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be187f-1576-400f-bd7b-9f354a05b16a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:41.138951 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be187f-1576-400f-bd7b-9f354a05b16a admin admin] PATH_INFO: `/v3/projects/117105d5e9fb4309aad25e39e0f5e4df` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:41.140604 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be187f-1576-400f-bd7b-9f354a05b16a admin admin] RBAC: Authorizing `identity:delete_project(project_id=117105d5e9fb4309aad25e39e0f5e4df)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:41.142534 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be187f-1576-400f-bd7b-9f354a05b16a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:41.189506 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-56be187f-1576-400f-bd7b-9f354a05b16a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '117105d5e9fb4309aad25e39e0f5e4df', 'request_id': 'req-56be187f-1576-400f-bd7b-9f354a05b16a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:41.196747 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-56be187f-1576-400f-bd7b-9f354a05b16a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '117105d5e9fb4309aad25e39e0f5e4df', 'request_id': 'req-56be187f-1576-400f-bd7b-9f354a05b16a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:41.203332 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-56be187f-1576-400f-bd7b-9f354a05b16a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '117105d5e9fb4309aad25e39e0f5e4df', 'request_id': 'req-56be187f-1576-400f-bd7b-9f354a05b16a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:41.213590 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-56be187f-1576-400f-bd7b-9f354a05b16a admin admin] The token cache is being invalidate because project 117105d5e9fb4309aad25e39e0f5e4df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:11:41.213912 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-56be187f-1576-400f-bd7b-9f354a05b16a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:41.214542 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-56be187f-1576-400f-bd7b-9f354a05b16a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:41.216028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1393/2770] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:11:41 2022] DELETE /identity/v3/projects/117105d5e9fb4309aad25e39e0f5e4df => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:11:41.220899 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3e694-781a-4e04-b840-ad8c8ecb0490 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:41.222308 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d2c3e694-781a-4e04-b840-ad8c8ecb0490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:41.235226 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3e694-781a-4e04-b840-ad8c8ecb0490 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:41.289999 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea7281-5a9a-436b-972c-631ed7fbd370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:41.290606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea7281-5a9a-436b-972c-631ed7fbd370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:41.290883 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea7281-5a9a-436b-972c-631ed7fbd370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:41.291145 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea7281-5a9a-436b-972c-631ed7fbd370 admin admin] PATH_INFO: `/v3/users/ccde5cd6590242379fa8c1b4c0dd1c97` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:41.292263 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea7281-5a9a-436b-972c-631ed7fbd370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccde5cd6590242379fa8c1b4c0dd1c97)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:41.294211 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea7281-5a9a-436b-972c-631ed7fbd370 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:41.339063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-1aea7281-5a9a-436b-972c-631ed7fbd370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccde5cd6590242379fa8c1b4c0dd1c97'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:41.339693 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-1aea7281-5a9a-436b-972c-631ed7fbd370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccde5cd6590242379fa8c1b4c0dd1c97'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:41.347113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-1aea7281-5a9a-436b-972c-631ed7fbd370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccde5cd6590242379fa8c1b4c0dd1c97'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:41.358618 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-1aea7281-5a9a-436b-972c-631ed7fbd370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccde5cd6590242379fa8c1b4c0dd1c97'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:41.359250 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-1aea7281-5a9a-436b-972c-631ed7fbd370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccde5cd6590242379fa8c1b4c0dd1c97'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:41.372420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1378/2771] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:11:41 2022] DELETE /identity/v3/users/ccde5cd6590242379fa8c1b4c0dd1c97 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:11:41.544925 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be187f-1576-400f-bd7b-9f354a05b16a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:41.546425 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-56be187f-1576-400f-bd7b-9f354a05b16a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:41.559327 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be187f-1576-400f-bd7b-9f354a05b16a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:41.619522 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a296067-aedf-4b19-9e3a-296184c209d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:41.620135 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a296067-aedf-4b19-9e3a-296184c209d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:41.620413 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a296067-aedf-4b19-9e3a-296184c209d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:41.620681 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a296067-aedf-4b19-9e3a-296184c209d0 admin admin] PATH_INFO: `/v3/projects/69ee2a12addb488a8c3e78c50e25d4c4` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:41.621859 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a296067-aedf-4b19-9e3a-296184c209d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69ee2a12addb488a8c3e78c50e25d4c4)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:41.623768 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a296067-aedf-4b19-9e3a-296184c209d0 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:41.665197 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:41.673888 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1a296067-aedf-4b19-9e3a-296184c209d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69ee2a12addb488a8c3e78c50e25d4c4', 'request_id': 'req-1a296067-aedf-4b19-9e3a-296184c209d0'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:41.682135 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1a296067-aedf-4b19-9e3a-296184c209d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69ee2a12addb488a8c3e78c50e25d4c4', 'request_id': 'req-1a296067-aedf-4b19-9e3a-296184c209d0'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:41.688838 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1a296067-aedf-4b19-9e3a-296184c209d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69ee2a12addb488a8c3e78c50e25d4c4', 'request_id': 'req-1a296067-aedf-4b19-9e3a-296184c209d0'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:41.700338 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1a296067-aedf-4b19-9e3a-296184c209d0 admin admin] The token cache is being invalidate because project 69ee2a12addb488a8c3e78c50e25d4c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:11:41.700633 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1a296067-aedf-4b19-9e3a-296184c209d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:41.701629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1a296067-aedf-4b19-9e3a-296184c209d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:41.703126 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1394/2772] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:11:41 2022] DELETE /identity/v3/projects/69ee2a12addb488a8c3e78c50e25d4c4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:11:51.369145 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=62,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:51.697013 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=10,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:59.464858 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea7281-5a9a-436b-972c-631ed7fbd370 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:59.466497 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1aea7281-5a9a-436b-972c-631ed7fbd370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:59.479211 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea7281-5a9a-436b-972c-631ed7fbd370 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:59.533914 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b43d3c-6a7a-4af8-b6a3-8641d65fc424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:59.534524 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b43d3c-6a7a-4af8-b6a3-8641d65fc424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:59.535755 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b43d3c-6a7a-4af8-b6a3-8641d65fc424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:59.535755 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b43d3c-6a7a-4af8-b6a3-8641d65fc424 admin admin] PATH_INFO: `/v3/users/77120cac9d17469a90cdd38b75c70e8b` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:59.536147 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b43d3c-6a7a-4af8-b6a3-8641d65fc424 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77120cac9d17469a90cdd38b75c70e8b)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:59.538114 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b43d3c-6a7a-4af8-b6a3-8641d65fc424 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:59.582876 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-49b43d3c-6a7a-4af8-b6a3-8641d65fc424 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77120cac9d17469a90cdd38b75c70e8b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:59.583511 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-49b43d3c-6a7a-4af8-b6a3-8641d65fc424 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77120cac9d17469a90cdd38b75c70e8b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:59.590357 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-49b43d3c-6a7a-4af8-b6a3-8641d65fc424 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77120cac9d17469a90cdd38b75c70e8b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:59.601895 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-49b43d3c-6a7a-4af8-b6a3-8641d65fc424 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77120cac9d17469a90cdd38b75c70e8b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:59.602541 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-49b43d3c-6a7a-4af8-b6a3-8641d65fc424 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77120cac9d17469a90cdd38b75c70e8b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:59.617063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1379/2773] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:11:59 2022] DELETE /identity/v3/users/77120cac9d17469a90cdd38b75c70e8b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:11:59.818333 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a296067-aedf-4b19-9e3a-296184c209d0 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:59.819738 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1a296067-aedf-4b19-9e3a-296184c209d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:59.831882 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a296067-aedf-4b19-9e3a-296184c209d0 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:11:59.893962 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1ed6b-812a-459e-8724-e4206a43358d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:11:59.894594 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1ed6b-812a-459e-8724-e4206a43358d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:11:59.894868 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1ed6b-812a-459e-8724-e4206a43358d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:11:59.895136 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1ed6b-812a-459e-8724-e4206a43358d admin admin] PATH_INFO: `/v3/projects/4019e0c424544f379499f94cae041629` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:11:59.896304 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1ed6b-812a-459e-8724-e4206a43358d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4019e0c424544f379499f94cae041629)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:11:59.898228 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1ed6b-812a-459e-8724-e4206a43358d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:11:59.945050 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-19e1ed6b-812a-459e-8724-e4206a43358d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4019e0c424544f379499f94cae041629', 'request_id': 'req-19e1ed6b-812a-459e-8724-e4206a43358d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:59.952313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-19e1ed6b-812a-459e-8724-e4206a43358d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4019e0c424544f379499f94cae041629', 'request_id': 'req-19e1ed6b-812a-459e-8724-e4206a43358d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:59.958986 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-19e1ed6b-812a-459e-8724-e4206a43358d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4019e0c424544f379499f94cae041629', 'request_id': 'req-19e1ed6b-812a-459e-8724-e4206a43358d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:59.969383 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-19e1ed6b-812a-459e-8724-e4206a43358d admin admin] The token cache is being invalidate because project 4019e0c424544f379499f94cae041629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:11:59.969675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-19e1ed6b-812a-459e-8724-e4206a43358d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:59.970312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-19e1ed6b-812a-459e-8724-e4206a43358d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:11:59.971807 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1395/2774] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:11:59 2022] DELETE /identity/v3/projects/4019e0c424544f379499f94cae041629 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:11:59.975815 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b43d3c-6a7a-4af8-b6a3-8641d65fc424 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:11:59.977245 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-49b43d3c-6a7a-4af8-b6a3-8641d65fc424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:11:59.990468 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b43d3c-6a7a-4af8-b6a3-8641d65fc424 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:12:00.044965 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a7e7d-519d-48b2-9bfe-57130f0d01ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:12:00.045575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a7e7d-519d-48b2-9bfe-57130f0d01ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:00.045875 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a7e7d-519d-48b2-9bfe-57130f0d01ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:00.046145 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a7e7d-519d-48b2-9bfe-57130f0d01ae admin admin] PATH_INFO: `/v3/users/bd7a0d89d09042ac9104823b4faae49e` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:00.047752 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a7e7d-519d-48b2-9bfe-57130f0d01ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd7a0d89d09042ac9104823b4faae49e)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:12:00.049660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a7e7d-519d-48b2-9bfe-57130f0d01ae admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:12:00.072186 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:12:00.096830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-2c7a7e7d-519d-48b2-9bfe-57130f0d01ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd7a0d89d09042ac9104823b4faae49e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:00.097462 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-2c7a7e7d-519d-48b2-9bfe-57130f0d01ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd7a0d89d09042ac9104823b4faae49e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:00.104165 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-2c7a7e7d-519d-48b2-9bfe-57130f0d01ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd7a0d89d09042ac9104823b4faae49e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:00.115971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-2c7a7e7d-519d-48b2-9bfe-57130f0d01ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd7a0d89d09042ac9104823b4faae49e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:00.116588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-2c7a7e7d-519d-48b2-9bfe-57130f0d01ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd7a0d89d09042ac9104823b4faae49e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:00.130026 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1380/2775] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:11:59 2022] DELETE /identity/v3/users/bd7a0d89d09042ac9104823b4faae49e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:12:00.298714 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1ed6b-812a-459e-8724-e4206a43358d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:12:00.300311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-19e1ed6b-812a-459e-8724-e4206a43358d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:12:00.314124 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1ed6b-812a-459e-8724-e4206a43358d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:12:00.372034 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71acc5-4b54-4e76-bf65-c42102275c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:12:00.372690 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71acc5-4b54-4e76-bf65-c42102275c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:00.372968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71acc5-4b54-4e76-bf65-c42102275c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:00.373241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71acc5-4b54-4e76-bf65-c42102275c87 admin admin] PATH_INFO: `/v3/projects/56cf90ac6b1842b392a499c153a4f1a1` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:00.374384 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71acc5-4b54-4e76-bf65-c42102275c87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56cf90ac6b1842b392a499c153a4f1a1)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:12:00.376815 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71acc5-4b54-4e76-bf65-c42102275c87 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:12:00.410412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:12:00.423730 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5e71acc5-4b54-4e76-bf65-c42102275c87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56cf90ac6b1842b392a499c153a4f1a1', 'request_id': 'req-5e71acc5-4b54-4e76-bf65-c42102275c87'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:00.432586 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5e71acc5-4b54-4e76-bf65-c42102275c87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56cf90ac6b1842b392a499c153a4f1a1', 'request_id': 'req-5e71acc5-4b54-4e76-bf65-c42102275c87'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:00.439620 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5e71acc5-4b54-4e76-bf65-c42102275c87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56cf90ac6b1842b392a499c153a4f1a1', 'request_id': 'req-5e71acc5-4b54-4e76-bf65-c42102275c87'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:00.450770 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5e71acc5-4b54-4e76-bf65-c42102275c87 admin admin] The token cache is being invalidate because project 56cf90ac6b1842b392a499c153a4f1a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:12:00.451212 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5e71acc5-4b54-4e76-bf65-c42102275c87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:00.452132 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5e71acc5-4b54-4e76-bf65-c42102275c87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:00.454814 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1396/2776] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:12:00 2022] DELETE /identity/v3/projects/56cf90ac6b1842b392a499c153a4f1a1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:12:00.461055 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f20645-7b1f-4680-bbab-caf8970ea7d4 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:00.461334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f20645-7b1f-4680-bbab-caf8970ea7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:00.461656 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f20645-7b1f-4680-bbab-caf8970ea7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:00.481041 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-e8f20645-7b1f-4680-bbab-caf8970ea7d4 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:12:00.482228 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e8f20645-7b1f-4680-bbab-caf8970ea7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:12:00.540251 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1381/2777] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:12:00.548513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee198a7d-2d46-42b7-9ad4-bdb1aadf25f1 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:00.548796 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee198a7d-2d46-42b7-9ad4-bdb1aadf25f1 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:00.549069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee198a7d-2d46-42b7-9ad4-bdb1aadf25f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:00.568981 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ee198a7d-2d46-42b7-9ad4-bdb1aadf25f1 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:12:00.570211 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ee198a7d-2d46-42b7-9ad4-bdb1aadf25f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:12:00.578043 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1397/2778] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:12:00.583453 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f20645-7b1f-4680-bbab-caf8970ea7d4 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:12:00.592959 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f20645-7b1f-4680-bbab-caf8970ea7d4 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:12:00.597446 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211612c-640b-45f7-9bd5-e2f4104289be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:12:00.598056 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211612c-640b-45f7-9bd5-e2f4104289be admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:00.598328 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211612c-640b-45f7-9bd5-e2f4104289be admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:00.598592 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211612c-640b-45f7-9bd5-e2f4104289be admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:00.599216 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211612c-640b-45f7-9bd5-e2f4104289be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:12:00.599510 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211612c-640b-45f7-9bd5-e2f4104289be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:12:00.601076 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211612c-640b-45f7-9bd5-e2f4104289be admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:12:00.612802 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1382/2779] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:12:00.617005 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee198a7d-2d46-42b7-9ad4-bdb1aadf25f1 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:12:00.626964 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee198a7d-2d46-42b7-9ad4-bdb1aadf25f1 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:12:00.631599 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5dac7b-63bf-46ae-a9bb-d74bb5a809fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:12:00.632194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dac7b-63bf-46ae-a9bb-d74bb5a809fe admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:00.632471 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dac7b-63bf-46ae-a9bb-d74bb5a809fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:00.632741 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dac7b-63bf-46ae-a9bb-d74bb5a809fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:00.633374 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5dac7b-63bf-46ae-a9bb-d74bb5a809fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:12:00.635290 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5dac7b-63bf-46ae-a9bb-d74bb5a809fe admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:12:00.661908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1398/2780] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:12:00 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:12:00.666165 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211612c-640b-45f7-9bd5-e2f4104289be admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:12:00.676421 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211612c-640b-45f7-9bd5-e2f4104289be admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:12:00.732830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08950173-544d-413a-8e64-d493c7a8eb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:12:00.733345 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08950173-544d-413a-8e64-d493c7a8eb14 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:00.733625 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08950173-544d-413a-8e64-d493c7a8eb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:00.733941 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08950173-544d-413a-8e64-d493c7a8eb14 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:00.735082 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08950173-544d-413a-8e64-d493c7a8eb14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:12:00.736978 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08950173-544d-413a-8e64-d493c7a8eb14 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:12:00.758850 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1383/2781] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:12:00 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:12:00.762779 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5dac7b-63bf-46ae-a9bb-d74bb5a809fe admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:12:00.774027 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5dac7b-63bf-46ae-a9bb-d74bb5a809fe admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:12:00.778908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d2047-e5ae-49e6-bc9a-5a8316567155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:12:00.779534 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d2047-e5ae-49e6-bc9a-5a8316567155 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:00.779813 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d2047-e5ae-49e6-bc9a-5a8316567155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:00.780086 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d2047-e5ae-49e6-bc9a-5a8316567155 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:00.780717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d2047-e5ae-49e6-bc9a-5a8316567155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:12:00.782589 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d2047-e5ae-49e6-bc9a-5a8316567155 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:12:00.792409 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1399/2782] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:12:00.796179 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08950173-544d-413a-8e64-d493c7a8eb14 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:12:00.806879 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08950173-544d-413a-8e64-d493c7a8eb14 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:12:00.811445 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e106b74-62cf-4174-8ca3-dfb8a5aa07a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:12:00.812024 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e106b74-62cf-4174-8ca3-dfb8a5aa07a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:00.812902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e106b74-62cf-4174-8ca3-dfb8a5aa07a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:00.813176 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e106b74-62cf-4174-8ca3-dfb8a5aa07a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:00.813936 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e106b74-62cf-4174-8ca3-dfb8a5aa07a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:12:00.815510 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e106b74-62cf-4174-8ca3-dfb8a5aa07a1 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:12:00.825741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1384/2783] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:12:00.829615 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d2047-e5ae-49e6-bc9a-5a8316567155 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:12:00.839405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d2047-e5ae-49e6-bc9a-5a8316567155 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:12:00.843965 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce373a-2d21-4506-8465-7e06665c9d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:12:00.844599 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce373a-2d21-4506-8465-7e06665c9d9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:00.844893 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce373a-2d21-4506-8465-7e06665c9d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:00.845146 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce373a-2d21-4506-8465-7e06665c9d9f admin admin] PATH_INFO: `/v3/projects/59b4f6c557734efba202181f956c20b1/users/d0ec1c50ea184141880ab1aa400a8ba8/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:00.859709 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce373a-2d21-4506-8465-7e06665c9d9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b4f6c557734efba202181f956c20b1, user_id=d0ec1c50ea184141880ab1aa400a8ba8, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:12:00.862381 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce373a-2d21-4506-8465-7e06665c9d9f admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:12:00.875858 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1400/2784] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:12:00 2022] PUT /identity/v3/projects/59b4f6c557734efba202181f956c20b1/users/d0ec1c50ea184141880ab1aa400a8ba8/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:12:00.885794 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc11da-a647-461f-918d-b85a6ea96764 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:00.886124 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc11da-a647-461f-918d-b85a6ea96764 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:00.886415 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc11da-a647-461f-918d-b85a6ea96764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:00.894916 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:12:00.918641 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-27fc11da-a647-461f-918d-b85a6ea96764 None None] MFA Rules not processed for user `d0ec1c50ea184141880ab1aa400a8ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:12:00.919835 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-27fc11da-a647-461f-918d-b85a6ea96764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:12:00.989860 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1385/2785] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:12:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:12:01.003407 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce373a-2d21-4506-8465-7e06665c9d9f admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:12:01.005104 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0dce373a-2d21-4506-8465-7e06665c9d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:12:01.066790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce373a-2d21-4506-8465-7e06665c9d9f admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:12:01.070611 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a2d88-c4b3-4a74-ba28-737bdabc89ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee54ed3a092e4eef9082c4e86bd918a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:12:01.071234 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a2d88-c4b3-4a74-ba28-737bdabc89ae service glance] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:01.071509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a2d88-c4b3-4a74-ba28-737bdabc89ae service glance] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:01.072018 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a2d88-c4b3-4a74-ba28-737bdabc89ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:01.081936 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a2d88-c4b3-4a74-ba28-737bdabc89ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:12:01.083481 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a2d88-c4b3-4a74-ba28-737bdabc89ae service glance] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:12:01.093459 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1401/2786] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:12:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 01:12:10.986192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=30 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:12:11.088714 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=65,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:12:22.915048 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc11da-a647-461f-918d-b85a6ea96764 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:12:22.977386 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc11da-a647-461f-918d-b85a6ea96764 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:12:22.981858 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909cb12-8a0b-41b2-b169-c8b686f59c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:12:22.982475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909cb12-8a0b-41b2-b169-c8b686f59c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:22.982748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909cb12-8a0b-41b2-b169-c8b686f59c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:22.983012 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909cb12-8a0b-41b2-b169-c8b686f59c28 admin admin] PATH_INFO: `/v3/users/d0ec1c50ea184141880ab1aa400a8ba8` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:22.984124 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909cb12-8a0b-41b2-b169-c8b686f59c28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0ec1c50ea184141880ab1aa400a8ba8)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:12:22.986619 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909cb12-8a0b-41b2-b169-c8b686f59c28 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:12:23.031511 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4909cb12-8a0b-41b2-b169-c8b686f59c28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0ec1c50ea184141880ab1aa400a8ba8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:23.032149 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4909cb12-8a0b-41b2-b169-c8b686f59c28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0ec1c50ea184141880ab1aa400a8ba8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:23.039488 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4909cb12-8a0b-41b2-b169-c8b686f59c28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0ec1c50ea184141880ab1aa400a8ba8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:23.051018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4909cb12-8a0b-41b2-b169-c8b686f59c28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0ec1c50ea184141880ab1aa400a8ba8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:23.051634 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4909cb12-8a0b-41b2-b169-c8b686f59c28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0ec1c50ea184141880ab1aa400a8ba8'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:23.063998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1386/2787] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:12:22 2022] DELETE /identity/v3/users/d0ec1c50ea184141880ab1aa400a8ba8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:12:23.068593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705a279-41fd-4249-a9b5-419b68c09c26 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:23.069063 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705a279-41fd-4249-a9b5-419b68c09c26 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:23.069172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705a279-41fd-4249-a9b5-419b68c09c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:23.088273 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-8705a279-41fd-4249-a9b5-419b68c09c26 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:12:23.089460 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8705a279-41fd-4249-a9b5-419b68c09c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:12:23.147177 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1402/2788] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:12:23.157018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909cb12-8a0b-41b2-b169-c8b686f59c28 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:12:23.159130 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4909cb12-8a0b-41b2-b169-c8b686f59c28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:12:23.214501 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909cb12-8a0b-41b2-b169-c8b686f59c28 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:12:23.218162 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b447ed-a54b-4133-a56b-0b19a67c58ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:12:23.218748 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b447ed-a54b-4133-a56b-0b19a67c58ca service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:23.219021 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b447ed-a54b-4133-a56b-0b19a67c58ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:23.219307 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b447ed-a54b-4133-a56b-0b19a67c58ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:23.228633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b447ed-a54b-4133-a56b-0b19a67c58ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:12:23.230066 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b447ed-a54b-4133-a56b-0b19a67c58ca service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:12:23.239371 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1387/2789] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:12:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:12:23.497397 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705a279-41fd-4249-a9b5-419b68c09c26 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:12:23.498875 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8705a279-41fd-4249-a9b5-419b68c09c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:12:23.510966 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705a279-41fd-4249-a9b5-419b68c09c26 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:12:23.516620 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8542e5f-c42f-4d38-9f5d-a662803d6dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:12:23.517274 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8542e5f-c42f-4d38-9f5d-a662803d6dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:23.517605 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8542e5f-c42f-4d38-9f5d-a662803d6dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:23.517817 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8542e5f-c42f-4d38-9f5d-a662803d6dd4 admin admin] PATH_INFO: `/v3/projects/59b4f6c557734efba202181f956c20b1` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:23.519040 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8542e5f-c42f-4d38-9f5d-a662803d6dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59b4f6c557734efba202181f956c20b1)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:12:23.521764 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8542e5f-c42f-4d38-9f5d-a662803d6dd4 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:12:23.569949 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b8542e5f-c42f-4d38-9f5d-a662803d6dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59b4f6c557734efba202181f956c20b1', 'request_id': 'req-b8542e5f-c42f-4d38-9f5d-a662803d6dd4'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:23.576732 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b8542e5f-c42f-4d38-9f5d-a662803d6dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59b4f6c557734efba202181f956c20b1', 'request_id': 'req-b8542e5f-c42f-4d38-9f5d-a662803d6dd4'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:23.583215 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b8542e5f-c42f-4d38-9f5d-a662803d6dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59b4f6c557734efba202181f956c20b1', 'request_id': 'req-b8542e5f-c42f-4d38-9f5d-a662803d6dd4'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:23.593426 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b8542e5f-c42f-4d38-9f5d-a662803d6dd4 admin admin] The token cache is being invalidate because project 59b4f6c557734efba202181f956c20b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:12:23.593706 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b8542e5f-c42f-4d38-9f5d-a662803d6dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:23.594350 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b8542e5f-c42f-4d38-9f5d-a662803d6dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:23.596310 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1403/2790] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:12:23 2022] DELETE /identity/v3/projects/59b4f6c557734efba202181f956c20b1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:12:23.601206 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa3924-82de-4b59-81b9-80a1324b4c23 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:23.601485 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa3924-82de-4b59-81b9-80a1324b4c23 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:23.601754 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa3924-82de-4b59-81b9-80a1324b4c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:23.621368 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-63aa3924-82de-4b59-81b9-80a1324b4c23 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:12:23.622573 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-63aa3924-82de-4b59-81b9-80a1324b4c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:12:23.639029 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:12:23.682862 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1388/2791] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:12:23.690543 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505976b-ba72-4bef-bcd4-66a954d131f0 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:23.690822 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505976b-ba72-4bef-bcd4-66a954d131f0 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:23.691149 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505976b-ba72-4bef-bcd4-66a954d131f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:23.710791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-4505976b-ba72-4bef-bcd4-66a954d131f0 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:12:23.712000 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4505976b-ba72-4bef-bcd4-66a954d131f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:12:23.720491 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1404/2792] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:12:23.724689 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa3924-82de-4b59-81b9-80a1324b4c23 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:12:23.734806 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa3924-82de-4b59-81b9-80a1324b4c23 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:12:23.739943 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60872f1-b850-41fd-92c3-825b9bc7984a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:12:23.740532 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60872f1-b850-41fd-92c3-825b9bc7984a admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:23.740811 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60872f1-b850-41fd-92c3-825b9bc7984a admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:23.741082 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60872f1-b850-41fd-92c3-825b9bc7984a admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:23.741772 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60872f1-b850-41fd-92c3-825b9bc7984a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:12:23.742100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60872f1-b850-41fd-92c3-825b9bc7984a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:12:23.743676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60872f1-b850-41fd-92c3-825b9bc7984a admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:12:23.754851 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1389/2793] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:12:23.759006 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505976b-ba72-4bef-bcd4-66a954d131f0 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:12:23.768539 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505976b-ba72-4bef-bcd4-66a954d131f0 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:12:23.773049 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b555463-5043-4477-ab49-2a5d16998cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:12:23.773627 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b555463-5043-4477-ab49-2a5d16998cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:23.773932 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b555463-5043-4477-ab49-2a5d16998cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:23.774198 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b555463-5043-4477-ab49-2a5d16998cd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:23.774834 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b555463-5043-4477-ab49-2a5d16998cd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:12:23.776948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b555463-5043-4477-ab49-2a5d16998cd2 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:12:23.803946 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1405/2794] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:12:23 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:12:23.808012 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60872f1-b850-41fd-92c3-825b9bc7984a admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:12:23.817829 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60872f1-b850-41fd-92c3-825b9bc7984a admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:12:23.875264 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0dc90-85e5-4c6a-9f08-3caff5dfe1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:12:23.875853 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0dc90-85e5-4c6a-9f08-3caff5dfe1ff admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:23.876158 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0dc90-85e5-4c6a-9f08-3caff5dfe1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:23.876430 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0dc90-85e5-4c6a-9f08-3caff5dfe1ff admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:23.877063 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0dc90-85e5-4c6a-9f08-3caff5dfe1ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:12:23.878986 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0dc90-85e5-4c6a-9f08-3caff5dfe1ff admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:12:23.900594 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1390/2795] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:12:23 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:12:23.904747 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b555463-5043-4477-ab49-2a5d16998cd2 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:12:23.915483 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b555463-5043-4477-ab49-2a5d16998cd2 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:12:23.920017 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff834a-2abc-43a3-8202-0c188d0ec801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:12:23.920601 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff834a-2abc-43a3-8202-0c188d0ec801 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:23.920875 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff834a-2abc-43a3-8202-0c188d0ec801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:23.921143 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff834a-2abc-43a3-8202-0c188d0ec801 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:23.921794 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff834a-2abc-43a3-8202-0c188d0ec801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:12:23.923415 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff834a-2abc-43a3-8202-0c188d0ec801 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:12:23.933162 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1406/2796] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:12:23.936696 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0dc90-85e5-4c6a-9f08-3caff5dfe1ff admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:12:23.946425 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0dc90-85e5-4c6a-9f08-3caff5dfe1ff admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:12:23.951093 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e030d-c00b-4a17-bb4f-8e11cd0049e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:12:23.951673 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e030d-c00b-4a17-bb4f-8e11cd0049e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:23.951947 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e030d-c00b-4a17-bb4f-8e11cd0049e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:23.952212 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e030d-c00b-4a17-bb4f-8e11cd0049e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:23.952840 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e030d-c00b-4a17-bb4f-8e11cd0049e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:12:23.955060 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e030d-c00b-4a17-bb4f-8e11cd0049e2 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:12:23.965307 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1391/2797] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:12:23.969260 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff834a-2abc-43a3-8202-0c188d0ec801 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:12:23.980200 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff834a-2abc-43a3-8202-0c188d0ec801 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:12:23.985015 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a85032-b125-4c88-bb12-40138973735a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:12:23.985748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a85032-b125-4c88-bb12-40138973735a admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:23.986100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a85032-b125-4c88-bb12-40138973735a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:23.986410 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a85032-b125-4c88-bb12-40138973735a admin admin] PATH_INFO: `/v3/projects/78bef17f0fe946629706a3ea531201d4/users/f425dbfb8ca141a09aad06f64c8933f0/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:24.001734 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a85032-b125-4c88-bb12-40138973735a admin admin] RBAC: Authorizing `identity:create_grant(project_id=78bef17f0fe946629706a3ea531201d4, user_id=f425dbfb8ca141a09aad06f64c8933f0, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:12:24.004446 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a85032-b125-4c88-bb12-40138973735a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:12:24.017500 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1407/2798] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:12:23 2022] PUT /identity/v3/projects/78bef17f0fe946629706a3ea531201d4/users/f425dbfb8ca141a09aad06f64c8933f0/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:12:24.029422 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcd3af-c837-4d66-9020-3333127866bc None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:24.029703 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcd3af-c837-4d66-9020-3333127866bc None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:24.030003 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcd3af-c837-4d66-9020-3333127866bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:24.057288 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-06bcd3af-c837-4d66-9020-3333127866bc None None] MFA Rules not processed for user `f425dbfb8ca141a09aad06f64c8933f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:12:24.058509 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-06bcd3af-c837-4d66-9020-3333127866bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:12:24.120497 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1392/2799] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:12:24.131675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a85032-b125-4c88-bb12-40138973735a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:12:24.133380 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c4a85032-b125-4c88-bb12-40138973735a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:12:24.155570 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:12:24.193289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a85032-b125-4c88-bb12-40138973735a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:12:24.196841 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c0fbd-c34e-4738-bef7-bd74a99927a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:12:24.197498 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c0fbd-c34e-4738-bef7-bd74a99927a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:24.197774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c0fbd-c34e-4738-bef7-bd74a99927a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:24.198070 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c0fbd-c34e-4738-bef7-bd74a99927a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:24.206776 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c0fbd-c34e-4738-bef7-bd74a99927a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:12:24.208178 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c0fbd-c34e-4738-bef7-bd74a99927a6 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:12:24.216780 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1408/2800] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:12:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:12:34.037195 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bcd3af-c837-4d66-9020-3333127866bc None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:12:34.055745 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:12:34.099577 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bcd3af-c837-4d66-9020-3333127866bc None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:12:34.103972 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc91f1a-c536-4b7f-b7cd-34e9886daade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:12:34.104575 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc91f1a-c536-4b7f-b7cd-34e9886daade admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:34.104846 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc91f1a-c536-4b7f-b7cd-34e9886daade admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:34.105111 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc91f1a-c536-4b7f-b7cd-34e9886daade admin admin] PATH_INFO: `/v3/users/f425dbfb8ca141a09aad06f64c8933f0` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:34.106222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc91f1a-c536-4b7f-b7cd-34e9886daade admin admin] RBAC: Authorizing `identity:delete_user(user_id=f425dbfb8ca141a09aad06f64c8933f0)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:12:34.108098 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc91f1a-c536-4b7f-b7cd-34e9886daade admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:12:34.154233 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-edc91f1a-c536-4b7f-b7cd-34e9886daade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f425dbfb8ca141a09aad06f64c8933f0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:34.154867 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-edc91f1a-c536-4b7f-b7cd-34e9886daade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f425dbfb8ca141a09aad06f64c8933f0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:34.161659 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-edc91f1a-c536-4b7f-b7cd-34e9886daade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f425dbfb8ca141a09aad06f64c8933f0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:34.173121 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-edc91f1a-c536-4b7f-b7cd-34e9886daade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f425dbfb8ca141a09aad06f64c8933f0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:34.173738 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-edc91f1a-c536-4b7f-b7cd-34e9886daade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f425dbfb8ca141a09aad06f64c8933f0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:34.186412 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1393/2801] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:12:34 2022] DELETE /identity/v3/users/f425dbfb8ca141a09aad06f64c8933f0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:12:34.191360 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f40ec-cec9-4c18-a81a-621fdf238eed None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:34.191888 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f40ec-cec9-4c18-a81a-621fdf238eed None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:34.192041 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f40ec-cec9-4c18-a81a-621fdf238eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:34.211230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-495f40ec-cec9-4c18-a81a-621fdf238eed None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:12:34.212442 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-495f40ec-cec9-4c18-a81a-621fdf238eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:12:34.277603 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1409/2802] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:12:34.286703 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc91f1a-c536-4b7f-b7cd-34e9886daade admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:12:34.288104 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-edc91f1a-c536-4b7f-b7cd-34e9886daade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:12:34.344825 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc91f1a-c536-4b7f-b7cd-34e9886daade admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:12:34.348327 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3340d9-e464-46e8-88a1-55df9051e36c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:12:34.348909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3340d9-e464-46e8-88a1-55df9051e36c service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:34.349182 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3340d9-e464-46e8-88a1-55df9051e36c service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:34.349448 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3340d9-e464-46e8-88a1-55df9051e36c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:34.358146 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3340d9-e464-46e8-88a1-55df9051e36c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:12:34.359551 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3340d9-e464-46e8-88a1-55df9051e36c service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:12:34.369331 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1394/2803] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:12:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:12:34.634409 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f40ec-cec9-4c18-a81a-621fdf238eed None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:12:34.635884 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-495f40ec-cec9-4c18-a81a-621fdf238eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:12:34.647701 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f40ec-cec9-4c18-a81a-621fdf238eed None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:12:34.652596 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773cdae-ecc9-49d3-9556-9844a2dc0cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:12:34.653239 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773cdae-ecc9-49d3-9556-9844a2dc0cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:34.653515 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773cdae-ecc9-49d3-9556-9844a2dc0cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:34.653785 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773cdae-ecc9-49d3-9556-9844a2dc0cb6 admin admin] PATH_INFO: `/v3/projects/78bef17f0fe946629706a3ea531201d4` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:34.655019 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773cdae-ecc9-49d3-9556-9844a2dc0cb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78bef17f0fe946629706a3ea531201d4)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:12:34.657436 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773cdae-ecc9-49d3-9556-9844a2dc0cb6 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:12:34.704612 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5773cdae-ecc9-49d3-9556-9844a2dc0cb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78bef17f0fe946629706a3ea531201d4', 'request_id': 'req-5773cdae-ecc9-49d3-9556-9844a2dc0cb6'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:34.711725 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5773cdae-ecc9-49d3-9556-9844a2dc0cb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78bef17f0fe946629706a3ea531201d4', 'request_id': 'req-5773cdae-ecc9-49d3-9556-9844a2dc0cb6'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:34.717979 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5773cdae-ecc9-49d3-9556-9844a2dc0cb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78bef17f0fe946629706a3ea531201d4', 'request_id': 'req-5773cdae-ecc9-49d3-9556-9844a2dc0cb6'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:34.728748 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5773cdae-ecc9-49d3-9556-9844a2dc0cb6 admin admin] The token cache is being invalidate because project 78bef17f0fe946629706a3ea531201d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:12:34.729030 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5773cdae-ecc9-49d3-9556-9844a2dc0cb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:34.729675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5773cdae-ecc9-49d3-9556-9844a2dc0cb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:12:34.731172 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1410/2804] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:12:34 2022] DELETE /identity/v3/projects/78bef17f0fe946629706a3ea531201d4 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:12:44.365170 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:12:44.725581 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:12:58.299379 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3340d9-e464-46e8-88a1-55df9051e36c service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:12:58.300804 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1c3340d9-e464-46e8-88a1-55df9051e36c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:12:58.444573 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3340d9-e464-46e8-88a1-55df9051e36c service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:12:58.514791 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba3063-64b1-4a2b-8371-3239a1f51e05 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abf9ab5fafe94afdb3ebe98536b5cc3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:12:58.515768 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba3063-64b1-4a2b-8371-3239a1f51e05 service placement] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:12:58.516250 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba3063-64b1-4a2b-8371-3239a1f51e05 service placement] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:12:58.516736 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba3063-64b1-4a2b-8371-3239a1f51e05 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:12:58.519367 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4aba3063-64b1-4a2b-8371-3239a1f51e05 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:12:58.533166 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba3063-64b1-4a2b-8371-3239a1f51e05 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:12:58.535534 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba3063-64b1-4a2b-8371-3239a1f51e05 service placement] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:12:58.546391 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1395/2805] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:12:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:13:00.228788 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633ca90-5f4b-48ad-99ca-4510046e4249 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:13:00.229257 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633ca90-5f4b-48ad-99ca-4510046e4249 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:13:00.229414 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633ca90-5f4b-48ad-99ca-4510046e4249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:13:00.257965 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-a633ca90-5f4b-48ad-99ca-4510046e4249 None None] MFA Rules not processed for user `eb9d1149a417436bbf1577d61407c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:13:00.259083 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a633ca90-5f4b-48ad-99ca-4510046e4249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:13:00.319757 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1411/2806] 10.222.0.20 () {58 vars in 967 bytes} [Wed Sep 14 01:13:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:13:00.361089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba3063-64b1-4a2b-8371-3239a1f51e05 service placement] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:13:00.363081 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4aba3063-64b1-4a2b-8371-3239a1f51e05 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:13:00.390516 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:13:00.436595 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba3063-64b1-4a2b-8371-3239a1f51e05 service placement] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:13:00.441677 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae42eab-4b6e-422a-9524-c1fdff532c7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d05652bfe542d5a2cfa39fbf7a83c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:13:00.442303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae42eab-4b6e-422a-9524-c1fdff532c7a service swift] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:13:00.442579 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae42eab-4b6e-422a-9524-c1fdff532c7a service swift] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:13:00.442846 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae42eab-4b6e-422a-9524-c1fdff532c7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:13:00.450727 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae42eab-4b6e-422a-9524-c1fdff532c7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:13:00.452282 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae42eab-4b6e-422a-9524-c1fdff532c7a service swift] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:13:00.460623 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1396/2807] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 14 01:13:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 01:13:06.700207 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633ca90-5f4b-48ad-99ca-4510046e4249 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:13:06.701765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a633ca90-5f4b-48ad-99ca-4510046e4249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:13:06.828652 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633ca90-5f4b-48ad-99ca-4510046e4249 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:13:06.834579 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787696a-ba59-4f24-81d3-ca4bc1504bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:13:06.835230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787696a-ba59-4f24-81d3-ca4bc1504bb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:13:06.835509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787696a-ba59-4f24-81d3-ca4bc1504bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:13:06.835804 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787696a-ba59-4f24-81d3-ca4bc1504bb1 admin admin] PATH_INFO: `/v3/users/6dcdcefc078b406d99420a5bab1776c5` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:13:06.837003 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787696a-ba59-4f24-81d3-ca4bc1504bb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dcdcefc078b406d99420a5bab1776c5)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:13:06.839003 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787696a-ba59-4f24-81d3-ca4bc1504bb1 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:13:06.894209 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0787696a-ba59-4f24-81d3-ca4bc1504bb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dcdcefc078b406d99420a5bab1776c5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:13:06.901716 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0787696a-ba59-4f24-81d3-ca4bc1504bb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dcdcefc078b406d99420a5bab1776c5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:13:06.909931 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:13:06.918316 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0787696a-ba59-4f24-81d3-ca4bc1504bb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dcdcefc078b406d99420a5bab1776c5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:13:06.919058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0787696a-ba59-4f24-81d3-ca4bc1504bb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dcdcefc078b406d99420a5bab1776c5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:13:06.919663 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0787696a-ba59-4f24-81d3-ca4bc1504bb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dcdcefc078b406d99420a5bab1776c5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:13:06.935888 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1412/2808] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:13:06 2022] DELETE /identity/v3/users/6dcdcefc078b406d99420a5bab1776c5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:13:07.121501 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae42eab-4b6e-422a-9524-c1fdff532c7a service swift] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:13:07.132800 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae42eab-4b6e-422a-9524-c1fdff532c7a service swift] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:13:07.190497 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55980c-9e93-407b-b9df-fba33fd63115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:13:07.191109 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55980c-9e93-407b-b9df-fba33fd63115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:13:07.191381 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55980c-9e93-407b-b9df-fba33fd63115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:13:07.191648 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55980c-9e93-407b-b9df-fba33fd63115 admin admin] PATH_INFO: `/v3/projects/57f92cc47a4540bb88497846ca0ee158` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:13:07.192734 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55980c-9e93-407b-b9df-fba33fd63115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57f92cc47a4540bb88497846ca0ee158)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:13:07.194687 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55980c-9e93-407b-b9df-fba33fd63115 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:13:07.239610 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3e55980c-9e93-407b-b9df-fba33fd63115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57f92cc47a4540bb88497846ca0ee158', 'request_id': 'req-3e55980c-9e93-407b-b9df-fba33fd63115'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:13:07.246597 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3e55980c-9e93-407b-b9df-fba33fd63115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57f92cc47a4540bb88497846ca0ee158', 'request_id': 'req-3e55980c-9e93-407b-b9df-fba33fd63115'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:13:07.252613 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3e55980c-9e93-407b-b9df-fba33fd63115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57f92cc47a4540bb88497846ca0ee158', 'request_id': 'req-3e55980c-9e93-407b-b9df-fba33fd63115'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:13:07.262751 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3e55980c-9e93-407b-b9df-fba33fd63115 admin admin] The token cache is being invalidate because project 57f92cc47a4540bb88497846ca0ee158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:13:07.262982 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3e55980c-9e93-407b-b9df-fba33fd63115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:13:07.263605 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3e55980c-9e93-407b-b9df-fba33fd63115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:13:07.265033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1397/2809] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:13:07 2022] DELETE /identity/v3/projects/57f92cc47a4540bb88497846ca0ee158 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:13:07.269633 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787696a-ba59-4f24-81d3-ca4bc1504bb1 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:13:07.271057 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0787696a-ba59-4f24-81d3-ca4bc1504bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:13:07.284656 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787696a-ba59-4f24-81d3-ca4bc1504bb1 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:13:07.338284 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3799198-b716-4dc3-a780-9d1ef738bfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:13:07.338950 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3799198-b716-4dc3-a780-9d1ef738bfe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:13:07.339274 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3799198-b716-4dc3-a780-9d1ef738bfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:13:07.339549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3799198-b716-4dc3-a780-9d1ef738bfe7 admin admin] PATH_INFO: `/v3/users/e68299983e9e47909354e502acaf39de` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:13:07.340676 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3799198-b716-4dc3-a780-9d1ef738bfe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e68299983e9e47909354e502acaf39de)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:13:07.342614 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3799198-b716-4dc3-a780-9d1ef738bfe7 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:13:07.411159 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-c3799198-b716-4dc3-a780-9d1ef738bfe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e68299983e9e47909354e502acaf39de'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:13:07.418366 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-c3799198-b716-4dc3-a780-9d1ef738bfe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e68299983e9e47909354e502acaf39de'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:13:07.430085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-c3799198-b716-4dc3-a780-9d1ef738bfe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e68299983e9e47909354e502acaf39de'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:13:07.430764 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-c3799198-b716-4dc3-a780-9d1ef738bfe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e68299983e9e47909354e502acaf39de'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:13:07.431371 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-c3799198-b716-4dc3-a780-9d1ef738bfe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e68299983e9e47909354e502acaf39de'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:13:07.443655 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1413/2810] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:13:07 2022] DELETE /identity/v3/users/e68299983e9e47909354e502acaf39de => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:13:07.609387 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55980c-9e93-407b-b9df-fba33fd63115 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:13:07.610828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3e55980c-9e93-407b-b9df-fba33fd63115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:13:07.623505 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55980c-9e93-407b-b9df-fba33fd63115 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:13:07.668569 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:13:07.685078 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e10f19-a163-4aa4-825f-bd2a79f96aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:13:07.685719 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e10f19-a163-4aa4-825f-bd2a79f96aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:13:07.686029 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e10f19-a163-4aa4-825f-bd2a79f96aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:13:07.686301 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e10f19-a163-4aa4-825f-bd2a79f96aa9 admin admin] PATH_INFO: `/v3/projects/ffd56d0f22b64ce2a5218e1b1a291c74` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:13:07.687465 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e10f19-a163-4aa4-825f-bd2a79f96aa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffd56d0f22b64ce2a5218e1b1a291c74)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:13:07.689572 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e10f19-a163-4aa4-825f-bd2a79f96aa9 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:13:07.743682 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a5e10f19-a163-4aa4-825f-bd2a79f96aa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffd56d0f22b64ce2a5218e1b1a291c74', 'request_id': 'req-a5e10f19-a163-4aa4-825f-bd2a79f96aa9'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:13:07.751202 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a5e10f19-a163-4aa4-825f-bd2a79f96aa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffd56d0f22b64ce2a5218e1b1a291c74', 'request_id': 'req-a5e10f19-a163-4aa4-825f-bd2a79f96aa9'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:13:07.758283 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a5e10f19-a163-4aa4-825f-bd2a79f96aa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffd56d0f22b64ce2a5218e1b1a291c74', 'request_id': 'req-a5e10f19-a163-4aa4-825f-bd2a79f96aa9'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:13:07.769285 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a5e10f19-a163-4aa4-825f-bd2a79f96aa9 admin admin] The token cache is being invalidate because project ffd56d0f22b64ce2a5218e1b1a291c74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:13:07.769679 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a5e10f19-a163-4aa4-825f-bd2a79f96aa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:13:07.770359 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a5e10f19-a163-4aa4-825f-bd2a79f96aa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:13:07.771868 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1398/2811] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:13:07 2022] DELETE /identity/v3/projects/ffd56d0f22b64ce2a5218e1b1a291c74 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:13:17.440629 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=59,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:13:17.765553 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=31,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:13:35.309389 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf560be-6921-4d24-b65e-babc305078d5 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:13:35.309987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf560be-6921-4d24-b65e-babc305078d5 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:13:35.310096 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf560be-6921-4d24-b65e-babc305078d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:13:35.328622 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-3bf560be-6921-4d24-b65e-babc305078d5 None None] MFA Rules not processed for user `827f496a660c4ea7be6a827f9f27d09d`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:13:35.329868 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3bf560be-6921-4d24-b65e-babc305078d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:13:35.382788 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1414/2812] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:13:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:13:45.376332 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=25 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:14:41.724120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e10f19-a163-4aa4-825f-bd2a79f96aa9 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:41.725523 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a5e10f19-a163-4aa4-825f-bd2a79f96aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:14:41.790484 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e10f19-a163-4aa4-825f-bd2a79f96aa9 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:41.795280 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3221bc-e9f8-45c6-b0d1-da5fbaeb43c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:41.795890 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3221bc-e9f8-45c6-b0d1-da5fbaeb43c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:41.796165 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3221bc-e9f8-45c6-b0d1-da5fbaeb43c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:41.796436 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3221bc-e9f8-45c6-b0d1-da5fbaeb43c7 admin admin] PATH_INFO: `/v3/users/827f496a660c4ea7be6a827f9f27d09d` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:41.797537 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3221bc-e9f8-45c6-b0d1-da5fbaeb43c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=827f496a660c4ea7be6a827f9f27d09d)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:41.799483 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3221bc-e9f8-45c6-b0d1-da5fbaeb43c7 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:41.848596 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3d3221bc-e9f8-45c6-b0d1-da5fbaeb43c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '827f496a660c4ea7be6a827f9f27d09d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:41.849322 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3d3221bc-e9f8-45c6-b0d1-da5fbaeb43c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '827f496a660c4ea7be6a827f9f27d09d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:41.856306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3d3221bc-e9f8-45c6-b0d1-da5fbaeb43c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '827f496a660c4ea7be6a827f9f27d09d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:41.868651 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3d3221bc-e9f8-45c6-b0d1-da5fbaeb43c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '827f496a660c4ea7be6a827f9f27d09d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:41.869306 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3d3221bc-e9f8-45c6-b0d1-da5fbaeb43c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '827f496a660c4ea7be6a827f9f27d09d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:41.882359 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1399/2813] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:14:41 2022] DELETE /identity/v3/users/827f496a660c4ea7be6a827f9f27d09d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:14:42.049157 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf560be-6921-4d24-b65e-babc305078d5 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:42.061134 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf560be-6921-4d24-b65e-babc305078d5 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:42.118615 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605ef75-e1e8-44bd-b77b-42e8d7e98f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:42.119241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605ef75-e1e8-44bd-b77b-42e8d7e98f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:42.119520 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605ef75-e1e8-44bd-b77b-42e8d7e98f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:42.119792 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605ef75-e1e8-44bd-b77b-42e8d7e98f52 admin admin] PATH_INFO: `/v3/projects/c7c272d384b547dab72c1f42f431970b` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:42.121143 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605ef75-e1e8-44bd-b77b-42e8d7e98f52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7c272d384b547dab72c1f42f431970b)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:42.123066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605ef75-e1e8-44bd-b77b-42e8d7e98f52 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:42.168198 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d605ef75-e1e8-44bd-b77b-42e8d7e98f52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7c272d384b547dab72c1f42f431970b', 'request_id': 'req-d605ef75-e1e8-44bd-b77b-42e8d7e98f52'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:42.175205 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d605ef75-e1e8-44bd-b77b-42e8d7e98f52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7c272d384b547dab72c1f42f431970b', 'request_id': 'req-d605ef75-e1e8-44bd-b77b-42e8d7e98f52'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:42.181774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d605ef75-e1e8-44bd-b77b-42e8d7e98f52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7c272d384b547dab72c1f42f431970b', 'request_id': 'req-d605ef75-e1e8-44bd-b77b-42e8d7e98f52'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:42.191671 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d605ef75-e1e8-44bd-b77b-42e8d7e98f52 admin admin] The token cache is being invalidate because project c7c272d384b547dab72c1f42f431970b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:14:42.191955 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d605ef75-e1e8-44bd-b77b-42e8d7e98f52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:42.192567 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d605ef75-e1e8-44bd-b77b-42e8d7e98f52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:42.194155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1415/2814] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:14:42 2022] DELETE /identity/v3/projects/c7c272d384b547dab72c1f42f431970b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:14:42.199798 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c97ca-2d00-4389-91bb-4051e3718386 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:42.200215 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c97ca-2d00-4389-91bb-4051e3718386 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:42.200592 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c97ca-2d00-4389-91bb-4051e3718386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:42.257935 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-621c97ca-2d00-4389-91bb-4051e3718386 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:14:42.259154 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-621c97ca-2d00-4389-91bb-4051e3718386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:14:42.301433 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:14:42.318171 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1400/2815] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:14:42.325940 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c5b96-de2d-4d69-bfbf-575ab143582e None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:42.326224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c5b96-de2d-4d69-bfbf-575ab143582e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:42.326554 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c5b96-de2d-4d69-bfbf-575ab143582e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:42.345682 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-4a3c5b96-de2d-4d69-bfbf-575ab143582e None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:14:42.346906 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4a3c5b96-de2d-4d69-bfbf-575ab143582e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:14:42.355069 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1416/2816] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:14:42.359225 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c97ca-2d00-4389-91bb-4051e3718386 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:42.369285 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c97ca-2d00-4389-91bb-4051e3718386 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:42.373782 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9daf6-cda0-4887-968a-1cab450ad9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:42.374391 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9daf6-cda0-4887-968a-1cab450ad9ed admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:42.374666 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9daf6-cda0-4887-968a-1cab450ad9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:42.374932 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9daf6-cda0-4887-968a-1cab450ad9ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:42.375594 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b9daf6-cda0-4887-968a-1cab450ad9ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:14:42.375912 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b9daf6-cda0-4887-968a-1cab450ad9ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:42.377557 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b9daf6-cda0-4887-968a-1cab450ad9ed admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:42.388792 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1401/2817] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:14:42.392877 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c5b96-de2d-4d69-bfbf-575ab143582e None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:42.402371 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c5b96-de2d-4d69-bfbf-575ab143582e None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:42.407025 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658a16b-5048-4012-812a-04fca23af5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:42.407617 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658a16b-5048-4012-812a-04fca23af5f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:42.407896 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658a16b-5048-4012-812a-04fca23af5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:42.408162 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658a16b-5048-4012-812a-04fca23af5f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:42.408778 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658a16b-5048-4012-812a-04fca23af5f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:42.410754 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658a16b-5048-4012-812a-04fca23af5f3 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:42.447371 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1417/2818] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:14:42 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:14:42.451399 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9daf6-cda0-4887-968a-1cab450ad9ed admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:42.461217 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9daf6-cda0-4887-968a-1cab450ad9ed admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:42.515517 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27478c71-9e80-4dc7-8cf1-c8fcace415d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:42.516125 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27478c71-9e80-4dc7-8cf1-c8fcace415d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:42.516385 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27478c71-9e80-4dc7-8cf1-c8fcace415d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:42.516653 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27478c71-9e80-4dc7-8cf1-c8fcace415d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:42.517271 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27478c71-9e80-4dc7-8cf1-c8fcace415d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:42.519204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27478c71-9e80-4dc7-8cf1-c8fcace415d5 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:42.540347 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1402/2819] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:14:42 2022] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:14:42.544377 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658a16b-5048-4012-812a-04fca23af5f3 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:42.554397 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658a16b-5048-4012-812a-04fca23af5f3 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:42.559676 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324de87-e5b0-4641-8702-46fc77552048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:42.560267 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324de87-e5b0-4641-8702-46fc77552048 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:42.560545 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324de87-e5b0-4641-8702-46fc77552048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:42.560813 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324de87-e5b0-4641-8702-46fc77552048 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:42.561443 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324de87-e5b0-4641-8702-46fc77552048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:42.563057 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324de87-e5b0-4641-8702-46fc77552048 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:42.572725 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1418/2820] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:14:42.576299 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27478c71-9e80-4dc7-8cf1-c8fcace415d5 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:42.585897 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27478c71-9e80-4dc7-8cf1-c8fcace415d5 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:42.590384 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8eebe-1fd5-4d7f-a8a2-0e1d6a036b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:42.590955 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8eebe-1fd5-4d7f-a8a2-0e1d6a036b59 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:42.591229 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8eebe-1fd5-4d7f-a8a2-0e1d6a036b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:42.591496 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8eebe-1fd5-4d7f-a8a2-0e1d6a036b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:42.592120 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8eebe-1fd5-4d7f-a8a2-0e1d6a036b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:42.593680 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8eebe-1fd5-4d7f-a8a2-0e1d6a036b59 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:42.604530 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1403/2821] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:14:42.608303 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324de87-e5b0-4641-8702-46fc77552048 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:42.617896 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324de87-e5b0-4641-8702-46fc77552048 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:42.623049 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fcdf0-1638-40ec-8341-1d4e6789104f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:42.623680 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fcdf0-1638-40ec-8341-1d4e6789104f admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:42.623958 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fcdf0-1638-40ec-8341-1d4e6789104f admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:42.624230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fcdf0-1638-40ec-8341-1d4e6789104f admin admin] PATH_INFO: `/v3/projects/f9e6d9e2b31d448a9224e2483d63f0fa/users/43b2239a3a424830ba19fce573caab3d/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:42.638874 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fcdf0-1638-40ec-8341-1d4e6789104f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e6d9e2b31d448a9224e2483d63f0fa, user_id=43b2239a3a424830ba19fce573caab3d, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:42.641510 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fcdf0-1638-40ec-8341-1d4e6789104f admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:42.655028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1419/2822] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:14:42 2022] PUT /identity/v3/projects/f9e6d9e2b31d448a9224e2483d63f0fa/users/43b2239a3a424830ba19fce573caab3d/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:14:42.666236 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6855e-5403-42b4-a76f-32022e559cdc None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:42.666516 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6855e-5403-42b4-a76f-32022e559cdc None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:42.666781 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6855e-5403-42b4-a76f-32022e559cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:42.693242 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-c4b6855e-5403-42b4-a76f-32022e559cdc None None] MFA Rules not processed for user `43b2239a3a424830ba19fce573caab3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:14:42.694473 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c4b6855e-5403-42b4-a76f-32022e559cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:14:42.758204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1404/2823] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:14:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:14:42.769199 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fcdf0-1638-40ec-8341-1d4e6789104f admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:42.770901 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-321fcdf0-1638-40ec-8341-1d4e6789104f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:14:42.793972 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:14:42.869220 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fcdf0-1638-40ec-8341-1d4e6789104f admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:42.874812 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af1242-cd51-4193-82fc-99fbdec6d611 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:42.875683 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af1242-cd51-4193-82fc-99fbdec6d611 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:42.876052 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af1242-cd51-4193-82fc-99fbdec6d611 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:42.876455 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af1242-cd51-4193-82fc-99fbdec6d611 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:42.885337 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af1242-cd51-4193-82fc-99fbdec6d611 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:42.887558 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af1242-cd51-4193-82fc-99fbdec6d611 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:42.897186 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1420/2824] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:14:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:14:45.690222 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6855e-5403-42b4-a76f-32022e559cdc None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:45.691609 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c4b6855e-5403-42b4-a76f-32022e559cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:14:45.737660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:14:45.769806 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6855e-5403-42b4-a76f-32022e559cdc None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:45.773318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835d026-4598-4a66-b35b-aa275f12f385 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:45.773933 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835d026-4598-4a66-b35b-aa275f12f385 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:45.774233 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835d026-4598-4a66-b35b-aa275f12f385 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:45.774496 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835d026-4598-4a66-b35b-aa275f12f385 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:45.776426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5835d026-4598-4a66-b35b-aa275f12f385 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:14:45.789291 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835d026-4598-4a66-b35b-aa275f12f385 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:45.790774 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835d026-4598-4a66-b35b-aa275f12f385 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:45.801325 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1405/2825] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:14:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:14:48.093970 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af1242-cd51-4193-82fc-99fbdec6d611 service nova] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:48.095359 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-32af1242-cd51-4193-82fc-99fbdec6d611 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:14:48.107884 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af1242-cd51-4193-82fc-99fbdec6d611 service nova] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:48.111428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34da1fa-06a5-4239-aa97-d86212fc2d76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:48.112018 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34da1fa-06a5-4239-aa97-d86212fc2d76 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:48.112318 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34da1fa-06a5-4239-aa97-d86212fc2d76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:48.112582 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34da1fa-06a5-4239-aa97-d86212fc2d76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:48.114553 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c34da1fa-06a5-4239-aa97-d86212fc2d76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:14:48.127602 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34da1fa-06a5-4239-aa97-d86212fc2d76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:48.129001 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34da1fa-06a5-4239-aa97-d86212fc2d76 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:48.139769 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1421/2826] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:14:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:14:48.256770 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835d026-4598-4a66-b35b-aa275f12f385 service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:48.315512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835d026-4598-4a66-b35b-aa275f12f385 service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:48.319938 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369e6f6-987e-4ce0-9028-390586d248d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:48.320542 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369e6f6-987e-4ce0-9028-390586d248d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:48.321338 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369e6f6-987e-4ce0-9028-390586d248d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:48.321590 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369e6f6-987e-4ce0-9028-390586d248d8 admin admin] PATH_INFO: `/v3/users/43b2239a3a424830ba19fce573caab3d` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:48.322707 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369e6f6-987e-4ce0-9028-390586d248d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43b2239a3a424830ba19fce573caab3d)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:48.324604 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369e6f6-987e-4ce0-9028-390586d248d8 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:48.370017 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a369e6f6-987e-4ce0-9028-390586d248d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43b2239a3a424830ba19fce573caab3d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:48.370649 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a369e6f6-987e-4ce0-9028-390586d248d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43b2239a3a424830ba19fce573caab3d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:48.377243 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a369e6f6-987e-4ce0-9028-390586d248d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43b2239a3a424830ba19fce573caab3d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:48.389015 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a369e6f6-987e-4ce0-9028-390586d248d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43b2239a3a424830ba19fce573caab3d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:48.389630 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a369e6f6-987e-4ce0-9028-390586d248d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43b2239a3a424830ba19fce573caab3d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:48.402547 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1406/2827] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:14:48 2022] DELETE /identity/v3/users/43b2239a3a424830ba19fce573caab3d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:14:48.406949 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a78e9-bcbc-4601-838f-b49f676a94d5 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:48.407253 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a78e9-bcbc-4601-838f-b49f676a94d5 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:48.407509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a78e9-bcbc-4601-838f-b49f676a94d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:48.426273 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-344a78e9-bcbc-4601-838f-b49f676a94d5 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:14:48.427471 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-344a78e9-bcbc-4601-838f-b49f676a94d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:14:48.484438 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1422/2828] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:14:48.493992 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369e6f6-987e-4ce0-9028-390586d248d8 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:48.495360 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a369e6f6-987e-4ce0-9028-390586d248d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:14:48.546908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:14:48.574812 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369e6f6-987e-4ce0-9028-390586d248d8 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:48.578338 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce43a2-928f-4f2a-bbb8-f0213b585669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:48.578921 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce43a2-928f-4f2a-bbb8-f0213b585669 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:48.579192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce43a2-928f-4f2a-bbb8-f0213b585669 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:48.579458 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce43a2-928f-4f2a-bbb8-f0213b585669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:48.588724 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce43a2-928f-4f2a-bbb8-f0213b585669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:48.590164 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce43a2-928f-4f2a-bbb8-f0213b585669 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:48.599224 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1407/2829] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:14:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:14:48.860002 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a78e9-bcbc-4601-838f-b49f676a94d5 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:48.861520 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-344a78e9-bcbc-4601-838f-b49f676a94d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:14:48.876301 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a78e9-bcbc-4601-838f-b49f676a94d5 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:48.882347 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31d707-85d9-40d6-ac63-94d63ff56076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:48.882989 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31d707-85d9-40d6-ac63-94d63ff56076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:48.884002 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31d707-85d9-40d6-ac63-94d63ff56076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:48.884285 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31d707-85d9-40d6-ac63-94d63ff56076 admin admin] PATH_INFO: `/v3/projects/f9e6d9e2b31d448a9224e2483d63f0fa` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:48.885433 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31d707-85d9-40d6-ac63-94d63ff56076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9e6d9e2b31d448a9224e2483d63f0fa)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:48.887389 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31d707-85d9-40d6-ac63-94d63ff56076 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:48.933934 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fc31d707-85d9-40d6-ac63-94d63ff56076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9e6d9e2b31d448a9224e2483d63f0fa', 'request_id': 'req-fc31d707-85d9-40d6-ac63-94d63ff56076'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:48.941344 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fc31d707-85d9-40d6-ac63-94d63ff56076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9e6d9e2b31d448a9224e2483d63f0fa', 'request_id': 'req-fc31d707-85d9-40d6-ac63-94d63ff56076'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:48.948291 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fc31d707-85d9-40d6-ac63-94d63ff56076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9e6d9e2b31d448a9224e2483d63f0fa', 'request_id': 'req-fc31d707-85d9-40d6-ac63-94d63ff56076'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:48.952389 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:14:48.960845 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fc31d707-85d9-40d6-ac63-94d63ff56076 admin admin] The token cache is being invalidate because project f9e6d9e2b31d448a9224e2483d63f0fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:14:48.961303 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fc31d707-85d9-40d6-ac63-94d63ff56076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:48.962152 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fc31d707-85d9-40d6-ac63-94d63ff56076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:48.964078 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1423/2830] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:14:48 2022] DELETE /identity/v3/projects/f9e6d9e2b31d448a9224e2483d63f0fa => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:14:48.968955 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706dcf1-d7be-4347-91cd-82ec4f83aacd None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:48.969239 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706dcf1-d7be-4347-91cd-82ec4f83aacd None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:48.969531 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706dcf1-d7be-4347-91cd-82ec4f83aacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:48.989614 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-6706dcf1-d7be-4347-91cd-82ec4f83aacd None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:14:48.990835 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6706dcf1-d7be-4347-91cd-82ec4f83aacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:14:49.049280 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1408/2831] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:14:49.058793 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e987b4-40d9-4233-b75d-36faabc04e9f None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:49.059010 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e987b4-40d9-4233-b75d-36faabc04e9f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:49.059277 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e987b4-40d9-4233-b75d-36faabc04e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:49.078432 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-05e987b4-40d9-4233-b75d-36faabc04e9f None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:14:49.079608 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-05e987b4-40d9-4233-b75d-36faabc04e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:14:49.087293 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1424/2832] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:14:49.091262 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706dcf1-d7be-4347-91cd-82ec4f83aacd None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:49.100764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706dcf1-d7be-4347-91cd-82ec4f83aacd None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:49.105829 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca090a4-f46a-441f-a260-da42882bf6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:49.106414 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca090a4-f46a-441f-a260-da42882bf6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:49.106692 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca090a4-f46a-441f-a260-da42882bf6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:49.106965 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca090a4-f46a-441f-a260-da42882bf6b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:49.107597 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca090a4-f46a-441f-a260-da42882bf6b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:14:49.107900 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca090a4-f46a-441f-a260-da42882bf6b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:49.109485 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca090a4-f46a-441f-a260-da42882bf6b8 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:49.121261 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1409/2833] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:14:49.125318 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e987b4-40d9-4233-b75d-36faabc04e9f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:49.134258 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e987b4-40d9-4233-b75d-36faabc04e9f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:49.138840 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056408e-5918-4373-9df4-b5a4f6b7bf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:49.139437 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056408e-5918-4373-9df4-b5a4f6b7bf6d admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:49.139712 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056408e-5918-4373-9df4-b5a4f6b7bf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:49.139978 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056408e-5918-4373-9df4-b5a4f6b7bf6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:49.140618 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056408e-5918-4373-9df4-b5a4f6b7bf6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:49.142535 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056408e-5918-4373-9df4-b5a4f6b7bf6d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:49.173374 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1425/2834] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:14:49 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:14:49.177291 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca090a4-f46a-441f-a260-da42882bf6b8 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:49.187702 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca090a4-f46a-441f-a260-da42882bf6b8 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:49.244687 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd394e44-1c0b-46d3-9c74-a9641ca432d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:49.245273 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd394e44-1c0b-46d3-9c74-a9641ca432d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:49.245546 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd394e44-1c0b-46d3-9c74-a9641ca432d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:49.245828 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd394e44-1c0b-46d3-9c74-a9641ca432d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:49.246445 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd394e44-1c0b-46d3-9c74-a9641ca432d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:49.248327 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd394e44-1c0b-46d3-9c74-a9641ca432d0 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:49.268458 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1410/2835] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:14:49 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:14:49.272562 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056408e-5918-4373-9df4-b5a4f6b7bf6d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:49.283039 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056408e-5918-4373-9df4-b5a4f6b7bf6d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:49.287636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab7554-d53f-413e-adc3-cc94cd46de44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:49.288224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab7554-d53f-413e-adc3-cc94cd46de44 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:49.288504 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab7554-d53f-413e-adc3-cc94cd46de44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:49.288774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab7554-d53f-413e-adc3-cc94cd46de44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:49.289407 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab7554-d53f-413e-adc3-cc94cd46de44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:49.291521 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab7554-d53f-413e-adc3-cc94cd46de44 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:49.301189 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1426/2836] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:14:49.304796 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd394e44-1c0b-46d3-9c74-a9641ca432d0 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:49.315084 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd394e44-1c0b-46d3-9c74-a9641ca432d0 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:49.319565 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa9d38-39ba-41be-b8b5-2b6e7d5c2999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:49.320136 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa9d38-39ba-41be-b8b5-2b6e7d5c2999 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:49.320415 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa9d38-39ba-41be-b8b5-2b6e7d5c2999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:49.320678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa9d38-39ba-41be-b8b5-2b6e7d5c2999 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:49.321414 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa9d38-39ba-41be-b8b5-2b6e7d5c2999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:49.323323 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa9d38-39ba-41be-b8b5-2b6e7d5c2999 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:49.333717 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1411/2837] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:14:49.337699 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab7554-d53f-413e-adc3-cc94cd46de44 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:49.347349 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab7554-d53f-413e-adc3-cc94cd46de44 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:49.351956 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00355e-2618-49e2-9c5c-fd06c6194d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:49.356685 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00355e-2618-49e2-9c5c-fd06c6194d99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:49.356993 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00355e-2618-49e2-9c5c-fd06c6194d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:49.357271 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00355e-2618-49e2-9c5c-fd06c6194d99 admin admin] PATH_INFO: `/v3/projects/e701ba5f5a7c4bd58f85d726d69724b7/users/eec963eb0d4745e1a62c446f0c37aaa5/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:49.372402 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00355e-2618-49e2-9c5c-fd06c6194d99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e701ba5f5a7c4bd58f85d726d69724b7, user_id=eec963eb0d4745e1a62c446f0c37aaa5, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:49.375089 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00355e-2618-49e2-9c5c-fd06c6194d99 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:49.387439 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1427/2838] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:14:49 2022] PUT /identity/v3/projects/e701ba5f5a7c4bd58f85d726d69724b7/users/eec963eb0d4745e1a62c446f0c37aaa5/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:14:49.397726 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebf0fa-00e3-44dd-8c99-7e89c034593f None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:49.398027 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebf0fa-00e3-44dd-8c99-7e89c034593f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:49.398319 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebf0fa-00e3-44dd-8c99-7e89c034593f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:49.426600 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-58ebf0fa-00e3-44dd-8c99-7e89c034593f None None] MFA Rules not processed for user `eec963eb0d4745e1a62c446f0c37aaa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:14:49.427829 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-58ebf0fa-00e3-44dd-8c99-7e89c034593f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:14:49.454971 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:14:49.496953 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1412/2839] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:14:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:14:49.501460 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00355e-2618-49e2-9c5c-fd06c6194d99 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:49.564864 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00355e-2618-49e2-9c5c-fd06c6194d99 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:49.569539 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ee8e4-7040-44da-b28c-648e2e84b649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:49.570085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ee8e4-7040-44da-b28c-648e2e84b649 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:49.570367 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ee8e4-7040-44da-b28c-648e2e84b649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:49.570640 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ee8e4-7040-44da-b28c-648e2e84b649 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:49.571284 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ee8e4-7040-44da-b28c-648e2e84b649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:49.573173 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ee8e4-7040-44da-b28c-648e2e84b649 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:49.598652 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1428/2840] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:14:49 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:14:49.603408 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebf0fa-00e3-44dd-8c99-7e89c034593f None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:49.613822 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebf0fa-00e3-44dd-8c99-7e89c034593f None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:49.671009 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac23930-166a-4ad9-8752-f834f4ea01dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:49.671598 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac23930-166a-4ad9-8752-f834f4ea01dd admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:49.671875 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac23930-166a-4ad9-8752-f834f4ea01dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:49.672145 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac23930-166a-4ad9-8752-f834f4ea01dd admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:49.672757 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac23930-166a-4ad9-8752-f834f4ea01dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:49.674691 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac23930-166a-4ad9-8752-f834f4ea01dd admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:49.695065 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1413/2841] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:14:49 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:14:49.698935 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ee8e4-7040-44da-b28c-648e2e84b649 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:49.708907 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ee8e4-7040-44da-b28c-648e2e84b649 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:49.714049 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5cc25-5d8e-4afc-9a26-85f9a7deb662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:49.714639 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5cc25-5d8e-4afc-9a26-85f9a7deb662 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:49.714920 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5cc25-5d8e-4afc-9a26-85f9a7deb662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:49.715193 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5cc25-5d8e-4afc-9a26-85f9a7deb662 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:49.715852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5cc25-5d8e-4afc-9a26-85f9a7deb662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:49.717424 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5cc25-5d8e-4afc-9a26-85f9a7deb662 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:49.728509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1429/2842] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:14:49.732485 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac23930-166a-4ad9-8752-f834f4ea01dd admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:49.742429 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac23930-166a-4ad9-8752-f834f4ea01dd admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:49.747133 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0e11b-7b93-4596-8211-54c7ac38d315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:49.747799 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0e11b-7b93-4596-8211-54c7ac38d315 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:49.748071 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0e11b-7b93-4596-8211-54c7ac38d315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:49.748334 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0e11b-7b93-4596-8211-54c7ac38d315 admin admin] PATH_INFO: `/v3/projects/986cb73c431c4e6eaaee5541db7fcee0/users/83dce93fdab84cd69aff19a53ba959f5/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:49.763198 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d0e11b-7b93-4596-8211-54c7ac38d315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=986cb73c431c4e6eaaee5541db7fcee0, user_id=83dce93fdab84cd69aff19a53ba959f5, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:49.765841 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d0e11b-7b93-4596-8211-54c7ac38d315 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:49.780796 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1414/2843] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:14:49 2022] PUT /identity/v3/projects/986cb73c431c4e6eaaee5541db7fcee0/users/83dce93fdab84cd69aff19a53ba959f5/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:14:49.784701 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5cc25-5d8e-4afc-9a26-85f9a7deb662 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:49.794509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5cc25-5d8e-4afc-9a26-85f9a7deb662 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:49.849732 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb722bd9-f565-469b-b452-ccb1378d2de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:49.850292 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb722bd9-f565-469b-b452-ccb1378d2de8 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:49.850573 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb722bd9-f565-469b-b452-ccb1378d2de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:49.850846 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb722bd9-f565-469b-b452-ccb1378d2de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:49.851476 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb722bd9-f565-469b-b452-ccb1378d2de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:49.853087 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb722bd9-f565-469b-b452-ccb1378d2de8 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:49.857961 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:14:49.864006 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1430/2844] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:14:49.867960 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0e11b-7b93-4596-8211-54c7ac38d315 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:49.879081 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0e11b-7b93-4596-8211-54c7ac38d315 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:49.884157 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db79f6-68e2-4705-8ad6-0a4ed6267c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:49.884793 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db79f6-68e2-4705-8ad6-0a4ed6267c44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:49.885066 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db79f6-68e2-4705-8ad6-0a4ed6267c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:49.885330 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db79f6-68e2-4705-8ad6-0a4ed6267c44 admin admin] PATH_INFO: `/v3/projects/986cb73c431c4e6eaaee5541db7fcee0/users/83dce93fdab84cd69aff19a53ba959f5/roles/0d7a36bda723430eae02f10f4c775c96` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:49.887244 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db79f6-68e2-4705-8ad6-0a4ed6267c44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=986cb73c431c4e6eaaee5541db7fcee0, user_id=83dce93fdab84cd69aff19a53ba959f5, role_id=0d7a36bda723430eae02f10f4c775c96)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:49.889869 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db79f6-68e2-4705-8ad6-0a4ed6267c44 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:49.900407 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1415/2845] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:14:49 2022] PUT /identity/v3/projects/986cb73c431c4e6eaaee5541db7fcee0/users/83dce93fdab84cd69aff19a53ba959f5/roles/0d7a36bda723430eae02f10f4c775c96 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:14:49.910610 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4caaff-c2d1-4457-86be-b382aa993a9f None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:49.910919 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4caaff-c2d1-4457-86be-b382aa993a9f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:49.911194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4caaff-c2d1-4457-86be-b382aa993a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:49.937987 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-4b4caaff-c2d1-4457-86be-b382aa993a9f None None] MFA Rules not processed for user `83dce93fdab84cd69aff19a53ba959f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:14:49.939190 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4b4caaff-c2d1-4457-86be-b382aa993a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:14:50.004578 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1431/2846] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:14:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:14:50.016990 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db79f6-68e2-4705-8ad6-0a4ed6267c44 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:50.018676 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-04db79f6-68e2-4705-8ad6-0a4ed6267c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:14:50.074290 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db79f6-68e2-4705-8ad6-0a4ed6267c44 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:50.077832 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c18591-618d-4297-b8f0-c8354138a1b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:50.078415 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c18591-618d-4297-b8f0-c8354138a1b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:50.078686 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c18591-618d-4297-b8f0-c8354138a1b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:50.078951 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c18591-618d-4297-b8f0-c8354138a1b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:50.088555 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c18591-618d-4297-b8f0-c8354138a1b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:50.089989 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c18591-618d-4297-b8f0-c8354138a1b5 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:50.099106 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1416/2847] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:14:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:14:51.408489 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4caaff-c2d1-4457-86be-b382aa993a9f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:51.470997 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4caaff-c2d1-4457-86be-b382aa993a9f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:51.475477 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c80b2a-e673-485d-936d-58474067d66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:51.476092 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c80b2a-e673-485d-936d-58474067d66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:51.476369 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c80b2a-e673-485d-936d-58474067d66b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:51.476654 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c80b2a-e673-485d-936d-58474067d66b admin admin] PATH_INFO: `/v3/users/eec963eb0d4745e1a62c446f0c37aaa5` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:51.477933 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c80b2a-e673-485d-936d-58474067d66b admin admin] RBAC: Authorizing `identity:delete_user(user_id=eec963eb0d4745e1a62c446f0c37aaa5)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:51.479858 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c80b2a-e673-485d-936d-58474067d66b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:51.528743 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-49c80b2a-e673-485d-936d-58474067d66b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eec963eb0d4745e1a62c446f0c37aaa5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:51.535521 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-49c80b2a-e673-485d-936d-58474067d66b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eec963eb0d4745e1a62c446f0c37aaa5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:51.547312 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-49c80b2a-e673-485d-936d-58474067d66b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eec963eb0d4745e1a62c446f0c37aaa5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:51.547974 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-49c80b2a-e673-485d-936d-58474067d66b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eec963eb0d4745e1a62c446f0c37aaa5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:51.548580 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-49c80b2a-e673-485d-936d-58474067d66b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eec963eb0d4745e1a62c446f0c37aaa5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:51.560698 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1432/2848] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:14:51 2022] DELETE /identity/v3/users/eec963eb0d4745e1a62c446f0c37aaa5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:14:51.565166 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567af7a-97ae-4d87-a40a-636fda6de79c None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:51.565677 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567af7a-97ae-4d87-a40a-636fda6de79c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:51.565777 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567af7a-97ae-4d87-a40a-636fda6de79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:51.584460 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-3567af7a-97ae-4d87-a40a-636fda6de79c None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:14:51.585639 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3567af7a-97ae-4d87-a40a-636fda6de79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:14:51.598431 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:14:51.645284 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1417/2849] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:14:51.655083 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c80b2a-e673-485d-936d-58474067d66b admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:51.656686 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-49c80b2a-e673-485d-936d-58474067d66b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:14:51.663261 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:14:51.714346 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c80b2a-e673-485d-936d-58474067d66b admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:51.717934 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485014fa-4ff5-4be3-b71d-7833053c1908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:51.718523 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485014fa-4ff5-4be3-b71d-7833053c1908 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:51.718798 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485014fa-4ff5-4be3-b71d-7833053c1908 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:51.719066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485014fa-4ff5-4be3-b71d-7833053c1908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:51.727892 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485014fa-4ff5-4be3-b71d-7833053c1908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:51.729298 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485014fa-4ff5-4be3-b71d-7833053c1908 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:51.738555 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1433/2850] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:14:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:14:51.999054 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567af7a-97ae-4d87-a40a-636fda6de79c None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:52.000539 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3567af7a-97ae-4d87-a40a-636fda6de79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:14:52.015248 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567af7a-97ae-4d87-a40a-636fda6de79c None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:52.019754 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8165d1e-619f-4f19-8ee1-54881deb10ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:52.020405 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8165d1e-619f-4f19-8ee1-54881deb10ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:52.020683 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8165d1e-619f-4f19-8ee1-54881deb10ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:52.020974 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8165d1e-619f-4f19-8ee1-54881deb10ca admin admin] PATH_INFO: `/v3/projects/e701ba5f5a7c4bd58f85d726d69724b7` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:52.022660 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8165d1e-619f-4f19-8ee1-54881deb10ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=e701ba5f5a7c4bd58f85d726d69724b7)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:52.024870 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8165d1e-619f-4f19-8ee1-54881deb10ca admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:52.071794 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b8165d1e-619f-4f19-8ee1-54881deb10ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e701ba5f5a7c4bd58f85d726d69724b7', 'request_id': 'req-b8165d1e-619f-4f19-8ee1-54881deb10ca'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:52.078976 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b8165d1e-619f-4f19-8ee1-54881deb10ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e701ba5f5a7c4bd58f85d726d69724b7', 'request_id': 'req-b8165d1e-619f-4f19-8ee1-54881deb10ca'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:52.085209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b8165d1e-619f-4f19-8ee1-54881deb10ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e701ba5f5a7c4bd58f85d726d69724b7', 'request_id': 'req-b8165d1e-619f-4f19-8ee1-54881deb10ca'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:52.095387 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b8165d1e-619f-4f19-8ee1-54881deb10ca admin admin] The token cache is being invalidate because project e701ba5f5a7c4bd58f85d726d69724b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:14:52.095672 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b8165d1e-619f-4f19-8ee1-54881deb10ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:52.096290 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b8165d1e-619f-4f19-8ee1-54881deb10ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:52.097743 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1418/2851] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:14:51 2022] DELETE /identity/v3/projects/e701ba5f5a7c4bd58f85d726d69724b7 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:14:52.101914 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485014fa-4ff5-4be3-b71d-7833053c1908 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:52.111761 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485014fa-4ff5-4be3-b71d-7833053c1908 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:52.167489 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74320bf4-9c30-4b14-b5ba-53248cb7db80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:52.168168 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74320bf4-9c30-4b14-b5ba-53248cb7db80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:52.168455 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74320bf4-9c30-4b14-b5ba-53248cb7db80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:52.168729 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74320bf4-9c30-4b14-b5ba-53248cb7db80 admin admin] PATH_INFO: `/v3/users/83dce93fdab84cd69aff19a53ba959f5` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:52.169862 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74320bf4-9c30-4b14-b5ba-53248cb7db80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83dce93fdab84cd69aff19a53ba959f5)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:52.171852 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74320bf4-9c30-4b14-b5ba-53248cb7db80 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:52.217750 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-74320bf4-9c30-4b14-b5ba-53248cb7db80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83dce93fdab84cd69aff19a53ba959f5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:52.224517 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-74320bf4-9c30-4b14-b5ba-53248cb7db80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83dce93fdab84cd69aff19a53ba959f5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:52.236313 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-74320bf4-9c30-4b14-b5ba-53248cb7db80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83dce93fdab84cd69aff19a53ba959f5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:52.237002 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-74320bf4-9c30-4b14-b5ba-53248cb7db80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83dce93fdab84cd69aff19a53ba959f5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:52.237605 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-74320bf4-9c30-4b14-b5ba-53248cb7db80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83dce93fdab84cd69aff19a53ba959f5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:52.249946 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1434/2852] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:14:52 2022] DELETE /identity/v3/users/83dce93fdab84cd69aff19a53ba959f5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:14:52.516286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8165d1e-619f-4f19-8ee1-54881deb10ca admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:52.517725 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b8165d1e-619f-4f19-8ee1-54881deb10ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:14:52.531275 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8165d1e-619f-4f19-8ee1-54881deb10ca admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:52.589031 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab307a6-9a0d-4f6c-ab89-b33d972980a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:52.589653 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab307a6-9a0d-4f6c-ab89-b33d972980a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:52.589955 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab307a6-9a0d-4f6c-ab89-b33d972980a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:52.590228 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab307a6-9a0d-4f6c-ab89-b33d972980a6 admin admin] PATH_INFO: `/v3/projects/986cb73c431c4e6eaaee5541db7fcee0` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:52.591326 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab307a6-9a0d-4f6c-ab89-b33d972980a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=986cb73c431c4e6eaaee5541db7fcee0)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:52.593231 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab307a6-9a0d-4f6c-ab89-b33d972980a6 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:52.636501 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:14:52.640386 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3ab307a6-9a0d-4f6c-ab89-b33d972980a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '986cb73c431c4e6eaaee5541db7fcee0', 'request_id': 'req-3ab307a6-9a0d-4f6c-ab89-b33d972980a6'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:52.648033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3ab307a6-9a0d-4f6c-ab89-b33d972980a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '986cb73c431c4e6eaaee5541db7fcee0', 'request_id': 'req-3ab307a6-9a0d-4f6c-ab89-b33d972980a6'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:52.654565 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3ab307a6-9a0d-4f6c-ab89-b33d972980a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '986cb73c431c4e6eaaee5541db7fcee0', 'request_id': 'req-3ab307a6-9a0d-4f6c-ab89-b33d972980a6'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:52.664595 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3ab307a6-9a0d-4f6c-ab89-b33d972980a6 admin admin] The token cache is being invalidate because project 986cb73c431c4e6eaaee5541db7fcee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:14:52.664882 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3ab307a6-9a0d-4f6c-ab89-b33d972980a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:52.665501 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3ab307a6-9a0d-4f6c-ab89-b33d972980a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:14:52.666962 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1419/2853] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:14:52 2022] DELETE /identity/v3/projects/986cb73c431c4e6eaaee5541db7fcee0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:14:52.672936 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829a2b0-d593-4dc3-8286-a3e8dfb0ada7 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:52.673409 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829a2b0-d593-4dc3-8286-a3e8dfb0ada7 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:52.673508 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829a2b0-d593-4dc3-8286-a3e8dfb0ada7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:52.693510 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-2829a2b0-d593-4dc3-8286-a3e8dfb0ada7 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:14:52.694734 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2829a2b0-d593-4dc3-8286-a3e8dfb0ada7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:14:52.714768 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:14:52.754758 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1435/2854] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:14:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:14:52.762552 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266a595-5307-4106-aae0-0fca6213ba6f None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:52.762831 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266a595-5307-4106-aae0-0fca6213ba6f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:52.763099 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266a595-5307-4106-aae0-0fca6213ba6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:52.783002 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-c266a595-5307-4106-aae0-0fca6213ba6f None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:14:52.784196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c266a595-5307-4106-aae0-0fca6213ba6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:14:52.793590 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1420/2855] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:14:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:14:52.798001 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829a2b0-d593-4dc3-8286-a3e8dfb0ada7 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:52.808281 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829a2b0-d593-4dc3-8286-a3e8dfb0ada7 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:52.812813 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232ead0-fc46-4968-8465-aae3a96c7e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:52.813397 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232ead0-fc46-4968-8465-aae3a96c7e52 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:52.813678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232ead0-fc46-4968-8465-aae3a96c7e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:52.813983 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232ead0-fc46-4968-8465-aae3a96c7e52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:52.814616 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232ead0-fc46-4968-8465-aae3a96c7e52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:14:52.814933 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232ead0-fc46-4968-8465-aae3a96c7e52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:52.816490 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232ead0-fc46-4968-8465-aae3a96c7e52 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:52.827818 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1436/2856] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:14:52.832160 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266a595-5307-4106-aae0-0fca6213ba6f None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:52.841366 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266a595-5307-4106-aae0-0fca6213ba6f None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:52.846003 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1257a-8f10-4160-bef2-81663cee12c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:52.846588 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1257a-8f10-4160-bef2-81663cee12c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:52.846868 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1257a-8f10-4160-bef2-81663cee12c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:52.847138 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1257a-8f10-4160-bef2-81663cee12c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:52.847771 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1257a-8f10-4160-bef2-81663cee12c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:52.849675 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1257a-8f10-4160-bef2-81663cee12c4 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:52.877491 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1421/2857] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:14:52 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:14:52.882059 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232ead0-fc46-4968-8465-aae3a96c7e52 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:52.893536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232ead0-fc46-4968-8465-aae3a96c7e52 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:52.952652 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c9ef0-b912-416f-8e8f-3328a944a9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:52.953256 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c9ef0-b912-416f-8e8f-3328a944a9c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:52.953538 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c9ef0-b912-416f-8e8f-3328a944a9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:52.953830 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c9ef0-b912-416f-8e8f-3328a944a9c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:52.954478 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c9ef0-b912-416f-8e8f-3328a944a9c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:52.956389 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c9ef0-b912-416f-8e8f-3328a944a9c5 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:52.977849 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1437/2858] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:14:52 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:14:52.982117 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1257a-8f10-4160-bef2-81663cee12c4 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:52.992522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1257a-8f10-4160-bef2-81663cee12c4 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:52.998374 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768e650-ad87-4d66-8d6e-bc10cfe829df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:52.998968 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768e650-ad87-4d66-8d6e-bc10cfe829df admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:52.999246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768e650-ad87-4d66-8d6e-bc10cfe829df admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:52.999515 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768e650-ad87-4d66-8d6e-bc10cfe829df admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:53.000153 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768e650-ad87-4d66-8d6e-bc10cfe829df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:53.001741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768e650-ad87-4d66-8d6e-bc10cfe829df admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:53.011811 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1422/2859] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:14:53.015927 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c9ef0-b912-416f-8e8f-3328a944a9c5 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:53.026765 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c9ef0-b912-416f-8e8f-3328a944a9c5 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:53.031507 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5532584-0c15-4f46-a5be-f3ef5a81176b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:53.032110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5532584-0c15-4f46-a5be-f3ef5a81176b admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:53.032415 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5532584-0c15-4f46-a5be-f3ef5a81176b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:53.032689 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5532584-0c15-4f46-a5be-f3ef5a81176b admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:53.033321 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5532584-0c15-4f46-a5be-f3ef5a81176b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:53.034933 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5532584-0c15-4f46-a5be-f3ef5a81176b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:53.046028 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1438/2860] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:14:53.049988 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768e650-ad87-4d66-8d6e-bc10cfe829df admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:53.060397 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768e650-ad87-4d66-8d6e-bc10cfe829df admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:53.065134 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2c953-982f-4713-b0fc-54241095dd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:53.065766 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2c953-982f-4713-b0fc-54241095dd06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:53.066077 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2c953-982f-4713-b0fc-54241095dd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:53.066351 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2c953-982f-4713-b0fc-54241095dd06 admin admin] PATH_INFO: `/v3/projects/07dc37c1fa4c4be3a62253c059d67cf7/users/cf97418023744d319f3f242087e7adbd/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:53.080521 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2c953-982f-4713-b0fc-54241095dd06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07dc37c1fa4c4be3a62253c059d67cf7, user_id=cf97418023744d319f3f242087e7adbd, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:53.083192 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2c953-982f-4713-b0fc-54241095dd06 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:53.095768 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1423/2861] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:14:53 2022] PUT /identity/v3/projects/07dc37c1fa4c4be3a62253c059d67cf7/users/cf97418023744d319f3f242087e7adbd/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:14:53.106505 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9465e4c-0b0b-4a31-ac53-c02f781afeeb None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:53.106790 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9465e4c-0b0b-4a31-ac53-c02f781afeeb None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:53.107088 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9465e4c-0b0b-4a31-ac53-c02f781afeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:53.139617 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-f9465e4c-0b0b-4a31-ac53-c02f781afeeb None None] MFA Rules not processed for user `cf97418023744d319f3f242087e7adbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:14:53.141157 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f9465e4c-0b0b-4a31-ac53-c02f781afeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:14:53.207597 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1439/2862] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:14:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 01:14:53.219718 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2c953-982f-4713-b0fc-54241095dd06 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:14:53.221401 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-dba2c953-982f-4713-b0fc-54241095dd06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:14:53.278392 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2c953-982f-4713-b0fc-54241095dd06 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:14:53.281847 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c1bdf-10b9-4947-9157-f4fe672ee7d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee54ed3a092e4eef9082c4e86bd918a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:14:53.282439 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c1bdf-10b9-4947-9157-f4fe672ee7d6 service glance] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:14:53.282709 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c1bdf-10b9-4947-9157-f4fe672ee7d6 service glance] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:14:53.282972 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c1bdf-10b9-4947-9157-f4fe672ee7d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:14:53.291577 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c1bdf-10b9-4947-9157-f4fe672ee7d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:14:53.292976 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c1bdf-10b9-4947-9157-f4fe672ee7d6 service glance] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:14:53.301712 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1424/2863] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:14:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:15:03.204671 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=87,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:15:03.297793 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:DELETE=4,keystone:SELECT=60,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:15:06.698085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9465e4c-0b0b-4a31-ac53-c02f781afeeb None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:15:06.760063 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9465e4c-0b0b-4a31-ac53-c02f781afeeb None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:15:06.765132 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad492d4-1171-49ce-b628-0d37099b2736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:15:06.765757 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad492d4-1171-49ce-b628-0d37099b2736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:06.766071 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad492d4-1171-49ce-b628-0d37099b2736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:06.766345 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad492d4-1171-49ce-b628-0d37099b2736 admin admin] PATH_INFO: `/v3/users/cf97418023744d319f3f242087e7adbd` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:06.767459 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad492d4-1171-49ce-b628-0d37099b2736 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf97418023744d319f3f242087e7adbd)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:15:06.769364 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad492d4-1171-49ce-b628-0d37099b2736 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:15:06.816212 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4ad492d4-1171-49ce-b628-0d37099b2736 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf97418023744d319f3f242087e7adbd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:15:06.823194 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4ad492d4-1171-49ce-b628-0d37099b2736 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf97418023744d319f3f242087e7adbd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:15:06.835600 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4ad492d4-1171-49ce-b628-0d37099b2736 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf97418023744d319f3f242087e7adbd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:15:06.836499 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4ad492d4-1171-49ce-b628-0d37099b2736 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf97418023744d319f3f242087e7adbd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:15:06.837127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4ad492d4-1171-49ce-b628-0d37099b2736 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf97418023744d319f3f242087e7adbd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:15:06.849908 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1440/2864] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:15:06 2022] DELETE /identity/v3/users/cf97418023744d319f3f242087e7adbd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:15:06.854419 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63541b-f33e-4184-8ea5-8144dbfb0996 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:06.854977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63541b-f33e-4184-8ea5-8144dbfb0996 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:06.854977 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63541b-f33e-4184-8ea5-8144dbfb0996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:06.874141 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-4f63541b-f33e-4184-8ea5-8144dbfb0996 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:15:06.875343 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4f63541b-f33e-4184-8ea5-8144dbfb0996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:15:06.934426 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1425/2865] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:15:06.944281 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad492d4-1171-49ce-b628-0d37099b2736 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:15:06.945647 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4ad492d4-1171-49ce-b628-0d37099b2736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:15:07.004019 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad492d4-1171-49ce-b628-0d37099b2736 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:15:07.007657 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d80e0-9f1b-4e5f-a991-7fc6cb1fec7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:15:07.008288 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d80e0-9f1b-4e5f-a991-7fc6cb1fec7d service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:07.008586 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d80e0-9f1b-4e5f-a991-7fc6cb1fec7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:07.008857 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d80e0-9f1b-4e5f-a991-7fc6cb1fec7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:07.017791 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d80e0-9f1b-4e5f-a991-7fc6cb1fec7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:15:07.019342 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d80e0-9f1b-4e5f-a991-7fc6cb1fec7d service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:15:07.030039 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1441/2866] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:15:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:15:07.291816 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63541b-f33e-4184-8ea5-8144dbfb0996 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:15:07.293920 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4f63541b-f33e-4184-8ea5-8144dbfb0996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:15:07.306755 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63541b-f33e-4184-8ea5-8144dbfb0996 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:15:07.311466 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c763c7-0226-45bc-af1e-6181ef9ce0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:15:07.312166 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c763c7-0226-45bc-af1e-6181ef9ce0cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:07.312518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c763c7-0226-45bc-af1e-6181ef9ce0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:07.312797 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c763c7-0226-45bc-af1e-6181ef9ce0cf admin admin] PATH_INFO: `/v3/projects/07dc37c1fa4c4be3a62253c059d67cf7` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:07.313996 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c763c7-0226-45bc-af1e-6181ef9ce0cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=07dc37c1fa4c4be3a62253c059d67cf7)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:15:07.315825 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c763c7-0226-45bc-af1e-6181ef9ce0cf admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:15:07.362452 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-63c763c7-0226-45bc-af1e-6181ef9ce0cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07dc37c1fa4c4be3a62253c059d67cf7', 'request_id': 'req-63c763c7-0226-45bc-af1e-6181ef9ce0cf'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:15:07.370303 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-63c763c7-0226-45bc-af1e-6181ef9ce0cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07dc37c1fa4c4be3a62253c059d67cf7', 'request_id': 'req-63c763c7-0226-45bc-af1e-6181ef9ce0cf'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:15:07.376366 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-63c763c7-0226-45bc-af1e-6181ef9ce0cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07dc37c1fa4c4be3a62253c059d67cf7', 'request_id': 'req-63c763c7-0226-45bc-af1e-6181ef9ce0cf'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:15:07.386441 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-63c763c7-0226-45bc-af1e-6181ef9ce0cf admin admin] The token cache is being invalidate because project 07dc37c1fa4c4be3a62253c059d67cf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:15:07.386720 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-63c763c7-0226-45bc-af1e-6181ef9ce0cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:15:07.387327 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-63c763c7-0226-45bc-af1e-6181ef9ce0cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:15:07.388763 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1426/2867] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:15:07 2022] DELETE /identity/v3/projects/07dc37c1fa4c4be3a62253c059d67cf7 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:15:07.393687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b14c8-0ca5-407b-90ce-c7d0b3278044 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:07.394268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b14c8-0ca5-407b-90ce-c7d0b3278044 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:07.394544 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b14c8-0ca5-407b-90ce-c7d0b3278044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:07.414453 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-8c0b14c8-0ca5-407b-90ce-c7d0b3278044 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:15:07.415633 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8c0b14c8-0ca5-407b-90ce-c7d0b3278044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:15:07.432470 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:15:07.475219 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1442/2868] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:15:07.484982 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9d53b-930c-4271-9db9-81e93994d3a1 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:07.485263 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9d53b-930c-4271-9db9-81e93994d3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:07.485533 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9d53b-930c-4271-9db9-81e93994d3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:07.504621 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-b2c9d53b-930c-4271-9db9-81e93994d3a1 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:15:07.505830 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b2c9d53b-930c-4271-9db9-81e93994d3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:15:07.513410 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1427/2869] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:15:07.517558 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b14c8-0ca5-407b-90ce-c7d0b3278044 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:15:07.528323 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b14c8-0ca5-407b-90ce-c7d0b3278044 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:15:07.532826 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c788b3-3c50-43ad-a7ef-c77c6d4566c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:15:07.533416 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c788b3-3c50-43ad-a7ef-c77c6d4566c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:07.533698 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c788b3-3c50-43ad-a7ef-c77c6d4566c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:07.534117 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c788b3-3c50-43ad-a7ef-c77c6d4566c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:07.534756 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c788b3-3c50-43ad-a7ef-c77c6d4566c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:15:07.535058 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c788b3-3c50-43ad-a7ef-c77c6d4566c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:15:07.536627 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c788b3-3c50-43ad-a7ef-c77c6d4566c0 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:15:07.549475 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1443/2870] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:15:07.553695 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9d53b-930c-4271-9db9-81e93994d3a1 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:15:07.563003 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9d53b-930c-4271-9db9-81e93994d3a1 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:15:07.567618 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7a8c8-ad08-47d3-9b10-1029cca3ea53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:15:07.568202 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7a8c8-ad08-47d3-9b10-1029cca3ea53 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:07.568475 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7a8c8-ad08-47d3-9b10-1029cca3ea53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:07.568741 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7a8c8-ad08-47d3-9b10-1029cca3ea53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:07.569370 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7a8c8-ad08-47d3-9b10-1029cca3ea53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:15:07.571284 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7a8c8-ad08-47d3-9b10-1029cca3ea53 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:15:07.597884 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1428/2871] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:15:07 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:15:07.602109 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c788b3-3c50-43ad-a7ef-c77c6d4566c0 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:15:07.612460 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c788b3-3c50-43ad-a7ef-c77c6d4566c0 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:15:07.668506 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97713fa4-5d1b-4ec4-84a1-2c3e7ac9ce73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:15:07.669126 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97713fa4-5d1b-4ec4-84a1-2c3e7ac9ce73 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:07.669407 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97713fa4-5d1b-4ec4-84a1-2c3e7ac9ce73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:07.669678 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97713fa4-5d1b-4ec4-84a1-2c3e7ac9ce73 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:07.670339 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97713fa4-5d1b-4ec4-84a1-2c3e7ac9ce73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:15:07.672232 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97713fa4-5d1b-4ec4-84a1-2c3e7ac9ce73 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:15:07.692412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1444/2872] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:15:07 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:15:07.696522 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7a8c8-ad08-47d3-9b10-1029cca3ea53 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:15:07.707188 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7a8c8-ad08-47d3-9b10-1029cca3ea53 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:15:07.711736 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf228f15-53ab-4366-821e-0a4fdd97825c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:15:07.712321 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf228f15-53ab-4366-821e-0a4fdd97825c admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:07.712593 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf228f15-53ab-4366-821e-0a4fdd97825c admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:07.712863 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf228f15-53ab-4366-821e-0a4fdd97825c admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:07.713491 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf228f15-53ab-4366-821e-0a4fdd97825c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:15:07.715704 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf228f15-53ab-4366-821e-0a4fdd97825c admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:15:07.725421 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1429/2873] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:15:07.729100 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97713fa4-5d1b-4ec4-84a1-2c3e7ac9ce73 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:15:07.738862 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97713fa4-5d1b-4ec4-84a1-2c3e7ac9ce73 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:15:07.743620 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578a054-814d-4b43-b23b-908dbc8c94ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:15:07.744218 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578a054-814d-4b43-b23b-908dbc8c94ef admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:07.744499 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578a054-814d-4b43-b23b-908dbc8c94ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:07.744774 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578a054-814d-4b43-b23b-908dbc8c94ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:07.745411 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578a054-814d-4b43-b23b-908dbc8c94ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:15:07.747066 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578a054-814d-4b43-b23b-908dbc8c94ef admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:15:07.757976 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1445/2874] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 01:15:07.762601 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf228f15-53ab-4366-821e-0a4fdd97825c admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:15:07.772239 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf228f15-53ab-4366-821e-0a4fdd97825c admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:15:07.777632 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e8449-a03f-46f1-8716-0b5822ddf411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:15:07.778294 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e8449-a03f-46f1-8716-0b5822ddf411 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:07.778574 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e8449-a03f-46f1-8716-0b5822ddf411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:07.778842 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e8449-a03f-46f1-8716-0b5822ddf411 admin admin] PATH_INFO: `/v3/projects/39f047ac8634477cbb8d9486e8ee2d10/users/42cb818492fe4f249ed9900cf3697ff0/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:07.793069 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e8449-a03f-46f1-8716-0b5822ddf411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f047ac8634477cbb8d9486e8ee2d10, user_id=42cb818492fe4f249ed9900cf3697ff0, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:15:07.795730 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e8449-a03f-46f1-8716-0b5822ddf411 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:15:07.808787 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1430/2875] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:15:07 2022] PUT /identity/v3/projects/39f047ac8634477cbb8d9486e8ee2d10/users/42cb818492fe4f249ed9900cf3697ff0/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:15:07.819124 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f02fd-6275-4dbc-88a0-7f4c88d2f70c None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:07.819413 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f02fd-6275-4dbc-88a0-7f4c88d2f70c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:07.819686 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f02fd-6275-4dbc-88a0-7f4c88d2f70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:07.848427 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-766f02fd-6275-4dbc-88a0-7f4c88d2f70c None None] MFA Rules not processed for user `42cb818492fe4f249ed9900cf3697ff0`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:15:07.849624 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-766f02fd-6275-4dbc-88a0-7f4c88d2f70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:15:07.912684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1446/2876] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:15:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:15:07.923432 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e8449-a03f-46f1-8716-0b5822ddf411 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:15:07.925150 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1b3e8449-a03f-46f1-8716-0b5822ddf411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:15:07.946557 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:15:07.982528 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e8449-a03f-46f1-8716-0b5822ddf411 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:15:07.986054 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595f25b-2f06-43a4-8d00-b62d5184f912 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:15:07.986642 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595f25b-2f06-43a4-8d00-b62d5184f912 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:07.986913 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595f25b-2f06-43a4-8d00-b62d5184f912 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:07.987178 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595f25b-2f06-43a4-8d00-b62d5184f912 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:07.995424 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595f25b-2f06-43a4-8d00-b62d5184f912 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:15:07.996835 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595f25b-2f06-43a4-8d00-b62d5184f912 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:15:08.005652 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1431/2877] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:15:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:15:09.355351 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a13aad-7971-4af5-ab35-24e07ad8a7d2 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:09.355873 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a13aad-7971-4af5-ab35-24e07ad8a7d2 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:09.355978 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a13aad-7971-4af5-ab35-24e07ad8a7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:09.374663 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-64a13aad-7971-4af5-ab35-24e07ad8a7d2 None None] MFA Rules not processed for user `42cb818492fe4f249ed9900cf3697ff0`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:15:09.375866 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-64a13aad-7971-4af5-ab35-24e07ad8a7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:15:09.382662 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1447/2878] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:15:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:15:18.001615 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=17 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:15:19.369756 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:15:21.982692 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705659dc-8486-460c-99b3-daa2b227e913 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:21.983203 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705659dc-8486-460c-99b3-daa2b227e913 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:21.983329 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705659dc-8486-460c-99b3-daa2b227e913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:22.032250 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-705659dc-8486-460c-99b3-daa2b227e913 None None] MFA Rules not processed for user `eb9d1149a417436bbf1577d61407c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:15:22.033446 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-705659dc-8486-460c-99b3-daa2b227e913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:15:22.096080 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1432/2879] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 14 01:15:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:15:22.141745 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a13aad-7971-4af5-ab35-24e07ad8a7d2 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:15:22.143161 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-64a13aad-7971-4af5-ab35-24e07ad8a7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:15:22.231668 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a13aad-7971-4af5-ab35-24e07ad8a7d2 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:15:22.236598 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7566bd3-898e-4d3f-9164-a573e8accbd6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d05652bfe542d5a2cfa39fbf7a83c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:15:22.237192 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7566bd3-898e-4d3f-9164-a573e8accbd6 service swift] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:22.237469 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7566bd3-898e-4d3f-9164-a573e8accbd6 service swift] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:22.237738 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7566bd3-898e-4d3f-9164-a573e8accbd6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:22.245717 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7566bd3-898e-4d3f-9164-a573e8accbd6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:15:22.247927 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7566bd3-898e-4d3f-9164-a573e8accbd6 service swift] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:15:22.255683 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1448/2880] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 14 01:15:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 01:15:22.750185 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f808fa-36c1-42da-901f-9dadd448f47d None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:22.750494 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f808fa-36c1-42da-901f-9dadd448f47d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:22.750775 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f808fa-36c1-42da-901f-9dadd448f47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:22.770232 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-44f808fa-36c1-42da-901f-9dadd448f47d None None] MFA Rules not processed for user `eb9d1149a417436bbf1577d61407c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:15:22.771432 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-44f808fa-36c1-42da-901f-9dadd448f47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:15:22.779435 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1433/2881] 10.222.0.20 () {58 vars in 967 bytes} [Wed Sep 14 01:15:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:15:22.791426 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7566bd3-898e-4d3f-9164-a573e8accbd6 service swift] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:15:22.801845 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7566bd3-898e-4d3f-9164-a573e8accbd6 service swift] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:15:22.806734 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3f8d2-b334-4953-b1bb-62352e6bf10a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d05652bfe542d5a2cfa39fbf7a83c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:15:22.807317 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3f8d2-b334-4953-b1bb-62352e6bf10a service swift] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:22.807593 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3f8d2-b334-4953-b1bb-62352e6bf10a service swift] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:22.807864 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3f8d2-b334-4953-b1bb-62352e6bf10a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:22.815672 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3f8d2-b334-4953-b1bb-62352e6bf10a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:15:22.817224 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3f8d2-b334-4953-b1bb-62352e6bf10a service swift] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:15:22.825441 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1449/2882] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 14 01:15:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 01:15:23.052518 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9fce1-4d74-4a92-a5a0-1f8c6ad58a5c None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:23.052984 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9fce1-4d74-4a92-a5a0-1f8c6ad58a5c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:23.053083 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9fce1-4d74-4a92-a5a0-1f8c6ad58a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:23.073292 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-37b9fce1-4d74-4a92-a5a0-1f8c6ad58a5c None None] MFA Rules not processed for user `eb9d1149a417436bbf1577d61407c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:15:23.074512 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-37b9fce1-4d74-4a92-a5a0-1f8c6ad58a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:15:23.082191 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1434/2883] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 14 01:15:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:15:23.093877 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3f8d2-b334-4953-b1bb-62352e6bf10a service swift] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:15:23.104512 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3f8d2-b334-4953-b1bb-62352e6bf10a service swift] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:15:23.109581 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883ecc4-86f3-457e-900d-bf0eac26c844 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d05652bfe542d5a2cfa39fbf7a83c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:15:23.110157 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883ecc4-86f3-457e-900d-bf0eac26c844 service swift] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:23.110434 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883ecc4-86f3-457e-900d-bf0eac26c844 service swift] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:23.110703 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883ecc4-86f3-457e-900d-bf0eac26c844 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:23.118514 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883ecc4-86f3-457e-900d-bf0eac26c844 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:15:23.120070 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883ecc4-86f3-457e-900d-bf0eac26c844 service swift] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:15:23.128563 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1450/2884] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 14 01:15:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 01:15:23.443712 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec129d-282c-4946-baf7-058317e676c1 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:23.443991 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec129d-282c-4946-baf7-058317e676c1 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:23.444255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec129d-282c-4946-baf7-058317e676c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:23.462908 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-52ec129d-282c-4946-baf7-058317e676c1 None None] MFA Rules not processed for user `eb9d1149a417436bbf1577d61407c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:15:23.464096 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-52ec129d-282c-4946-baf7-058317e676c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:15:23.471286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1435/2885] 10.222.0.20 () {58 vars in 967 bytes} [Wed Sep 14 01:15:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:15:23.483684 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883ecc4-86f3-457e-900d-bf0eac26c844 service swift] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:15:23.494132 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883ecc4-86f3-457e-900d-bf0eac26c844 service swift] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:15:23.499779 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d60d60-d510-4d34-92ac-264b83f48243 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d05652bfe542d5a2cfa39fbf7a83c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:15:23.500364 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d60d60-d510-4d34-92ac-264b83f48243 service swift] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:23.500646 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d60d60-d510-4d34-92ac-264b83f48243 service swift] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:23.500917 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d60d60-d510-4d34-92ac-264b83f48243 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:23.508919 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d60d60-d510-4d34-92ac-264b83f48243 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:15:23.510521 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d60d60-d510-4d34-92ac-264b83f48243 service swift] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:15:23.518357 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1451/2886] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 14 01:15:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 01:15:25.654696 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec129d-282c-4946-baf7-058317e676c1 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:15:25.716313 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec129d-282c-4946-baf7-058317e676c1 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:15:25.720761 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eebc40-87b4-4745-939e-9d93e5310c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:15:25.721378 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eebc40-87b4-4745-939e-9d93e5310c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:25.721654 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eebc40-87b4-4745-939e-9d93e5310c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:25.721954 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eebc40-87b4-4745-939e-9d93e5310c3a admin admin] PATH_INFO: `/v3/users/42cb818492fe4f249ed9900cf3697ff0` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:25.723081 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eebc40-87b4-4745-939e-9d93e5310c3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=42cb818492fe4f249ed9900cf3697ff0)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:15:25.724994 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eebc40-87b4-4745-939e-9d93e5310c3a admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:15:25.771032 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-06eebc40-87b4-4745-939e-9d93e5310c3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42cb818492fe4f249ed9900cf3697ff0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:15:25.771707 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-06eebc40-87b4-4745-939e-9d93e5310c3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42cb818492fe4f249ed9900cf3697ff0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:15:25.777204 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:15:25.779566 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-06eebc40-87b4-4745-939e-9d93e5310c3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42cb818492fe4f249ed9900cf3697ff0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:15:25.792461 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-06eebc40-87b4-4745-939e-9d93e5310c3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42cb818492fe4f249ed9900cf3697ff0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:15:25.793091 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-06eebc40-87b4-4745-939e-9d93e5310c3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42cb818492fe4f249ed9900cf3697ff0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:15:25.807206 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1436/2887] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:15:25 2022] DELETE /identity/v3/users/42cb818492fe4f249ed9900cf3697ff0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:15:25.812258 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe6bba-b70c-4bad-a345-59e27274e952 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:25.812736 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe6bba-b70c-4bad-a345-59e27274e952 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:25.812840 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe6bba-b70c-4bad-a345-59e27274e952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:25.831547 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-2bbe6bba-b70c-4bad-a345-59e27274e952 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:15:25.832833 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2bbe6bba-b70c-4bad-a345-59e27274e952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:15:25.892635 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1452/2888] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:15:25.903260 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eebc40-87b4-4745-939e-9d93e5310c3a admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:15:25.904694 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-06eebc40-87b4-4745-939e-9d93e5310c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:15:25.961110 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eebc40-87b4-4745-939e-9d93e5310c3a admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:15:25.964664 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c55f92-aa35-4f7b-9d36-dd90ae13a2d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:15:25.965250 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c55f92-aa35-4f7b-9d36-dd90ae13a2d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:25.965521 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c55f92-aa35-4f7b-9d36-dd90ae13a2d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:25.966406 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c55f92-aa35-4f7b-9d36-dd90ae13a2d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:25.975073 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c55f92-aa35-4f7b-9d36-dd90ae13a2d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:15:25.976481 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c55f92-aa35-4f7b-9d36-dd90ae13a2d4 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:15:25.986348 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1437/2889] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:15:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:15:26.149084 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe6bba-b70c-4bad-a345-59e27274e952 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:15:26.150860 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2bbe6bba-b70c-4bad-a345-59e27274e952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:15:26.164456 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe6bba-b70c-4bad-a345-59e27274e952 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:15:26.169675 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e895a-db53-4eee-a3bc-6cb43f638720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:15:26.170709 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e895a-db53-4eee-a3bc-6cb43f638720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:26.170843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e895a-db53-4eee-a3bc-6cb43f638720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:26.171079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e895a-db53-4eee-a3bc-6cb43f638720 admin admin] PATH_INFO: `/v3/projects/39f047ac8634477cbb8d9486e8ee2d10` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:26.172221 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e895a-db53-4eee-a3bc-6cb43f638720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39f047ac8634477cbb8d9486e8ee2d10)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:15:26.174170 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e895a-db53-4eee-a3bc-6cb43f638720 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:15:26.205835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:15:26.226343 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d96e895a-db53-4eee-a3bc-6cb43f638720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39f047ac8634477cbb8d9486e8ee2d10', 'request_id': 'req-d96e895a-db53-4eee-a3bc-6cb43f638720'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:15:26.236555 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d96e895a-db53-4eee-a3bc-6cb43f638720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39f047ac8634477cbb8d9486e8ee2d10', 'request_id': 'req-d96e895a-db53-4eee-a3bc-6cb43f638720'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:15:26.244484 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d96e895a-db53-4eee-a3bc-6cb43f638720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39f047ac8634477cbb8d9486e8ee2d10', 'request_id': 'req-d96e895a-db53-4eee-a3bc-6cb43f638720'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:15:26.255110 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d96e895a-db53-4eee-a3bc-6cb43f638720 admin admin] The token cache is being invalidate because project 39f047ac8634477cbb8d9486e8ee2d10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:15:26.255414 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d96e895a-db53-4eee-a3bc-6cb43f638720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:15:26.256129 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d96e895a-db53-4eee-a3bc-6cb43f638720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:15:26.258767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1453/2890] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:15:26 2022] DELETE /identity/v3/projects/39f047ac8634477cbb8d9486e8ee2d10 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:15:26.265173 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e17e68-4592-4342-abd8-d3cd6e2d01b2 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:26.265453 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e17e68-4592-4342-abd8-d3cd6e2d01b2 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:26.265732 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e17e68-4592-4342-abd8-d3cd6e2d01b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:26.285574 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-a0e17e68-4592-4342-abd8-d3cd6e2d01b2 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:15:26.286797 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a0e17e68-4592-4342-abd8-d3cd6e2d01b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:15:26.343460 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1438/2891] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:15:26.350946 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6719cdb-74a1-4364-9ad7-62667935d98a None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:26.351228 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6719cdb-74a1-4364-9ad7-62667935d98a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:26.351497 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6719cdb-74a1-4364-9ad7-62667935d98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:26.371182 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-b6719cdb-74a1-4364-9ad7-62667935d98a None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:15:26.372407 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b6719cdb-74a1-4364-9ad7-62667935d98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:15:26.379970 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1454/2892] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:15:26.383955 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e17e68-4592-4342-abd8-d3cd6e2d01b2 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:15:26.394018 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e17e68-4592-4342-abd8-d3cd6e2d01b2 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:15:26.398606 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403dc75e-74e5-4574-ab59-5b49d0959895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:15:26.399136 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dc75e-74e5-4574-ab59-5b49d0959895 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:26.399413 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dc75e-74e5-4574-ab59-5b49d0959895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:26.399684 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dc75e-74e5-4574-ab59-5b49d0959895 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:26.400319 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403dc75e-74e5-4574-ab59-5b49d0959895 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:15:26.400880 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403dc75e-74e5-4574-ab59-5b49d0959895 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:15:26.402505 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403dc75e-74e5-4574-ab59-5b49d0959895 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:15:26.414486 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1439/2893] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:15:26.418625 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6719cdb-74a1-4364-9ad7-62667935d98a None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:15:26.427750 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6719cdb-74a1-4364-9ad7-62667935d98a None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:15:26.432314 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99f6f2-2d93-4263-87a4-5d7e9ad6b9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:15:26.432894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99f6f2-2d93-4263-87a4-5d7e9ad6b9ba admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:26.433202 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99f6f2-2d93-4263-87a4-5d7e9ad6b9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:26.433474 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99f6f2-2d93-4263-87a4-5d7e9ad6b9ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:26.434130 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99f6f2-2d93-4263-87a4-5d7e9ad6b9ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:15:26.436037 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99f6f2-2d93-4263-87a4-5d7e9ad6b9ba admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:15:26.462809 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1455/2894] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:15:26 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:15:26.467167 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403dc75e-74e5-4574-ab59-5b49d0959895 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:15:26.476861 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403dc75e-74e5-4574-ab59-5b49d0959895 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:15:26.531909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c23595-f506-47b3-8946-ac08166ee893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:15:26.532494 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c23595-f506-47b3-8946-ac08166ee893 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:26.532770 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c23595-f506-47b3-8946-ac08166ee893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:26.533062 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c23595-f506-47b3-8946-ac08166ee893 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:26.533718 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c23595-f506-47b3-8946-ac08166ee893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:15:26.535655 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c23595-f506-47b3-8946-ac08166ee893 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:15:26.546240 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:15:26.559832 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1440/2895] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:15:26 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:15:26.564387 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99f6f2-2d93-4263-87a4-5d7e9ad6b9ba admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:15:26.575747 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99f6f2-2d93-4263-87a4-5d7e9ad6b9ba admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:15:26.580577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f39e4-e327-4f86-9ac0-2597db54a101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:15:26.581174 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f39e4-e327-4f86-9ac0-2597db54a101 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:26.581454 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f39e4-e327-4f86-9ac0-2597db54a101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:26.581726 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f39e4-e327-4f86-9ac0-2597db54a101 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:26.582457 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f39e4-e327-4f86-9ac0-2597db54a101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:15:26.584068 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f39e4-e327-4f86-9ac0-2597db54a101 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:15:26.594656 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1456/2896] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 01:15:26.598734 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c23595-f506-47b3-8946-ac08166ee893 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:15:26.608467 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c23595-f506-47b3-8946-ac08166ee893 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:15:26.612956 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57bffa1-94c9-46b4-82a8-d4d2abe768ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:15:26.613534 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bffa1-94c9-46b4-82a8-d4d2abe768ed admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:26.613833 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bffa1-94c9-46b4-82a8-d4d2abe768ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:26.614100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bffa1-94c9-46b4-82a8-d4d2abe768ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:26.614728 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57bffa1-94c9-46b4-82a8-d4d2abe768ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:15:26.616298 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57bffa1-94c9-46b4-82a8-d4d2abe768ed admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:15:26.626617 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1441/2897] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:15:26.630513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f39e4-e327-4f86-9ac0-2597db54a101 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:15:26.640842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f39e4-e327-4f86-9ac0-2597db54a101 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:15:26.645412 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea14c50-941e-452f-8572-2ca9982b819d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:15:26.646079 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea14c50-941e-452f-8572-2ca9982b819d admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:26.646361 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea14c50-941e-452f-8572-2ca9982b819d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:26.646635 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea14c50-941e-452f-8572-2ca9982b819d admin admin] PATH_INFO: `/v3/projects/b5e00099aecd4bd798b292898ab8017d/users/8fc1452bc4fb474c863f7383792ea8e3/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:26.661746 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea14c50-941e-452f-8572-2ca9982b819d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5e00099aecd4bd798b292898ab8017d, user_id=8fc1452bc4fb474c863f7383792ea8e3, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:15:26.664360 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea14c50-941e-452f-8572-2ca9982b819d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:15:26.676702 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1457/2898] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:15:26 2022] PUT /identity/v3/projects/b5e00099aecd4bd798b292898ab8017d/users/8fc1452bc4fb474c863f7383792ea8e3/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:15:26.681677 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d0446-81a0-4ea0-b47b-5b2e15f7e886 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:26.682190 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d0446-81a0-4ea0-b47b-5b2e15f7e886 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:26.682392 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d0446-81a0-4ea0-b47b-5b2e15f7e886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:26.702557 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-704d0446-81a0-4ea0-b47b-5b2e15f7e886 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:15:26.703802 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-704d0446-81a0-4ea0-b47b-5b2e15f7e886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:15:26.769667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1442/2899] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:15:26.780403 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea14c50-941e-452f-8572-2ca9982b819d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:15:26.782279 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1ea14c50-941e-452f-8572-2ca9982b819d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:15:26.841745 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea14c50-941e-452f-8572-2ca9982b819d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:15:26.845451 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a43ea-e31f-45a1-b9fc-d9de209d667b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:15:26.846088 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a43ea-e31f-45a1-b9fc-d9de209d667b service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:26.846370 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a43ea-e31f-45a1-b9fc-d9de209d667b service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:26.846644 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a43ea-e31f-45a1-b9fc-d9de209d667b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:26.855537 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a43ea-e31f-45a1-b9fc-d9de209d667b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:15:26.856959 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a43ea-e31f-45a1-b9fc-d9de209d667b service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:15:26.866453 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1458/2900] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:15:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:15:27.488490 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9c260-04b4-4cd7-b224-b399e24d76af None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:27.488777 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9c260-04b4-4cd7-b224-b399e24d76af None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:27.489053 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9c260-04b4-4cd7-b224-b399e24d76af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:27.516858 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-8dd9c260-04b4-4cd7-b224-b399e24d76af None None] MFA Rules not processed for user `8fc1452bc4fb474c863f7383792ea8e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:15:27.518002 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8dd9c260-04b4-4cd7-b224-b399e24d76af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:15:27.586909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1443/2901] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:15:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:15:27.597683 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a43ea-e31f-45a1-b9fc-d9de209d667b service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:15:27.599102 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2e5a43ea-e31f-45a1-b9fc-d9de209d667b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:15:27.659032 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a43ea-e31f-45a1-b9fc-d9de209d667b service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:15:27.662729 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5b1cc-2f81-4fb0-a7fa-9e9d9eb6265a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:15:27.663953 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5b1cc-2f81-4fb0-a7fa-9e9d9eb6265a service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:27.664237 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5b1cc-2f81-4fb0-a7fa-9e9d9eb6265a service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:27.664510 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5b1cc-2f81-4fb0-a7fa-9e9d9eb6265a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:27.671753 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:15:27.674181 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5b1cc-2f81-4fb0-a7fa-9e9d9eb6265a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:15:27.676088 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5b1cc-2f81-4fb0-a7fa-9e9d9eb6265a service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:15:27.686181 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1459/2902] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:15:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:15:29.039286 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0a586-3a2b-4556-9722-29c4c3250fdf None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:29.039762 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0a586-3a2b-4556-9722-29c4c3250fdf None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:29.039886 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0a586-3a2b-4556-9722-29c4c3250fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:29.058199 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-77e0a586-3a2b-4556-9722-29c4c3250fdf None None] MFA Rules not processed for user `8fc1452bc4fb474c863f7383792ea8e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:15:29.059883 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-77e0a586-3a2b-4556-9722-29c4c3250fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:15:29.066510 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1444/2903] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:15:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:15:37.686903 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:15:39.052896 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:INSERT=2,keystone:SELECT=69 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:15:53.016876 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac052d6-fab2-47bd-b766-35f2ea7281eb None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:53.017335 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac052d6-fab2-47bd-b766-35f2ea7281eb None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:53.017450 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac052d6-fab2-47bd-b766-35f2ea7281eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:53.038033 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-dac052d6-fab2-47bd-b766-35f2ea7281eb None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:15:53.039327 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-dac052d6-fab2-47bd-b766-35f2ea7281eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:15:53.047241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1460/2904] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 14 01:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:15:53.064667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0a586-3a2b-4556-9722-29c4c3250fdf None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:15:53.066116 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-77e0a586-3a2b-4556-9722-29c4c3250fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:15:53.138477 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0a586-3a2b-4556-9722-29c4c3250fdf None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:15:53.144413 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780650f-c24d-4a5b-b0d8-2e15be11a242 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:15:53.144944 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780650f-c24d-4a5b-b0d8-2e15be11a242 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:53.145219 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780650f-c24d-4a5b-b0d8-2e15be11a242 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:53.145488 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780650f-c24d-4a5b-b0d8-2e15be11a242 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:53.153763 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780650f-c24d-4a5b-b0d8-2e15be11a242 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:15:53.155417 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780650f-c24d-4a5b-b0d8-2e15be11a242 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:15:53.165100 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1445/2905] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:15:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:15:56.054005 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0aff3-0760-4d95-9f49-9d4a92f75b16 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:56.054589 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0aff3-0760-4d95-9f49-9d4a92f75b16 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:56.054589 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0aff3-0760-4d95-9f49-9d4a92f75b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:56.073977 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-01c0aff3-0760-4d95-9f49-9d4a92f75b16 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:15:56.075170 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-01c0aff3-0760-4d95-9f49-9d4a92f75b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:15:56.082876 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1461/2906] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 14 01:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:15:56.097123 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780650f-c24d-4a5b-b0d8-2e15be11a242 service nova] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:15:56.098547 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e780650f-c24d-4a5b-b0d8-2e15be11a242 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:15:56.113137 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780650f-c24d-4a5b-b0d8-2e15be11a242 service nova] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:15:56.118728 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae5476-db5f-4a3a-be9d-f9b9811d40df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:15:56.119311 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae5476-db5f-4a3a-be9d-f9b9811d40df service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:56.119587 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae5476-db5f-4a3a-be9d-f9b9811d40df service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:56.119856 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae5476-db5f-4a3a-be9d-f9b9811d40df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:56.128653 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae5476-db5f-4a3a-be9d-f9b9811d40df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:15:56.130246 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae5476-db5f-4a3a-be9d-f9b9811d40df service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:15:56.139377 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1446/2907] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:15:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:15:59.306506 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b3ba6-c1d5-4f28-8426-2d44ae00b3e5 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:59.307064 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b3ba6-c1d5-4f28-8426-2d44ae00b3e5 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:59.307064 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b3ba6-c1d5-4f28-8426-2d44ae00b3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:59.326378 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-1e4b3ba6-c1d5-4f28-8426-2d44ae00b3e5 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:15:59.327572 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1e4b3ba6-c1d5-4f28-8426-2d44ae00b3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:15:59.335957 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1462/2908] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 14 01:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:15:59.349552 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae5476-db5f-4a3a-be9d-f9b9811d40df service nova] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:15:59.360455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae5476-db5f-4a3a-be9d-f9b9811d40df service nova] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:15:59.365743 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef49aa7-1df2-45ef-ae32-f8729eb9a4e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:15:59.366342 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef49aa7-1df2-45ef-ae32-f8729eb9a4e1 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:15:59.366617 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef49aa7-1df2-45ef-ae32-f8729eb9a4e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:15:59.366881 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef49aa7-1df2-45ef-ae32-f8729eb9a4e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:15:59.374667 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef49aa7-1df2-45ef-ae32-f8729eb9a4e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:15:59.376708 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef49aa7-1df2-45ef-ae32-f8729eb9a4e1 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:15:59.385961 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1447/2909] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:15:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:16:02.402842 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a0eb8-fa4f-4b84-b031-fac9349a3921 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:16:02.403287 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a0eb8-fa4f-4b84-b031-fac9349a3921 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:16:02.403403 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a0eb8-fa4f-4b84-b031-fac9349a3921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:16:02.422655 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-c99a0eb8-fa4f-4b84-b031-fac9349a3921 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:16:02.423843 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c99a0eb8-fa4f-4b84-b031-fac9349a3921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:16:02.431428 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1463/2910] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 14 01:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:16:02.447092 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef49aa7-1df2-45ef-ae32-f8729eb9a4e1 service nova] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:16:02.458819 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef49aa7-1df2-45ef-ae32-f8729eb9a4e1 service nova] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:16:02.464182 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9bc23-d0aa-4adc-9753-cebfe756c1c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:16:02.464758 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9bc23-d0aa-4adc-9753-cebfe756c1c2 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:16:02.465034 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9bc23-d0aa-4adc-9753-cebfe756c1c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:16:02.465304 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9bc23-d0aa-4adc-9753-cebfe756c1c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:16:02.473175 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9bc23-d0aa-4adc-9753-cebfe756c1c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:16:02.474764 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9bc23-d0aa-4adc-9753-cebfe756c1c2 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:16:02.483869 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1448/2911] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:16:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:16:05.568595 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09849a8-b7f9-47b9-b1a9-af9ffe67b334 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:16:05.569062 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09849a8-b7f9-47b9-b1a9-af9ffe67b334 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:16:05.569179 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09849a8-b7f9-47b9-b1a9-af9ffe67b334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:16:05.588884 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-b09849a8-b7f9-47b9-b1a9-af9ffe67b334 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:16:05.590127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b09849a8-b7f9-47b9-b1a9-af9ffe67b334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:16:05.598054 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1464/2912] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 14 01:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:16:05.617159 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9bc23-d0aa-4adc-9753-cebfe756c1c2 service nova] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:16:05.628897 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9bc23-d0aa-4adc-9753-cebfe756c1c2 service nova] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:16:05.634332 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50c9af-9226-416c-bc57-22208a1db245 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:16:05.634926 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50c9af-9226-416c-bc57-22208a1db245 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:16:05.635207 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50c9af-9226-416c-bc57-22208a1db245 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:16:05.635479 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50c9af-9226-416c-bc57-22208a1db245 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:16:05.644330 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50c9af-9226-416c-bc57-22208a1db245 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:16:05.645924 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50c9af-9226-416c-bc57-22208a1db245 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:16:05.655401 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1449/2913] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:16:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:16:08.730002 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a273e-fe3f-408f-953a-ce8f917901c8 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:16:08.730520 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a273e-fe3f-408f-953a-ce8f917901c8 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:16:08.730642 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a273e-fe3f-408f-953a-ce8f917901c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:16:08.751060 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-2f6a273e-fe3f-408f-953a-ce8f917901c8 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:16:08.752866 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2f6a273e-fe3f-408f-953a-ce8f917901c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:16:08.760709 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1465/2914] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 14 01:16:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:16:08.776755 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50c9af-9226-416c-bc57-22208a1db245 service nova] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:16:08.787872 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50c9af-9226-416c-bc57-22208a1db245 service nova] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:16:08.793210 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3126d-6acf-4dbe-aeec-4ee207591237 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:16:08.793785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3126d-6acf-4dbe-aeec-4ee207591237 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:16:08.794089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3126d-6acf-4dbe-aeec-4ee207591237 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:16:08.794357 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3126d-6acf-4dbe-aeec-4ee207591237 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:16:08.803256 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d3126d-6acf-4dbe-aeec-4ee207591237 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:16:08.804855 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d3126d-6acf-4dbe-aeec-4ee207591237 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:16:08.814807 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1450/2915] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:16:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:16:18.746230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=18 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:16:18.810040 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=64 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:16:18.994601 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a273e-fe3f-408f-953a-ce8f917901c8 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:16:19.007933 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a273e-fe3f-408f-953a-ce8f917901c8 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:16:19.013658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddebc8e-82e6-43a8-850f-1850df32356f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:16:19.014339 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddebc8e-82e6-43a8-850f-1850df32356f service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:16:19.014608 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddebc8e-82e6-43a8-850f-1850df32356f service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:16:19.014973 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddebc8e-82e6-43a8-850f-1850df32356f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:16:19.016618 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7ddebc8e-82e6-43a8-850f-1850df32356f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:16:19.039559 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddebc8e-82e6-43a8-850f-1850df32356f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:16:19.041155 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddebc8e-82e6-43a8-850f-1850df32356f service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:16:19.052115 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1466/2916] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:16:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:16:23.997594 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb9a9e-cb0d-43d2-afcc-73507f1bbfc0 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:16:23.998124 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb9a9e-cb0d-43d2-afcc-73507f1bbfc0 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:16:23.998288 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb9a9e-cb0d-43d2-afcc-73507f1bbfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:16:24.018102 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-88eb9a9e-cb0d-43d2-afcc-73507f1bbfc0 None None] MFA Rules not processed for user `8fc1452bc4fb474c863f7383792ea8e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:16:24.019279 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-88eb9a9e-cb0d-43d2-afcc-73507f1bbfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:16:24.026582 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1451/2917] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:16:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:16:24.247298 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddebc8e-82e6-43a8-850f-1850df32356f service nova] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:16:24.248709 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7ddebc8e-82e6-43a8-850f-1850df32356f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:16:24.259890 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddebc8e-82e6-43a8-850f-1850df32356f service nova] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:16:24.263387 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ec3bc-9d8e-4ce2-9f41-e16d546e7ced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:16:24.263969 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ec3bc-9d8e-4ce2-9f41-e16d546e7ced service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:16:24.264244 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ec3bc-9d8e-4ce2-9f41-e16d546e7ced service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:16:24.264509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ec3bc-9d8e-4ce2-9f41-e16d546e7ced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:16:24.266152 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2d1ec3bc-9d8e-4ce2-9f41-e16d546e7ced service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:16:24.275924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ec3bc-9d8e-4ce2-9f41-e16d546e7ced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:16:24.277329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ec3bc-9d8e-4ce2-9f41-e16d546e7ced service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:16:24.285670 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1467/2918] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:16:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:16:24.600785 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb9a9e-cb0d-43d2-afcc-73507f1bbfc0 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:16:24.602189 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-88eb9a9e-cb0d-43d2-afcc-73507f1bbfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:16:24.671038 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb9a9e-cb0d-43d2-afcc-73507f1bbfc0 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:16:24.676873 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f405f8-d4a0-45cf-91c6-672d2961d0cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abf9ab5fafe94afdb3ebe98536b5cc3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:16:24.677519 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f405f8-d4a0-45cf-91c6-672d2961d0cb service placement] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:16:24.677814 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f405f8-d4a0-45cf-91c6-672d2961d0cb service placement] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:16:24.678089 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f405f8-d4a0-45cf-91c6-672d2961d0cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:16:24.679756 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-18f405f8-d4a0-45cf-91c6-672d2961d0cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:16:24.691507 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f405f8-d4a0-45cf-91c6-672d2961d0cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:16:24.693058 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f405f8-d4a0-45cf-91c6-672d2961d0cb service placement] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:16:24.702902 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1452/2919] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:16:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:16:26.303010 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ec3bc-9d8e-4ce2-9f41-e16d546e7ced service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:16:26.311970 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ec3bc-9d8e-4ce2-9f41-e16d546e7ced service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:16:26.316683 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42160bf-c3ac-4b6a-94c1-164910ea11da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:16:26.317391 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42160bf-c3ac-4b6a-94c1-164910ea11da service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:16:26.317665 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42160bf-c3ac-4b6a-94c1-164910ea11da service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:16:26.318040 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42160bf-c3ac-4b6a-94c1-164910ea11da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:16:26.319738 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f42160bf-c3ac-4b6a-94c1-164910ea11da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:16:26.329928 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42160bf-c3ac-4b6a-94c1-164910ea11da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:16:26.331335 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42160bf-c3ac-4b6a-94c1-164910ea11da service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:16:26.339129 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1468/2920] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:16:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:16:31.828180 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f405f8-d4a0-45cf-91c6-672d2961d0cb service placement] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:16:31.843203 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f405f8-d4a0-45cf-91c6-672d2961d0cb service placement] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:16:31.849137 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b6f2c-813a-4106-802c-af20fcc3daf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:16:31.849732 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b6f2c-813a-4106-802c-af20fcc3daf4 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:16:31.850033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b6f2c-813a-4106-802c-af20fcc3daf4 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:16:31.850314 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b6f2c-813a-4106-802c-af20fcc3daf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:16:31.851996 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-860b6f2c-813a-4106-802c-af20fcc3daf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:16:31.864624 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b6f2c-813a-4106-802c-af20fcc3daf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:16:31.866208 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b6f2c-813a-4106-802c-af20fcc3daf4 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:16:31.877440 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1453/2921] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:16:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:16:35.696960 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942acb6-7bf1-49c0-ae43-82d59d6dc8da None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:16:35.697509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942acb6-7bf1-49c0-ae43-82d59d6dc8da None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:16:35.697509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942acb6-7bf1-49c0-ae43-82d59d6dc8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:16:35.718835 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-3942acb6-7bf1-49c0-ae43-82d59d6dc8da None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:16:35.720634 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3942acb6-7bf1-49c0-ae43-82d59d6dc8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:16:35.729006 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1469/2922] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 14 01:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:16:35.744105 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b6f2c-813a-4106-802c-af20fcc3daf4 service nova] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:16:35.755340 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b6f2c-813a-4106-802c-af20fcc3daf4 service nova] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:16:35.760777 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a839f5-933b-4bad-81e2-b32a66362e36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:16:35.761354 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a839f5-933b-4bad-81e2-b32a66362e36 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:16:35.761631 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a839f5-933b-4bad-81e2-b32a66362e36 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:16:35.761928 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a839f5-933b-4bad-81e2-b32a66362e36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:16:35.770005 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a839f5-933b-4bad-81e2-b32a66362e36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:16:35.771565 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a839f5-933b-4bad-81e2-b32a66362e36 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:16:35.781052 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1454/2923] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:16:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:16:38.978292 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1c297-42e3-4df5-86f5-659c2d0a8ea4 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:16:38.978839 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1c297-42e3-4df5-86f5-659c2d0a8ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:16:38.978950 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1c297-42e3-4df5-86f5-659c2d0a8ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:16:39.002752 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-6bc1c297-42e3-4df5-86f5-659c2d0a8ea4 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:16:39.004018 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6bc1c297-42e3-4df5-86f5-659c2d0a8ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:16:39.011687 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1470/2924] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 14 01:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:16:39.028805 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a839f5-933b-4bad-81e2-b32a66362e36 service nova] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:16:39.040503 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a839f5-933b-4bad-81e2-b32a66362e36 service nova] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:16:39.046060 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902d2d1-07c6-44a7-a608-c2410b27e119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:16:39.046637 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902d2d1-07c6-44a7-a608-c2410b27e119 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:16:39.046913 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902d2d1-07c6-44a7-a608-c2410b27e119 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:16:39.047177 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902d2d1-07c6-44a7-a608-c2410b27e119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:16:39.055903 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902d2d1-07c6-44a7-a608-c2410b27e119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:16:39.057449 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902d2d1-07c6-44a7-a608-c2410b27e119 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:16:39.066590 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1455/2925] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:16:42.055949 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ccc38-1a2f-46f7-9968-cd617674b7aa None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:16:42.056452 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ccc38-1a2f-46f7-9968-cd617674b7aa None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:16:42.056570 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ccc38-1a2f-46f7-9968-cd617674b7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:16:42.075767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ca7ccc38-1a2f-46f7-9968-cd617674b7aa None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:16:42.076939 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ca7ccc38-1a2f-46f7-9968-cd617674b7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:16:42.084658 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1471/2926] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 14 01:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:16:42.099918 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902d2d1-07c6-44a7-a608-c2410b27e119 service nova] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:16:42.111705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902d2d1-07c6-44a7-a608-c2410b27e119 service nova] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:16:42.116998 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ba892-21ee-43f5-8520-94751aa1be44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:16:42.117574 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ba892-21ee-43f5-8520-94751aa1be44 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:16:42.117873 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ba892-21ee-43f5-8520-94751aa1be44 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:16:42.118142 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ba892-21ee-43f5-8520-94751aa1be44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:16:42.125996 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ba892-21ee-43f5-8520-94751aa1be44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:16:42.127540 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ba892-21ee-43f5-8520-94751aa1be44 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:16:42.136634 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1456/2927] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:16:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:16:45.215873 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906360eb-1ff1-4cdf-a4d9-e1dd5a279a06 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:16:45.216375 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906360eb-1ff1-4cdf-a4d9-e1dd5a279a06 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:16:45.216480 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906360eb-1ff1-4cdf-a4d9-e1dd5a279a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:16:45.235993 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-906360eb-1ff1-4cdf-a4d9-e1dd5a279a06 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:16:45.237181 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-906360eb-1ff1-4cdf-a4d9-e1dd5a279a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:16:45.244886 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1472/2928] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 14 01:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:16:45.261016 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ba892-21ee-43f5-8520-94751aa1be44 service nova] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:16:45.272030 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ba892-21ee-43f5-8520-94751aa1be44 service nova] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:16:45.278047 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa104ba-58eb-4277-a327-580a70daf4b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:16:45.278632 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa104ba-58eb-4277-a327-580a70daf4b8 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:16:45.278909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa104ba-58eb-4277-a327-580a70daf4b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:16:45.279179 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa104ba-58eb-4277-a327-580a70daf4b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:16:45.287273 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa104ba-58eb-4277-a327-580a70daf4b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:16:45.288825 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa104ba-58eb-4277-a327-580a70daf4b8 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:16:45.298552 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1457/2929] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:16:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:16:48.370265 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f8636-abc1-4a29-8370-60dcf1eade83 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:16:48.370767 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f8636-abc1-4a29-8370-60dcf1eade83 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:16:48.370874 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f8636-abc1-4a29-8370-60dcf1eade83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:16:48.390311 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-b88f8636-abc1-4a29-8370-60dcf1eade83 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:16:48.391488 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b88f8636-abc1-4a29-8370-60dcf1eade83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:16:48.399365 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1473/2930] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 14 01:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:16:48.416148 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa104ba-58eb-4277-a327-580a70daf4b8 service nova] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:16:48.427565 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa104ba-58eb-4277-a327-580a70daf4b8 service nova] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:16:48.432815 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf688500-01e4-4de1-8e5b-7947149adc19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05caac9e8b9498583780306887734be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:16:48.433389 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf688500-01e4-4de1-8e5b-7947149adc19 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:16:48.433663 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf688500-01e4-4de1-8e5b-7947149adc19 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:16:48.433966 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf688500-01e4-4de1-8e5b-7947149adc19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:16:48.442498 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf688500-01e4-4de1-8e5b-7947149adc19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:16:48.444041 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf688500-01e4-4de1-8e5b-7947149adc19 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:16:48.453113 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1458/2931] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:16:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:16:58.385623 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=33 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:16:58.449029 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=71 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:17:16.382701 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f8636-abc1-4a29-8370-60dcf1eade83 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:17:16.394885 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f8636-abc1-4a29-8370-60dcf1eade83 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:17:16.399936 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9159a-0732-4202-85cb-6d0cdea16db4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abf9ab5fafe94afdb3ebe98536b5cc3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:17:16.400536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9159a-0732-4202-85cb-6d0cdea16db4 service placement] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:17:16.401084 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9159a-0732-4202-85cb-6d0cdea16db4 service placement] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:17:16.401353 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9159a-0732-4202-85cb-6d0cdea16db4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:17:16.403027 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c8b9159a-0732-4202-85cb-6d0cdea16db4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:17:16.414399 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9159a-0732-4202-85cb-6d0cdea16db4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:17:16.415968 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9159a-0732-4202-85cb-6d0cdea16db4 service placement] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:17:16.425980 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1474/2932] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:17:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:17:16.448420 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf688500-01e4-4de1-8e5b-7947149adc19 service nova] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:17:16.460147 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf688500-01e4-4de1-8e5b-7947149adc19 service nova] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:17:16.468807 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77abcb-e7af-446b-8108-f220a8634b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:17:16.469429 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77abcb-e7af-446b-8108-f220a8634b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:17:16.469705 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77abcb-e7af-446b-8108-f220a8634b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:17:16.470198 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77abcb-e7af-446b-8108-f220a8634b6a admin admin] PATH_INFO: `/v3/users/8fc1452bc4fb474c863f7383792ea8e3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:17:16.471954 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77abcb-e7af-446b-8108-f220a8634b6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fc1452bc4fb474c863f7383792ea8e3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:17:16.474056 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77abcb-e7af-446b-8108-f220a8634b6a admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:17:16.519965 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-0a77abcb-e7af-446b-8108-f220a8634b6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fc1452bc4fb474c863f7383792ea8e3'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:17:16.520613 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-0a77abcb-e7af-446b-8108-f220a8634b6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fc1452bc4fb474c863f7383792ea8e3'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:17:16.527623 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-0a77abcb-e7af-446b-8108-f220a8634b6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fc1452bc4fb474c863f7383792ea8e3'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:17:16.539365 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-0a77abcb-e7af-446b-8108-f220a8634b6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fc1452bc4fb474c863f7383792ea8e3'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:17:16.539992 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-0a77abcb-e7af-446b-8108-f220a8634b6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fc1452bc4fb474c863f7383792ea8e3'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:17:16.551931 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1459/2933] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:17:16 2022] DELETE /identity/v3/users/8fc1452bc4fb474c863f7383792ea8e3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:17:16.721876 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9159a-0732-4202-85cb-6d0cdea16db4 service placement] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:17:16.734018 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9159a-0732-4202-85cb-6d0cdea16db4 service placement] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:17:16.794669 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1994f-25b1-4b91-a6a9-9d9f4569d4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:17:16.795300 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1994f-25b1-4b91-a6a9-9d9f4569d4b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:17:16.795577 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1994f-25b1-4b91-a6a9-9d9f4569d4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:17:16.795846 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1994f-25b1-4b91-a6a9-9d9f4569d4b7 admin admin] PATH_INFO: `/v3/projects/b5e00099aecd4bd798b292898ab8017d` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:17:16.796948 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1994f-25b1-4b91-a6a9-9d9f4569d4b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5e00099aecd4bd798b292898ab8017d)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:17:16.799440 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1994f-25b1-4b91-a6a9-9d9f4569d4b7 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:17:16.846801 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-83b1994f-25b1-4b91-a6a9-9d9f4569d4b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5e00099aecd4bd798b292898ab8017d', 'request_id': 'req-83b1994f-25b1-4b91-a6a9-9d9f4569d4b7'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:17:16.853549 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-83b1994f-25b1-4b91-a6a9-9d9f4569d4b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5e00099aecd4bd798b292898ab8017d', 'request_id': 'req-83b1994f-25b1-4b91-a6a9-9d9f4569d4b7'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:17:16.859950 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-83b1994f-25b1-4b91-a6a9-9d9f4569d4b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5e00099aecd4bd798b292898ab8017d', 'request_id': 'req-83b1994f-25b1-4b91-a6a9-9d9f4569d4b7'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:17:16.870329 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-83b1994f-25b1-4b91-a6a9-9d9f4569d4b7 admin admin] The token cache is being invalidate because project b5e00099aecd4bd798b292898ab8017d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:17:16.870617 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-83b1994f-25b1-4b91-a6a9-9d9f4569d4b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:17:16.871241 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-83b1994f-25b1-4b91-a6a9-9d9f4569d4b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:17:16.872716 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1475/2934] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:17:16 2022] DELETE /identity/v3/projects/b5e00099aecd4bd798b292898ab8017d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:17:16.877729 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469d711-fcf2-41c8-9ee7-2cc174a58a93 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:17:16.878039 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469d711-fcf2-41c8-9ee7-2cc174a58a93 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:17:16.878312 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469d711-fcf2-41c8-9ee7-2cc174a58a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:17:16.898244 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-f469d711-fcf2-41c8-9ee7-2cc174a58a93 None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:17:16.899602 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f469d711-fcf2-41c8-9ee7-2cc174a58a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:17:16.959200 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1460/2935] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:17:16.966891 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a122be-5902-43ac-b575-79ef2ecbbede None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:17:16.967181 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a122be-5902-43ac-b575-79ef2ecbbede None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:17:16.967460 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a122be-5902-43ac-b575-79ef2ecbbede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:17:16.987255 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-09a122be-5902-43ac-b575-79ef2ecbbede None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:17:16.988455 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-09a122be-5902-43ac-b575-79ef2ecbbede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:17:16.996297 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1476/2936] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:17:17.000626 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469d711-fcf2-41c8-9ee7-2cc174a58a93 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:17:17.011078 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469d711-fcf2-41c8-9ee7-2cc174a58a93 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:17:17.015687 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f99237-ca77-4aca-b34f-0aa190e3c2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:17:17.016393 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f99237-ca77-4aca-b34f-0aa190e3c2ba admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:17:17.016678 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f99237-ca77-4aca-b34f-0aa190e3c2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:17:17.017580 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f99237-ca77-4aca-b34f-0aa190e3c2ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:17:17.018255 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f99237-ca77-4aca-b34f-0aa190e3c2ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 01:17:17.018567 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f99237-ca77-4aca-b34f-0aa190e3c2ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:17:17.020152 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f99237-ca77-4aca-b34f-0aa190e3c2ba admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:17:17.031895 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1461/2937] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 14 01:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 01:17:17.036130 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a122be-5902-43ac-b575-79ef2ecbbede None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:17:17.045295 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a122be-5902-43ac-b575-79ef2ecbbede None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:17:17.049924 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2957a-3560-4965-a26a-583ae806b40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:17:17.050515 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2957a-3560-4965-a26a-583ae806b40c admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:17:17.050792 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2957a-3560-4965-a26a-583ae806b40c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:17:17.051063 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2957a-3560-4965-a26a-583ae806b40c admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:17:17.051692 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2957a-3560-4965-a26a-583ae806b40c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:17:17.053587 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2957a-3560-4965-a26a-583ae806b40c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:17:17.082133 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1477/2938] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 14 01:17:17 2022] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:17:17.086167 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f99237-ca77-4aca-b34f-0aa190e3c2ba admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:17:17.097556 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f99237-ca77-4aca-b34f-0aa190e3c2ba admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:17:17.152196 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246fc85-be05-4abe-b8cb-7f0ddb36a6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:17:17.152794 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246fc85-be05-4abe-b8cb-7f0ddb36a6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:17:17.153071 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246fc85-be05-4abe-b8cb-7f0ddb36a6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:17:17.153341 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246fc85-be05-4abe-b8cb-7f0ddb36a6b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:17:17.153988 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246fc85-be05-4abe-b8cb-7f0ddb36a6b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:17:17.155889 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246fc85-be05-4abe-b8cb-7f0ddb36a6b6 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:17:17.164199 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:17:17.178129 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1462/2939] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 14 01:17:17 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 01:17:17.182230 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2957a-3560-4965-a26a-583ae806b40c admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:17:17.192289 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2957a-3560-4965-a26a-583ae806b40c admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:17:17.196771 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cb037-31c8-446e-a6c4-3a3f5d1822b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:17:17.197360 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cb037-31c8-446e-a6c4-3a3f5d1822b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:17:17.197636 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cb037-31c8-446e-a6c4-3a3f5d1822b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:17:17.197940 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cb037-31c8-446e-a6c4-3a3f5d1822b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:17:17.198569 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200cb037-31c8-446e-a6c4-3a3f5d1822b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:17:17.200137 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200cb037-31c8-446e-a6c4-3a3f5d1822b7 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:17:17.209820 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1478/2940] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:17:17.213482 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246fc85-be05-4abe-b8cb-7f0ddb36a6b6 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:17:17.223959 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246fc85-be05-4abe-b8cb-7f0ddb36a6b6 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:17:17.228511 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00af0b-43f5-4f0f-afed-f81b80c2df9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:17:17.229087 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00af0b-43f5-4f0f-afed-f81b80c2df9e admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:17:17.229363 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00af0b-43f5-4f0f-afed-f81b80c2df9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:17:17.229633 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00af0b-43f5-4f0f-afed-f81b80c2df9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:17:17.230312 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00af0b-43f5-4f0f-afed-f81b80c2df9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:17:17.231957 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00af0b-43f5-4f0f-afed-f81b80c2df9e admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:17:17.242293 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1463/2941] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 14 01:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 01:17:17.246124 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cb037-31c8-446e-a6c4-3a3f5d1822b7 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:17:17.257004 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cb037-31c8-446e-a6c4-3a3f5d1822b7 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:17:17.263518 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2ffaf-9980-486c-ad22-c88cc95f7f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:17:17.264496 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2ffaf-9980-486c-ad22-c88cc95f7f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:17:17.264893 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2ffaf-9980-486c-ad22-c88cc95f7f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:17:17.265275 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2ffaf-9980-486c-ad22-c88cc95f7f21 admin admin] PATH_INFO: `/v3/projects/5e5dcdeaceca4a18b276cee65a834364/users/d72250f03405402f84749533ba5994f9/roles/ee3984f710984de6bf564de3bee00d33` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:17:17.286217 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2ffaf-9980-486c-ad22-c88cc95f7f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5dcdeaceca4a18b276cee65a834364, user_id=d72250f03405402f84749533ba5994f9, role_id=ee3984f710984de6bf564de3bee00d33)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:17:17.288930 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2ffaf-9980-486c-ad22-c88cc95f7f21 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:17:17.304265 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1479/2942] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 14 01:17:17 2022] PUT /identity/v3/projects/5e5dcdeaceca4a18b276cee65a834364/users/d72250f03405402f84749533ba5994f9/roles/ee3984f710984de6bf564de3bee00d33 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:17:17.315559 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71d9f2-c1fc-4558-8495-3d0b72f7d978 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:17:17.315846 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71d9f2-c1fc-4558-8495-3d0b72f7d978 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:17:17.316121 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71d9f2-c1fc-4558-8495-3d0b72f7d978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:17:17.343731 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-7e71d9f2-c1fc-4558-8495-3d0b72f7d978 None None] MFA Rules not processed for user `d72250f03405402f84749533ba5994f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:17:17.345580 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7e71d9f2-c1fc-4558-8495-3d0b72f7d978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:17:17.408380 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1464/2943] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:17:17 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:17:17.419798 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2ffaf-9980-486c-ad22-c88cc95f7f21 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:17:17.421542 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-89f2ffaf-9980-486c-ad22-c88cc95f7f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:17:17.435705 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:17:17.480894 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2ffaf-9980-486c-ad22-c88cc95f7f21 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:17:17.484511 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd15bf-4be7-4c12-82df-f5e451ac22d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50394b1ba51b45a6bf833b63ff7e423b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:17:17.485113 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd15bf-4be7-4c12-82df-f5e451ac22d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:17:17.485393 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd15bf-4be7-4c12-82df-f5e451ac22d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:17:17.485666 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd15bf-4be7-4c12-82df-f5e451ac22d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:17:17.494085 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd15bf-4be7-4c12-82df-f5e451ac22d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:17:17.495513 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd15bf-4be7-4c12-82df-f5e451ac22d3 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:17:17.504222 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1480/2944] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:17:17 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:17:22.470610 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71d9f2-c1fc-4558-8495-3d0b72f7d978 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:17:22.533059 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71d9f2-c1fc-4558-8495-3d0b72f7d978 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:17:22.537462 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41892c25-6eb3-4ee2-a9f3-7d06f2898eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:17:22.538104 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41892c25-6eb3-4ee2-a9f3-7d06f2898eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:17:22.538379 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41892c25-6eb3-4ee2-a9f3-7d06f2898eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:17:22.538647 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41892c25-6eb3-4ee2-a9f3-7d06f2898eaf admin admin] PATH_INFO: `/v3/users/d72250f03405402f84749533ba5994f9` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:17:22.539742 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41892c25-6eb3-4ee2-a9f3-7d06f2898eaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d72250f03405402f84749533ba5994f9)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:17:22.541647 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41892c25-6eb3-4ee2-a9f3-7d06f2898eaf admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:17:22.587839 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-41892c25-6eb3-4ee2-a9f3-7d06f2898eaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd72250f03405402f84749533ba5994f9'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:17:22.588490 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-41892c25-6eb3-4ee2-a9f3-7d06f2898eaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd72250f03405402f84749533ba5994f9'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:17:22.595346 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-41892c25-6eb3-4ee2-a9f3-7d06f2898eaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd72250f03405402f84749533ba5994f9'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:17:22.606206 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:17:22.608675 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-41892c25-6eb3-4ee2-a9f3-7d06f2898eaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd72250f03405402f84749533ba5994f9'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:17:22.609455 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-41892c25-6eb3-4ee2-a9f3-7d06f2898eaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd72250f03405402f84749533ba5994f9'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:17:22.623505 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1465/2945] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 14 01:17:22 2022] DELETE /identity/v3/users/d72250f03405402f84749533ba5994f9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:17:22.628536 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f21651-0939-4884-806a-71bea8b63efd None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:17:22.629027 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f21651-0939-4884-806a-71bea8b63efd None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:17:22.629127 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f21651-0939-4884-806a-71bea8b63efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:17:22.648526 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-15f21651-0939-4884-806a-71bea8b63efd None None] MFA Rules not processed for user `07ccce5a2a4546febae17d32e636d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 01:17:22.649762 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-15f21651-0939-4884-806a-71bea8b63efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:17:22.708555 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1481/2946] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 14 01:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 01:17:22.718052 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41892c25-6eb3-4ee2-a9f3-7d06f2898eaf admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:17:22.719452 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-41892c25-6eb3-4ee2-a9f3-7d06f2898eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:17:22.774353 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41892c25-6eb3-4ee2-a9f3-7d06f2898eaf admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:17:22.778200 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a7da7-a7a1-4af6-be05-197765639e64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4444b17075f4224a4da1ef501fd4eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:17:22.778783 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a7da7-a7a1-4af6-be05-197765639e64 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:17:22.779052 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a7da7-a7a1-4af6-be05-197765639e64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:17:22.779315 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a7da7-a7a1-4af6-be05-197765639e64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:17:22.788738 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a7da7-a7a1-4af6-be05-197765639e64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:17:22.790216 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a7da7-a7a1-4af6-be05-197765639e64 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:17:22.799371 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1466/2947] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:17:23.055429 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f21651-0939-4884-806a-71bea8b63efd None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:17:23.056840 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-15f21651-0939-4884-806a-71bea8b63efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:17:23.069612 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f21651-0939-4884-806a-71bea8b63efd None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:17:23.074407 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa09851-edaf-4c0a-bcb1-77f5fbb76eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ccce5a2a4546febae17d32e636d9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e0a2fe229b4532ac18c75cfe42e13c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:17:23.075031 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa09851-edaf-4c0a-bcb1-77f5fbb76eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:17:23.075307 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa09851-edaf-4c0a-bcb1-77f5fbb76eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:17:23.075575 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa09851-edaf-4c0a-bcb1-77f5fbb76eab admin admin] PATH_INFO: `/v3/projects/5e5dcdeaceca4a18b276cee65a834364` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:17:23.076720 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa09851-edaf-4c0a-bcb1-77f5fbb76eab admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e5dcdeaceca4a18b276cee65a834364)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:17:23.078643 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa09851-edaf-4c0a-bcb1-77f5fbb76eab admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:17:23.125405 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-faa09851-edaf-4c0a-bcb1-77f5fbb76eab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e5dcdeaceca4a18b276cee65a834364', 'request_id': 'req-faa09851-edaf-4c0a-bcb1-77f5fbb76eab'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:17:23.133430 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-faa09851-edaf-4c0a-bcb1-77f5fbb76eab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e5dcdeaceca4a18b276cee65a834364', 'request_id': 'req-faa09851-edaf-4c0a-bcb1-77f5fbb76eab'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:17:23.139615 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-faa09851-edaf-4c0a-bcb1-77f5fbb76eab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e5dcdeaceca4a18b276cee65a834364', 'request_id': 'req-faa09851-edaf-4c0a-bcb1-77f5fbb76eab'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:17:23.150603 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-faa09851-edaf-4c0a-bcb1-77f5fbb76eab admin admin] The token cache is being invalidate because project 5e5dcdeaceca4a18b276cee65a834364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 01:17:23.151160 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-faa09851-edaf-4c0a-bcb1-77f5fbb76eab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:17:23.151789 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-faa09851-edaf-4c0a-bcb1-77f5fbb76eab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 01:17:23.153268 dv-cinder-857528-1-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1482/2948] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 14 01:17:23 2022] DELETE /identity/v3/projects/5e5dcdeaceca4a18b276cee65a834364 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 01:17:32.795220 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:DELETE=2,keystone:SELECT=29,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:17:33.147509 dv-cinder-857528-1-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:17:58.670843 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a7da7-a7a1-4af6-be05-197765639e64 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 01:17:58.672225 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-740a7da7-a7a1-4af6-be05-197765639e64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:17:58.741858 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a7da7-a7a1-4af6-be05-197765639e64 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 01:17:58.799318 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95586c7-e254-469a-87c6-b9729f3a18e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abf9ab5fafe94afdb3ebe98536b5cc3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37c835c05924364bcd1530d44f024fe', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 01:17:58.799909 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95586c7-e254-469a-87c6-b9729f3a18e5 service placement] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 01:17:58.800180 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95586c7-e254-469a-87c6-b9729f3a18e5 service placement] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 01:17:58.800446 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95586c7-e254-469a-87c6-b9729f3a18e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 01:17:58.802209 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a95586c7-e254-469a-87c6-b9729f3a18e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 01:17:58.813353 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95586c7-e254-469a-87c6-b9729f3a18e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 01:17:58.814921 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95586c7-e254-469a-87c6-b9729f3a18e5 service placement] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 01:17:58.825033 dv-cinder-857528-1-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1467/2949] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 14 01:17:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 01:18:08.820312 dv-cinder-857528-1-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=58 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}